00000001:02000400:0.0F:1789477138.359667:0:2965:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg123-server.virtnet: executing set_hostid 00000001:02000400:0.0:1789477156.381053:0:3187:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg123-server.virtnet: executing load_modules_local 00000001:01000000:1.0F:1789477158.604389:0:3250:0:(lnet-crypto.c:359:cfs_crypto_performance_test()) Crypto hash algorithm adler32 speed = 529 MB/s 00000001:01000000:2.0F:1789477158.854297:0:3250:0:(lnet-crypto.c:359:cfs_crypto_performance_test()) Crypto hash algorithm crc32 speed = 583 MB/s 00000001:01000000:3.0F:1789477159.106354:0:3250:0:(lnet-crypto.c:359:cfs_crypto_performance_test()) Crypto hash algorithm crc32c speed = 4760 MB/s 00000020:02000000:2.0:1789477159.855428:0:3279:0:(class_obd.c:771:obdclass_init()) Lustre: Build Version: 2.17.57_84_gd41d3c6 00000400:02000000:1.0:1789477160.812952:0:3294:0:(api-ni.c:2823:lnet_startup_lndni()) Added LNI 192.168.201.123@tcp [8/256/0/180] 00008000:02000000:2.0:1789477164.315698:0:3444:0:(echo_client.c:2574:obdecho_init()) Echo OBD driver; http://www.lustre.org/ 00000001:02000400:1.0:1789477213.126241:0:5255:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg123-server.virtnet: executing load_modules_local 00000020:01000004:2.0:1789477223.963352:0:5825:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1789477223.963359:0:5825:0:(obd_mount.c:926:lmd_print()) device: lustre-mdt1/mdt1 00000080:01200004:2.0:1789477223.963523:0:5825:0:(super25.c:131:lustre_fill_super()) VFS Op: sb 000000006f803582 00000080:02000400:2.0:1789477223.963549:0:5825:0:(super25.c:149:lustre_fill_super()) lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' 00000020:01000004:2.0:1789477223.984389:0:5825:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-MDT0000, type=osd-zfs, lsifl=200065, mountfl=0 00000020:01000004:2.0:1789477223.984405:0:5825:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-zfs) 00000020:00000080:2.0:1789477223.984451:0:5825:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (00000000083f5a9d) 00000020:00000080:2.0:1789477223.984471:0:5825:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-zfs with refcount 2 00100000:10000000:2.0:1789477224.039720:0:5825:0:(scrub.c:230:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:2.0:1789477224.040101:0:5825:0:(scrub.c:230:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:3.0:1789477224.081956:0:5825:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:3.0:1789477224.082001:0:5825:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:3.0:1789477224.082024:0:5825:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:3.0:1789477224.082079:0:5825:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:3.0:1789477224.082105:0:5825:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:3.0:1789477224.083211:0:5825:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:3.0:1789477224.083227:0:5825:0:(osd_handler.c:1564:osd_obd_connect()) connect #0 00000020:00000080:3.0:1789477224.083246:0:5825:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xafddb3c8f9281363 00000020:01000004:3.0:1789477224.083258:0:5825:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-MDT0000 on device lustre-mdt1/mdt1 00000020:01000000:3.0:1789477224.083264:0:5825:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:3.0:1789477224.083270:0:5825:0:(tgt_mount.c:101:server_register_mount()) register mount 000000006f803582 from MGS 00000020:01000004:3.0:1789477224.083277:0:5825:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:3.0:1789477224.083313:0:5825:0:(genops.c:413:class_newdev()) Allocate new device MGS (000000006e9abac7) 00000020:00000080:3.0:1789477224.083328:0:5825:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:3.0:1789477224.084484:0:5825:0:(tgt_mount.c:153:server_get_mount()) get mount 000000006f803582 from MGS, refs=2 00080000:01000000:3.0:1789477224.084500:0:5825:0:(osd_handler.c:1564:osd_obd_connect()) connect #1 00000020:00000080:3.0:1789477224.084513:0:5825:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xafddb3c8f9281371 00000100:00100000:3.0:1789477224.084837:0:5825:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:3.0:1789477224.085074:0:5825:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:3.0:1789477224.085091:0:5825:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:2.0:1789477224.085758:0:5825:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:2.0:1789477224.085768:0:5825:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:2.0:1789477224.088406:0:5825:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789477224.088706:0:5825:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:2.0:1789477224.088714:0:5825:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:1.0:1789477224.090350:0:5825:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:1.0:1789477224.090371:0:5825:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:2.0:1789477224.092731:0:5825:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:2.0:1789477224.092757:0:5825:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:0.0:1789477224.093482:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789477224.093486:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789477224.093487:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789477224.093698:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789477224.093700:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789477224.093702:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789477224.094686:0:5825:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:0.0:1789477224.098399:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:01000000:1.0:1789477224.345186:0:5825:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip512 speed = 1699 MB/s 00000001:01000000:3.0:1789477224.595673:0:5825:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip4K speed = 3239 MB/s 00000001:01000000:3.0:1789477224.845968:0:5825:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc512 speed = 427 MB/s 00000001:01000000:0.0:1789477225.098157:0:5825:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc4K speed = 515 MB/s 00080000:10000000:0.0:1789477225.108047:0:5825:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x3:0x0] (8/8/4) registered 00010000:00010000:2.0:1789477225.137084:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:1.0:1789477225.148996:0:5825:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 20000000:01000000:1.0:1789477225.149025:0:5825:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:1.0:1789477225.149028:0:5825:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 10000000:01000000:0.0:1789477225.164817:0:5836:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:2.0:1789477225.164920:0:5825:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:2.0:1789477225.165010:0:5825:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000040:00080000:2.0:1789477225.165332:0:5825:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:2.0:1789477225.165377:0:5825:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:2.0:1789477225.173871:0:5825:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789477225.174176:0:5825:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:2.0:1789477225.174184:0:5825:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:0.0:1789477225.182335:0:5825:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:0.0:1789477225.182359:0:5825:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:0.0:1789477225.187385:0:5825:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:0.0:1789477225.187408:0:5825:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:0.0:1789477225.195242:0:5825:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:0.0:1789477225.195270:0:5825:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.201.123@tcp' 00000020:01000004:0.0:1789477225.195271:0:5825:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:0.0:1789477225.195337:0:5825:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.201.123@tcp (typ=mgc) 00000020:00000080:0.0:1789477225.195361:0:5825:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.201.123@tcp (00000000d1efce88) 00000020:00000080:0.0:1789477225.195379:0:5825:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:0.0:1789477225.195491:0:5825:0:(ldlm_lib.c:102:import_set_conn()) imp 0000000090eacadf@MGC192.168.201.123@tcp: add connection 192.168.201.123@tcp at head 00000100:00080000:2.0:1789477225.195828:0:5840:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 00010000:00010000:1.0:1789477225.195892:0:5825:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.201.123@tcp-0 is initialized 00000040:01000000:1.0:1789477225.195906:0:5825:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.123@tcp ctxt 1 is initialized 10000000:01000000:0.0:1789477225.197382:0:5841:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:3.0:1789477225.198304:0:5825:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.201.123@tcp (uuid 07d5e05c-913f-419f-adbc-d3cf15e9cd51) 00000020:00000080:3.0:1789477225.198329:0:5825:0:(genops.c:1385:class_connect()) connect: client 07d5e05c-913f-419f-adbc-d3cf15e9cd51, cookie 0xafddb3c8f928137f 00000100:00080000:3.0:1789477225.198342:0:5825:0:(import.c:510:import_select_connection()) MGC192.168.201.123@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1789477225.198351:0:5825:0:(import.c:625:import_select_connection()) MGC192.168.201.123@tcp: import 0000000090eacadf using connection 192.168.201.123@tcp/0@lo 00000100:00100000:3.0:1789477225.198401:0:5825:0:(import.c:827:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000b794fda7 x1876402802524288/t0(0) o250->MGC192.168.201.123@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1789477225.198440:0:5825:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import 07d5e05c-913f-419f-adbc-d3cf15e9cd51->MGS 00000020:01000004:3.0:1789477225.198464:0:5825:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:3.0:1789477225.198470:0:5825:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:3.0:1789477225.198483:0:5825:0:(genops.c:413:class_newdev()) Allocate new device MDS (00000000eec79f8d) 00000020:00000080:3.0:1789477225.198496:0:5825:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:1.0:1789477225.200688:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000b794fda7 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:07d5e05c-913f-419f-adbc-d3cf15e9cd51:3309:1876402802524288:0@lo:250: 00000100:00100000:1.0:1789477225.200767:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789477225.200874:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802524288 00000100:00100000:1.0:1789477225.200883:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802524288 00000100:00100000:1.0:1789477225.200925:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789477225.200932:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c73884fc pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3309:x1876402802524288:12345-0@lo:250: 00010000:00080000:1.0:1789477225.200961:0:5837:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from 07d5e05c-913f-419f-adbc-d3cf15e9cd51@0@lo t0 exp 0000000000000000 cur 170 last 0 00000020:00000080:1.0:1789477225.200988:0:5837:0:(genops.c:1385:class_connect()) connect: client 07d5e05c-913f-419f-adbc-d3cf15e9cd51, cookie 0xafddb3c8f928138d 00000100:00080000:1.0:1789477225.201156:0:5837:0:(import.c:65:import_set_state_nolock()) 00000000d05e9e4e : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789477225.201212:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c73884fc pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07d5e05c-913f-419f-adbc-d3cf15e9cd51+5:3309:x1876402802524288:12345-0@lo:250: Request processed in 279us (445us total) trans 0 rc 0/0 00000100:00100000:1.0:1789477225.201219:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789477225.201258:0:3309:0:(client.c:3125:ptlrpc_free_committed()) MGC192.168.201.123@tcp: committing for last_committed 0 gen 1 00000100:00080000:1.0:1789477225.201268:0:3309:0:(import.c:1133:ptlrpc_connect_interpret()) MGC192.168.201.123@tcp: connect to target with instance 0 00000100:00080000:1.0:1789477225.201276:0:3309:0:(import.c:957:ptlrpc_connect_set_flags()) MGC192.168.201.123@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:1.0:1789477225.201280:0:3309:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:1.0:1789477225.201283:0:3309:0:(import.c:65:import_set_state_nolock()) 0000000090eacadf MGS: changing import state from CONNECTING to FULL 10000000:01000000:1.0:1789477225.201286:0:3309:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:1.0:1789477225.201294:0:3309:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:1.0:1789477225.201305:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000b794fda7 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:07d5e05c-913f-419f-adbc-d3cf15e9cd51:3309:1876402802524288:0@lo:250: 00000100:00100000:3.0:1789477225.224708:0:5825:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1789477225.225804:0:5825:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:3.0:1789477225.225814:0:5825:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:2.0:1789477225.236009:0:5825:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:2.0:1789477225.236041:0:5825:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:2.0:1789477225.240252:0:5825:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:2.0:1789477225.240283:0:5825:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:2.0:1789477225.244121:0:5825:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789477225.244798:0:5825:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:2.0:1789477225.244809:0:5825:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:3.0:1789477225.246555:0:5825:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:3.0:1789477225.246758:0:5825:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:2.0:1789477225.329858:0:5825:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789477225.330214:0:5825:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:2.0:1789477225.330221:0:5825:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:2.0:1789477225.332258:0:5825:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:2.0:1789477225.332283:0:5825:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:2.0:1789477225.337936:0:5825:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789477225.338148:0:5825:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:2.0:1789477225.338156:0:5825:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:2.0:1789477225.339704:0:5825:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:2.0:1789477225.339716:0:5825:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:3.0:1789477225.341175:0:5825:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1789477225.341349:0:5825:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:3.0:1789477225.341354:0:5825:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:3.0:1789477225.343111:0:5825:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:3.0:1789477225.343123:0:5825:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:0.0:1789477225.344054:0:5825:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1789477225.344229:0:5825:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:0.0:1789477225.344235:0:5825:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:2.0:1789477225.355237:0:5825:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:2.0:1789477225.355263:0:5825:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:0.0:1789477225.407544:0:5825:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1789477225.407778:0:5825:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:0.0:1789477225.407785:0:5825:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:2.0:1789477225.414866:0:5825:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:2.0:1789477225.414883:0:5825:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:2.0:1789477225.416825:0:5825:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:2.0:1789477225.416839:0:5825:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:2.0:1789477225.418295:0:5825:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:2.0:1789477225.418321:0:5825:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-mdt1/mdt1 10000000:01000000:2.0:1789477225.418328:0:5825:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.201.123@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:2.0:1789477225.418465:0:5825:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.123@tcp ctxt 0 is initialized 00000020:01000004:2.0:1789477225.418500:0:5825:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.201.123@tcp, index=0000, flags=0x20065 00000020:01000004:2.0:1789477225.418505:0:5825:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1789477225.418517:0:5825:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1789477225.418518:0:5825:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789477225.418519:0:5825:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789477225.418520:0:5825:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789477225.418522:0:5825:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789477225.418523:0:5825:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1789477225.418525:0:5825:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1789477225.418526:0:5825:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1789477225.418533:0:5825:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1789477225.418534:0:5825:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789477225.418536:0:5825:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1789477225.418538:0:5825:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020065 00000020:01000004:2.0:1789477225.418540:0:5825:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1789477225.418541:0:5825:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1789477225.418543:0:5825:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789477225.418543:0:5825:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789477225.418544:0:5825:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789477225.418545:0:5825:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789477225.418546:0:5825:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1789477225.418547:0:5825:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1789477225.418548:0:5825:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1789477225.418549:0:5825:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1789477225.418550:0:5825:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789477225.418551:0:5825:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1789477225.418832:0:5825:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:2.0:1789477225.418849:0:5825:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000eca96d96 pname:cluuid:pid:xid:nid:opc:job mount.lustre:07d5e05c-913f-419f-adbc-d3cf15e9cd51:5825:1876402802524416:0@lo:253: 00000100:00100000:2.0:1789477225.418929:0:5825:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789477225.418978:0:5825:0:(client.c:2715:ptlrpc_set_wait()) set 00000000bb4e3ef3 going to sleep for 11 seconds 00000100:00100000:1.0:1789477225.419539:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802524416 00000100:00100000:1.0:1789477225.419549:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802524416 00000100:00100000:1.0:1789477225.419617:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789477225.419627:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000000d45c13a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:07d5e05c-913f-419f-adbc-d3cf15e9cd51+5:5825:x1876402802524416:12345-0@lo:253: 20000000:01000000:1.0:1789477225.419679:0:5839:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1789477225.419682:0:5839:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 10000000:01000000:1.0:1789477225.420609:0:5861:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:2.0:1789477225.420796:0:5839:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 00000040:00080000:2.0:1789477225.421091:0:5839:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789477225.422361:0:5862:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 1 20000000:01000000:2.0:1789477225.423912:0:5839:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:2.0:1789477225.423919:0:5839:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-MDT0000, index=0 20000000:01000000:2.0:1789477225.423925:0:5839:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-MDT0000 to 0 20000000:01000000:2.0:1789477225.423928:0:5839:0:(mgs_llog.c:3612:mgs_write_log_mdt()) writing new mdt lustre-MDT0000 20000000:01000000:2.0:1789477225.423944:0:5839:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-MDT0000-mdtlov) log for lustre-MDT0000 00000040:00080000:2.0:1789477225.424157:0:5839:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1789477225.424404:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 20000000:01000000:2.0:1789477225.424417:0:5839:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf001 lov lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:2.0:1789477225.424463:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 136 off8552 00000040:00080000:2.0:1789477225.424521:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 176 off8728 00000040:00080000:2.0:1789477225.424560:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8952 00000040:00080000:2.0:1789477225.424683:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9176 20000000:01000000:2.0:1789477225.424703:0:5839:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf001 mdt lustre-MDT0000_UUID (null) (null) 00000040:00080000:2.0:1789477225.424749:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9296 20000000:01000000:2.0:1789477225.424764:0:5839:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-MDT0000 lustre-MDT0000-mdtlov (null) (null) 00000040:00080000:2.0:1789477225.424800:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 112 off9408 20000000:01000000:2.0:1789477225.424808:0:5839:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf003 lustre-MDT0000_UUID 0 lustre-MDT0000-mdtlov f 00000040:00080000:2.0:1789477225.424839:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 160 off9568 00000040:00080000:2.0:1789477225.424888:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9792 00000040:00080000:2.0:1789477225.424921:0:5839:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:2.0:1789477225.424926:0:5839:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-clilov) log for lustre-client 00000040:00080000:2.0:1789477225.424939:0:5839:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1789477225.425140:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 20000000:01000000:2.0:1789477225.425150:0:5839:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf001 lov lustre-clilov_UUID (null) (null) 00000040:00080000:2.0:1789477225.425196:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 120 off8536 00000040:00080000:2.0:1789477225.425230:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 168 off8704 00000040:00080000:2.0:1789477225.425283:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].4, 224 off8928 20000000:01000000:2.0:1789477225.425296:0:5839:0:(mgs_llog.c:3129:mgs_write_log_lmv()) Writing lmv(lustre-clilmv) log for lustre-client 00000040:00080000:2.0:1789477225.425368:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].5, 224 off9152 20000000:01000000:2.0:1789477225.425377:0:5839:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf001 lmv lustre-clilmv_UUID (null) (null) 00000040:00080000:2.0:1789477225.425418:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].6, 120 off9272 00000040:00080000:2.0:1789477225.425453:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].7, 168 off9440 00000040:00080000:2.0:1789477225.425484:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].8, 224 off9664 20000000:01000000:2.0:1789477225.425494:0:5839:0:(mgs_llog.c:3094:mgs_write_log_mount_opt()) Writing mount options log for lustre-client 00000040:00080000:2.0:1789477225.425608:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].9, 224 off9888 20000000:01000000:2.0:1789477225.425617:0:5839:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-client lustre-clilov lustre-clilmv (null) 00000040:00080000:2.0:1789477225.425652:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].10, 120 off10008 00000040:00080000:2.0:1789477225.425685:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].11, 224 off10232 00000040:00080000:2.0:1789477225.425847:0:5839:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 20000000:01000000:2.0:1789477225.425893:0:5839:0:(mgs_llog.c:3309:mgs_write_log_mdc_to_lmv()) adding mdc for lustre-MDT0000 to log lustre-client:lmv(lustre-clilmv) 20000000:01000000:2.0:1789477225.425900:0:5839:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre-MDT0000/add mdc fl=4 00000040:00080000:1.0:1789477225.431257:0:5863:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 00000040:00080000:3.0:1789477225.431756:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].12, 224 off10456 20000000:01000000:3.0:1789477225.431789:0:5839:0:(mgs_llog.c:3355:mgs_write_log_mdc_to_lmv()) add nid 192.168.201.123@tcp for mdt 20000000:01000000:3.0:1789477225.431791:0:5839:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.201.123@tcp (null) (null) (null) 00000040:00080000:3.0:1789477225.431831:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].13, 88 off10544 20000000:01000000:3.0:1789477225.431839:0:5839:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf001 mdc lustre-clilmv_UUID (null) (null) 00000040:00080000:3.0:1789477225.431868:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].14, 128 off10672 20000000:01000000:3.0:1789477225.431875:0:5839:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf003 lustre-MDT0000_UUID 192.168.201.123@tcp (null) (null) 00000040:00080000:3.0:1789477225.431921:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].15, 144 off10816 20000000:01000000:3.0:1789477225.431931:0:5839:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf014 lustre-MDT0000_UUID 0 1 lustre-MDT0000-mdc_UUID 00000040:00080000:3.0:1789477225.431963:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].16, 160 off10976 00000040:00080000:3.0:1789477225.431998:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].17, 224 off11200 20000000:01000000:3.0:1789477225.432063:0:5839:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity ', param: 'sys.timeout=20' 20000000:01000000:3.0:1789477225.432067:0:5839:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:3.0:1789477225.432071:0:5839:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:3.0:1789477225.432094:0:5839:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:3.0:1789477225.432101:0:5839:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:3.0:1789477225.432132:0:5839:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:3.0:1789477225.432135:0:5839:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 00000040:00080000:3.0:1789477225.434386:0:5864:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 18 count 18 00000040:00080000:2.0:1789477225.434883:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].18, 224 off11424 00000040:00080000:2.0:1789477225.434935:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].19, 80 off11504 00000040:00080000:2.0:1789477225.434970:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].20, 224 off11728 20000000:01000000:2.0:1789477225.434984:0:5839:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:2.0:1789477225.434987:0:5839:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 00000040:00080000:1.0:1789477225.435565:0:5865:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 10 count 10 00000040:00080000:2.0:1789477225.436033:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 224 off10016 00000040:00080000:2.0:1789477225.436075:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 80 off10096 00000040:00080000:2.0:1789477225.436138:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10320 00000020:00000080:2.0:1789477225.436153:0:5839:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1789477225.436155:0:5839:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 100 to 20 20000000:01000000:2.0:1789477225.436161:0:5839:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:2.0:1789477225.436164:0:5839:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:2.0:1789477225.436171:0:5839:0:(mgs_llog.c:5072:mgs_write_log_param()) mdt param identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity 20000000:01000000:2.0:1789477225.436179:0:5839:0:(mgs_llog.c:1379:mgs_modify_param()) modify lustre-MDT0000/lustre-MDT0000/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity del=0 00000040:00080000:1.0:1789477225.436941:0:5866:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 13 count 13 20000000:02000000:2.0:1789477225.437080:0:5839:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 00000040:00080000:2.0:1789477225.447320:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 224 off10544 00000040:00080000:2.0:1789477225.447386:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 160 off10704 00000040:00080000:2.0:1789477225.447477:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 224 off10928 10000000:01000000:2.0:1789477225.447517:0:5839:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:2.0:1789477225.447545:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 0000000079828e56/0xafddb3c8f9281394 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477225.447567:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000079828e56/0xafddb3c8f9281394 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477225.447612:0:5839:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 0000000079828e56/0xafddb3c8f9281394 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477225.447621:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 0000000079828e56/0xafddb3c8f9281394 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477225.447628:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 0000000079828e56/0xafddb3c8f9281394 lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477225.447636:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 0000000079828e56/0xafddb3c8f9281394 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477225.447658:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000079828e56 already unused, calling callback (00000000dfb29c3b) 00010000:00010000:2.0:1789477225.447663:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 0000000079828e56/0xafddb3c8f9281394 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477225.447672:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 0000000079828e56/0xafddb3c8f9281394 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477225.447688:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 0000000079828e56/0xafddb3c8f9281394 lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477225.447696:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 0000000079828e56/0xafddb3c8f9281394 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477225.447702:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000079828e56/0xafddb3c8f9281394 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1789477225.447725:0:5839:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:1.0:1789477225.703896:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000000d45c13a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:07d5e05c-913f-419f-adbc-d3cf15e9cd51+5:5825:x1876402802524416:12345-0@lo:253: Request processed in 284263us (284959us total) trans 0 rc 0/0 00000100:00100000:1.0:1789477225.703913:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789477225.704137:0:5825:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000eca96d96 pname:cluuid:pid:xid:nid:opc:job mount.lustre:07d5e05c-913f-419f-adbc-d3cf15e9cd51:5825:1876402802524416:0@lo:253: 10000000:01000000:0.0:1789477225.704151:0:5825:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:0.0:1789477225.704153:0:5825:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1789477225.704155:0:5825:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1789477225.704156:0:5825:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789477225.704157:0:5825:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-MDT0000_UUID 00000020:01000004:0.0:1789477225.704223:0:5825:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789477225.704224:0:5825:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789477225.704225:0:5825:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1789477225.704226:0:5825:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1789477225.704227:0:5825:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:0.0:1789477225.704228:0:5825:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789477225.704230:0:5825:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1789477225.704248:0:5825:0:(tgt_mount.c:101:server_register_mount()) register mount 000000006f803582 from lustre-MDT0000 10000000:01000000:0.0:1789477225.704274:0:5825:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:0.0:1789477225.704277:0:5825:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:0.0:1789477225.704281:0:5825:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff9d0d482499b8 10000000:01000000:0.0:1789477225.704285:0:5825:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1789477225.704293:0:5825:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff9d0d482499b8 from 1 10000000:01000000:0.0:1789477225.704296:0:5825:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1789477225.704418:0:5825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.123@tcp lock: 000000006b55e165/0xafddb3c8f928139b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477225.704476:0:5825:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.123@tcp lock: 000000006b55e165/0xafddb3c8f928139b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477225.704484:0:5825:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.123@tcp lock: 000000006b55e165/0xafddb3c8f928139b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789477225.704499:0:5825:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000060ac3006 pname:cluuid:pid:xid:nid:opc:job mount.lustre:07d5e05c-913f-419f-adbc-d3cf15e9cd51:5825:1876402802524544:0@lo:101: 00000100:00100000:0.0:1789477225.704552:0:5825:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789477225.704598:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802524544 00000100:00100000:1.0:1789477225.704605:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802524544 00000100:00100000:1.0:1789477225.704647:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789477225.704656:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000008b75205 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07d5e05c-913f-419f-adbc-d3cf15e9cd51+5:5825:x1876402802524544:12345-0@lo:101: 00010000:00010000:1.0:1789477225.704668:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789477225.704682:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000006a13f80c/0xafddb3c8f92813a2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xafddb3c8f928139b expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477225.704703:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000006a13f80c/0xafddb3c8f92813a2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xafddb3c8f928139b expref: 6 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477225.704714:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000006a13f80c/0xafddb3c8f92813a2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xafddb3c8f928139b expref: 6 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477225.704723:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000006a13f80c, rc 0) 00000100:00100000:1.0:1789477225.704754:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000008b75205 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07d5e05c-913f-419f-adbc-d3cf15e9cd51+6:5825:x1876402802524544:12345-0@lo:101: Request processed in 100us (202us total) trans 0 rc 0/0 00000100:00100000:1.0:1789477225.704760:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1789477225.704804:0:5825:0:(client.c:2715:ptlrpc_set_wait()) set 000000007b45d52e going to sleep for 11 seconds 00000100:00100000:0.0:1789477225.704818:0:5825:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000060ac3006 pname:cluuid:pid:xid:nid:opc:job mount.lustre:07d5e05c-913f-419f-adbc-d3cf15e9cd51:5825:1876402802524544:0@lo:101: 00010000:00010000:0.0:1789477225.704834:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.123@tcp lock: 000000006b55e165/0xafddb3c8f928139b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xafddb3c8f92813a2 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477225.704840:0:5825:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.123@tcp lock: 000000006b55e165/0xafddb3c8f928139b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xafddb3c8f92813a2 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789477225.704881:0:5825:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000060ac3006 pname:cluuid:pid:xid:nid:opc:job mount.lustre:07d5e05c-913f-419f-adbc-d3cf15e9cd51:5825:1876402802524672:0@lo:501: 00000100:00100000:0.0:1789477225.705096:0:5825:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789477225.705121:0:5825:0:(client.c:2715:ptlrpc_set_wait()) set 000000007b45d52e going to sleep for 11 seconds 00000100:00100000:1.0:1789477225.705216:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802524672 00000100:00100000:1.0:1789477225.705220:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802524672 00000100:00100000:1.0:1789477225.705268:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789477225.705273:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d913b042 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:07d5e05c-913f-419f-adbc-d3cf15e9cd51+6:5825:x1876402802524672:12345-0@lo:501: 00000100:00100000:1.0:1789477225.705469:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d913b042 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:07d5e05c-913f-419f-adbc-d3cf15e9cd51+6:5825:x1876402802524672:12345-0@lo:501: Request processed in 196us (373us total) trans 0 rc -2/-2 00000100:00100000:1.0:1789477225.705474:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1789477225.705538:0:5825:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000060ac3006 pname:cluuid:pid:xid:nid:opc:job mount.lustre:07d5e05c-913f-419f-adbc-d3cf15e9cd51:5825:1876402802524672:0@lo:501: 10000000:01000000:0.0:1789477225.705566:0:5825:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.123@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1789477225.705602:0:5825:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.123@tcp lock: 000000006b55e165/0xafddb3c8f928139b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xafddb3c8f92813a2 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477225.705611:0:5825:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.123@tcp lock: 000000006b55e165/0xafddb3c8f928139b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xafddb3c8f92813a2 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789477225.705619:0:5825:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9d0d4444e800 10000000:01000000:0.0:1789477225.705623:0:5825:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1789477225.705626:0:5825:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff9d0d4444e800 10000000:01000000:0.0:1789477225.705627:0:5825:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:0.0:1789477225.705629:0:5825:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff9d0d4444e800 from 1 10000000:01000000:0.0:1789477225.705631:0:5825:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:0.0:1789477225.705644:0:5825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.123@tcp lock: 000000009d5a81ec/0xafddb3c8f92813a9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477225.705648:0:5825:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.123@tcp lock: 000000009d5a81ec/0xafddb3c8f92813a9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477225.705652:0:5825:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.123@tcp lock: 000000009d5a81ec/0xafddb3c8f92813a9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789477225.705660:0:5825:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000060ac3006 pname:cluuid:pid:xid:nid:opc:job mount.lustre:07d5e05c-913f-419f-adbc-d3cf15e9cd51:5825:1876402802524800:0@lo:101: 00000100:00100000:0.0:1789477225.705685:0:5825:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789477225.705720:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802524800 00000100:00100000:0.0:1789477225.705721:0:5825:0:(client.c:2715:ptlrpc_set_wait()) set 000000007b45d52e going to sleep for 11 seconds 00000100:00100000:1.0:1789477225.705725:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802524800 00000100:00100000:1.0:1789477225.705787:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1789477225.705794:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c46ccb85 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07d5e05c-913f-419f-adbc-d3cf15e9cd51+6:5825:x1876402802524800:12345-0@lo:101: 00010000:00010000:1.0:1789477225.705801:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789477225.705811:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000878bb6f2/0xafddb3c8f92813b0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xafddb3c8f92813a9 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477225.705824:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000878bb6f2/0xafddb3c8f92813b0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xafddb3c8f92813a9 expref: 7 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477225.705831:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000878bb6f2/0xafddb3c8f92813b0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xafddb3c8f92813a9 expref: 7 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477225.705837:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000878bb6f2, rc 0) 00000100:00100000:1.0:1789477225.705870:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c46ccb85 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07d5e05c-913f-419f-adbc-d3cf15e9cd51+7:5825:x1876402802524800:12345-0@lo:101: Request processed in 78us (184us total) trans 0 rc 0/0 00000100:00100000:1.0:1789477225.705876:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1789477225.706210:0:5825:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000060ac3006 pname:cluuid:pid:xid:nid:opc:job mount.lustre:07d5e05c-913f-419f-adbc-d3cf15e9cd51:5825:1876402802524800:0@lo:101: 00010000:00010000:0.0:1789477225.706219:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.123@tcp lock: 000000009d5a81ec/0xafddb3c8f92813a9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xafddb3c8f92813b0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477225.706224:0:5825:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.123@tcp lock: 000000009d5a81ec/0xafddb3c8f92813a9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xafddb3c8f92813b0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789477225.706233:0:5825:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.123@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:0.0:1789477225.706268:0:5825:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.123@tcp lock: 000000009d5a81ec/0xafddb3c8f92813a9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xafddb3c8f92813b0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477225.706272:0:5825:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.123@tcp lock: 000000009d5a81ec/0xafddb3c8f92813a9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xafddb3c8f92813b0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789477225.706276:0:5825:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:0.0:1789477225.706278:0:5825:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1789477225.706281:0:5825:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff9d0d4444e800 10000000:01000000:0.0:1789477225.706282:0:5825:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:0.0:1789477225.706284:0:5825:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:0.0:1789477225.706285:0:5825:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:0.0:1789477225.706295:0:5825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.123@tcp lock: 00000000d7ded8a6/0xafddb3c8f92813b7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477225.706299:0:5825:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.123@tcp lock: 00000000d7ded8a6/0xafddb3c8f92813b7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477225.706303:0:5825:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.123@tcp lock: 00000000d7ded8a6/0xafddb3c8f92813b7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789477225.706315:0:5825:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000060ac3006 pname:cluuid:pid:xid:nid:opc:job mount.lustre:07d5e05c-913f-419f-adbc-d3cf15e9cd51:5825:1876402802524928:0@lo:101: 00000100:00100000:0.0:1789477225.706344:0:5825:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789477225.706358:0:5825:0:(client.c:2715:ptlrpc_set_wait()) set 000000007b45d52e going to sleep for 11 seconds 00000100:00100000:1.0:1789477225.706383:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802524928 00000100:00100000:1.0:1789477225.706392:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802524928 00000100:00100000:1.0:1789477225.706457:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1789477225.706464:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000fae5221f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:07d5e05c-913f-419f-adbc-d3cf15e9cd51+7:5825:x1876402802524928:12345-0@lo:101: 00010000:00010000:1.0:1789477225.706472:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789477225.706480:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000006c968605/0xafddb3c8f92813be lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xafddb3c8f92813b7 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477225.706493:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000006c968605/0xafddb3c8f92813be lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xafddb3c8f92813b7 expref: 8 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477225.706510:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000006c968605/0xafddb3c8f92813be lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xafddb3c8f92813b7 expref: 8 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477225.706517:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000006c968605, rc 0) 00000100:00100000:1.0:1789477225.706544:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000fae5221f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:07d5e05c-913f-419f-adbc-d3cf15e9cd51+8:5825:x1876402802524928:12345-0@lo:101: Request processed in 81us (199us total) trans 0 rc 0/0 00000100:00100000:1.0:1789477225.706550:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1789477225.706573:0:5825:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000060ac3006 pname:cluuid:pid:xid:nid:opc:job mount.lustre:07d5e05c-913f-419f-adbc-d3cf15e9cd51:5825:1876402802524928:0@lo:101: 00010000:00010000:0.0:1789477225.706644:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.123@tcp lock: 00000000d7ded8a6/0xafddb3c8f92813b7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xafddb3c8f92813be expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477225.706651:0:5825:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.123@tcp lock: 00000000d7ded8a6/0xafddb3c8f92813b7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xafddb3c8f92813be expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789477225.706685:0:5825:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000060ac3006 pname:cluuid:pid:xid:nid:opc:job mount.lustre:07d5e05c-913f-419f-adbc-d3cf15e9cd51:5825:1876402802525056:0@lo:501: 00000100:00100000:0.0:1789477225.706786:0:5825:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789477225.706807:0:5825:0:(client.c:2715:ptlrpc_set_wait()) set 000000007b45d52e going to sleep for 11 seconds 00000100:00100000:1.0:1789477225.706822:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802525056 00000100:00100000:1.0:1789477225.706826:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802525056 00000100:00100000:1.0:1789477225.706854:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1789477225.706860:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d871ec87 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07d5e05c-913f-419f-adbc-d3cf15e9cd51+8:5825:x1876402802525056:12345-0@lo:501: 00000100:00100000:1.0:1789477225.707042:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d871ec87 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07d5e05c-913f-419f-adbc-d3cf15e9cd51+9:5825:x1876402802525056:12345-0@lo:501: Request processed in 182us (255us total) trans 0 rc 0/0 00000100:00100000:1.0:1789477225.707059:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1789477225.707072:0:5825:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000060ac3006 pname:cluuid:pid:xid:nid:opc:job mount.lustre:07d5e05c-913f-419f-adbc-d3cf15e9cd51:5825:1876402802525056:0@lo:501: 00000100:00100000:0.0:1789477225.707098:0:5825:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000060ac3006 pname:cluuid:pid:xid:nid:opc:job mount.lustre:07d5e05c-913f-419f-adbc-d3cf15e9cd51:5825:1876402802525184:0@lo:503: 00000100:00100000:0.0:1789477225.707136:0:5825:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789477225.707155:0:5825:0:(client.c:2715:ptlrpc_set_wait()) set 000000007b45d52e going to sleep for 11 seconds 00000100:00100000:1.0:1789477225.707215:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802525184 00000100:00100000:1.0:1789477225.707219:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802525184 00000100:00100000:1.0:1789477225.707249:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1789477225.707255:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000000436170 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:07d5e05c-913f-419f-adbc-d3cf15e9cd51+9:5825:x1876402802525184:12345-0@lo:503: 00000100:00100000:1.0:1789477225.707396:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000000436170 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:07d5e05c-913f-419f-adbc-d3cf15e9cd51+9:5825:x1876402802525184:12345-0@lo:503: Request processed in 141us (259us total) trans 0 rc 0/0 00000100:00100000:1.0:1789477225.707408:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1789477225.707489:0:5825:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000060ac3006 pname:cluuid:pid:xid:nid:opc:job mount.lustre:07d5e05c-913f-419f-adbc-d3cf15e9cd51:5825:1876402802525184:0@lo:503: 00000100:00100000:0.0:1789477225.708055:0:5869:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000060ac3006 pname:cluuid:pid:xid:nid:opc:job llog_process_th:07d5e05c-913f-419f-adbc-d3cf15e9cd51:5869:1876402802525312:0@lo:502: 00000100:00100000:0.0:1789477225.708100:0:5869:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789477225.708132:0:5869:0:(client.c:2715:ptlrpc_set_wait()) set 0000000002b11c82 going to sleep for 11 seconds 00000100:00100000:3.0:1789477225.708240:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802525312 00000100:00100000:3.0:1789477225.708245:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802525312 00000100:00100000:3.0:1789477225.708298:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1789477225.708303:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000092d85715 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07d5e05c-913f-419f-adbc-d3cf15e9cd51+9:5869:x1876402802525312:12345-0@lo:502: 00000100:00100000:3.0:1789477225.708444:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000092d85715 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07d5e05c-913f-419f-adbc-d3cf15e9cd51+9:5869:x1876402802525312:12345-0@lo:502: Request processed in 141us (344us total) trans 0 rc 0/0 00000100:00100000:3.0:1789477225.708449:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1789477225.708513:0:5869:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000060ac3006 pname:cluuid:pid:xid:nid:opc:job llog_process_th:07d5e05c-913f-419f-adbc-d3cf15e9cd51:5869:1876402802525312:0@lo:502: 00000020:01000000:0.0:1789477225.708532:0:5869:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789477225.708541:0:5869:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789477225.708547:0:5869:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:0.0:1789477225.708550:0:5869:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:0.0:1789477225.708552:0:5869:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1789477225.708564:0:5869:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (00000000f9c3d45c) 00000020:00000080:0.0:1789477225.708596:0:5869:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:0.0:1789477225.708603:0:5869:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:0.0:1789477225.708665:0:5869:0:(osd_handler.c:1564:osd_obd_connect()) connect #2 00000020:00000080:0.0:1789477225.708670:0:5869:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xafddb3c8f92813cc 00000020:00000080:0.0:1789477225.708867:0:5869:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:0.0:1789477225.708872:0:5869:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789477225.708874:0:5869:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789477225.708875:0:5869:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:0.0:1789477225.708877:0:5869:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789477225.708879:0:5869:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789477225.708880:0:5869:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:0.0:1789477225.708881:0:5869:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1789477225.708887:0:5869:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (000000009d80d1a7) 00000020:00000080:0.0:1789477225.708903:0:5869:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:0.0:1789477225.708905:0:5869:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:0.0:1789477225.708907:0:5869:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:0.0:1789477225.708909:0:5869:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:0.0:1789477225.708913:0:5869:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1789477225.708953:0:5869:0:(tgt_mount.c:153:server_get_mount()) get mount 000000006f803582 from lustre-MDT0000, refs=3 00000020:00000080:0.0:1789477225.708963:0:5869:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (00000000d7b198c7) 00000020:00000080:0.0:1789477225.708968:0:5869:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:0.0:1789477225.709007:0:5869:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:0.0:1789477225.709011:0:5869:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xafddb3c8f92813e1 00000020:00000080:0.0:1789477225.709080:0:5869:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:0.0:1789477225.709086:0:5869:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:0.0:1789477225.709090:0:5869:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0xafddb3c8f92813e8 00080000:01000000:0.0:1789477225.709094:0:5869:0:(osd_handler.c:1564:osd_obd_connect()) connect #3 00000020:00000080:0.0:1789477225.709098:0:5869:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xafddb3c8f92813ef 00080000:10000000:0.0:1789477225.709401:0:5869:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/8/3) registered 40000000:02000000:0.0:1789477225.709543:0:5869:0:(fid_handler.c:560:seq_server_init()) ctl-lustre-MDT0000: No data found on store. Initialize space. 40000000:02000000:1.0:1789477225.712864:0:5869:0:(fid_handler.c:560:seq_server_init()) srv-lustre-MDT0000: No data found on store. Initialize space. 00010000:00010000:1.0:1789477225.767481:0:5869:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:02000400:1.0:1789477225.767880:0:5869:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-MDT0000: new disk, initializing 00000001:00000004:1.0:1789477225.771407:0:5869:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 0 00000001:00080000:1.0:1789477225.771754:0:5869:0:(tgt_lastrcvd.c:240:tgt_reply_header_write()) lustre-MDT0000: write reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:1.0:1789477225.811371:0:5869:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (00000000e501f5b0) 00000020:00000080:1.0:1789477225.811395:0:5869:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:1.0:1789477225.811466:0:5869:0:(osd_handler.c:1564:osd_obd_connect()) connect #4 00000020:00000080:1.0:1789477225.811475:0:5869:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xafddb3c8f92813fd 00000020:00000080:1.0:1789477225.811881:0:5869:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00080000:10000000:1.0:1789477225.813851:0:5869:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/8/4) registered 00080000:10000000:0.0:1789477225.844444:0:5869:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/8/4) registered 00080000:10000000:1.0:1789477225.932492:0:5869:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/8/4) registered 00080000:10000000:1.0:1789477225.999718:0:5869:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/8/4) registered 00080000:10000000:2.0:1789477226.044297:0:5869:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/8/4) registered 00080000:10000000:0.0:1789477226.116668:0:5869:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/8/4) registered 00010000:00010000:1.0:1789477226.163649:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1789477226.193123:0:5869:0:(genops.c:1385:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0xafddb3c8f9281404 00000020:00000080:0.0:1789477226.193698:0:5869:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:0.0:1789477226.193713:0:5869:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789477226.193722:0:5869:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789477226.193724:0:5869:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:0.0:1789477226.193727:0:5869:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789477226.193733:0:5869:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789477226.193734:0:5869:0:(obd_config.c:1563:class_process_config()) marker 9 (0x1) lustre sys.timeout 00000020:00000080:0.0:1789477226.193737:0:5869:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1789477226.193739:0:5869:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1789477226.193742:0:5869:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789477226.193744:0:5869:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789477226.193745:0:5869:0:(obd_config.c:1563:class_process_config()) marker 9 (0x2) lustre sys.timeout 00000020:01000000:0.0:1789477226.193748:0:5869:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789477226.193752:0:5869:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789477226.193753:0:5869:0:(obd_config.c:1563:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:0.0:1789477226.193758:0:5869:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:0.0:1789477226.193804:0:5869:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000100:00100000:0.0:1789477226.193948:0:5869:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000060ac3006 pname:cluuid:pid:xid:nid:opc:job llog_process_th:07d5e05c-913f-419f-adbc-d3cf15e9cd51:5869:1876402802525440:0@lo:502: 00000100:00100000:0.0:1789477226.194064:0:5869:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789477226.194140:0:5869:0:(client.c:2715:ptlrpc_set_wait()) set 00000000f1afc8a4 going to sleep for 11 seconds 00000100:00100000:1.0:1789477226.195094:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802525440 00000100:00100000:1.0:1789477226.195108:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802525440 00000100:00100000:1.0:1789477226.195172:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1789477226.195183:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000000b34b7c1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:07d5e05c-913f-419f-adbc-d3cf15e9cd51+9:5869:x1876402802525440:12345-0@lo:502: 00000100:00100000:1.0:1789477226.205048:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000000b34b7c1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:07d5e05c-913f-419f-adbc-d3cf15e9cd51+9:5869:x1876402802525440:12345-0@lo:502: Request processed in 9852us (10972us total) trans 0 rc 0/0 00000100:00100000:1.0:1789477226.205072:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1789477226.205373:0:5869:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000060ac3006 pname:cluuid:pid:xid:nid:opc:job llog_process_th:07d5e05c-913f-419f-adbc-d3cf15e9cd51:5869:1876402802525440:0@lo:502: 00000020:01000000:2.0:1789477226.205429:0:5869:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789477226.205440:0:5869:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789477226.205443:0:5869:0:(obd_config.c:1563:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000040:00080000:2.0:1789477226.205448:0:5869:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 00000020:01000000:0.0:1789477226.206067:0:5825:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-15 (rc=0) 10000000:01000000:0.0:1789477226.206094:0:5825:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.123@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1789477226.206155:0:5825:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.123@tcp lock: 00000000d7ded8a6/0xafddb3c8f92813b7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xafddb3c8f92813be expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477226.206167:0:5825:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.123@tcp lock: 00000000d7ded8a6/0xafddb3c8f92813b7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xafddb3c8f92813be expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789477226.206198:0:5825:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9d0d4444e800 from 1 10000000:01000000:0.0:1789477226.206201:0:5825:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1789477226.206251:0:5825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.123@tcp lock: 000000005982ec0e/0xafddb3c8f928140b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477226.206259:0:5825:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.123@tcp lock: 000000005982ec0e/0xafddb3c8f928140b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477226.206271:0:5825:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.123@tcp lock: 000000005982ec0e/0xafddb3c8f928140b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789477226.206296:0:5825:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000056a7c3b9 pname:cluuid:pid:xid:nid:opc:job mount.lustre:07d5e05c-913f-419f-adbc-d3cf15e9cd51:5825:1876402802525568:0@lo:101: 00000100:00100000:0.0:1789477226.206389:0:5825:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789477226.206465:0:5825:0:(client.c:2715:ptlrpc_set_wait()) set 00000000cc244361 going to sleep for 11 seconds 00000100:00100000:3.0:1789477226.206592:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802525568 00000100:00100000:3.0:1789477226.206604:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802525568 00000100:00100000:3.0:1789477226.206667:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1789477226.206678:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000017df446a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07d5e05c-913f-419f-adbc-d3cf15e9cd51+9:5825:x1876402802525568:12345-0@lo:101: 00010000:00010000:3.0:1789477226.206708:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789477226.206728:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000e4751848/0xafddb3c8f9281412 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xafddb3c8f928140b expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477226.206755:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000e4751848/0xafddb3c8f9281412 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xafddb3c8f928140b expref: 10 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477226.206765:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000e4751848/0xafddb3c8f9281412 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xafddb3c8f928140b expref: 10 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477226.206774:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000e4751848, rc 0) 00000100:00100000:3.0:1789477226.206825:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000017df446a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07d5e05c-913f-419f-adbc-d3cf15e9cd51+10:5825:x1876402802525568:12345-0@lo:101: Request processed in 148us (437us total) trans 0 rc 0/0 00000100:00100000:3.0:1789477226.206832:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1789477226.207085:0:5825:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000056a7c3b9 pname:cluuid:pid:xid:nid:opc:job mount.lustre:07d5e05c-913f-419f-adbc-d3cf15e9cd51:5825:1876402802525568:0@lo:101: 00010000:00010000:0.0:1789477226.207101:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.123@tcp lock: 000000005982ec0e/0xafddb3c8f928140b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xafddb3c8f9281412 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477226.207110:0:5825:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.123@tcp lock: 000000005982ec0e/0xafddb3c8f928140b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xafddb3c8f9281412 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789477226.207755:0:5825:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000056a7c3b9 pname:cluuid:pid:xid:nid:opc:job mount.lustre:07d5e05c-913f-419f-adbc-d3cf15e9cd51:5825:1876402802525696:0@lo:256: 00000100:00100000:0.0:1789477226.207819:0:5825:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789477226.208007:0:5825:0:(client.c:2715:ptlrpc_set_wait()) set 00000000cc244361 going to sleep for 11 seconds 00000100:00100000:1.0:1789477226.208180:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802525696 00000100:00100000:1.0:1789477226.208190:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802525696 00000100:00100000:1.0:1789477226.208254:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1789477226.208263:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000cdb8f86f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07d5e05c-913f-419f-adbc-d3cf15e9cd51+10:5825:x1876402802525696:12345-0@lo:256: 20000000:01000000:1.0:1789477226.208288:0:5838:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:1.0:1789477226.208316:0:5838:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:1.0:1789477226.208408:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000cdb8f86f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07d5e05c-913f-419f-adbc-d3cf15e9cd51+10:5825:x1876402802525696:12345-0@lo:256: Request processed in 144us (586us total) trans 0 rc 0/0 00000100:00100000:1.0:1789477226.208415:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1789477226.208640:0:5825:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000056a7c3b9 pname:cluuid:pid:xid:nid:opc:job mount.lustre:07d5e05c-913f-419f-adbc-d3cf15e9cd51:5825:1876402802525696:0@lo:256: 10000000:01000000:0.0:1789477226.209437:0:5825:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.123@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1789477226.209874:0:5825:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.123@tcp lock: 000000005982ec0e/0xafddb3c8f928140b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xafddb3c8f9281412 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477226.209907:0:5825:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.123@tcp lock: 000000005982ec0e/0xafddb3c8f928140b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xafddb3c8f9281412 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789477226.209917:0:5825:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9d0d4444e800 from 1 10000000:01000000:0.0:1789477226.209920:0:5825:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1789477226.209969:0:5825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.123@tcp lock: 00000000b056e994/0xafddb3c8f9281419 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477226.209976:0:5825:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.123@tcp lock: 00000000b056e994/0xafddb3c8f9281419 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477226.209988:0:5825:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.123@tcp lock: 00000000b056e994/0xafddb3c8f9281419 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789477226.210011:0:5825:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000056a7c3b9 pname:cluuid:pid:xid:nid:opc:job mount.lustre:07d5e05c-913f-419f-adbc-d3cf15e9cd51:5825:1876402802525824:0@lo:101: 00000100:00100000:0.0:1789477226.210081:0:5825:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789477226.210127:0:5825:0:(client.c:2715:ptlrpc_set_wait()) set 00000000cc244361 going to sleep for 11 seconds 00000100:00100000:1.0:1789477226.210267:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802525824 00000100:00100000:1.0:1789477226.210275:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802525824 00000100:00100000:1.0:1789477226.210345:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1789477226.210355:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000021fdc21f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07d5e05c-913f-419f-adbc-d3cf15e9cd51+10:5825:x1876402802525824:12345-0@lo:101: 00010000:00010000:1.0:1789477226.210370:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789477226.210386:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000025858e8c/0xafddb3c8f9281420 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xafddb3c8f9281419 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477226.210415:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000025858e8c/0xafddb3c8f9281420 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xafddb3c8f9281419 expref: 11 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477226.210426:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000025858e8c/0xafddb3c8f9281420 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xafddb3c8f9281419 expref: 11 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477226.210435:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000025858e8c, rc 0) 00000100:00100000:1.0:1789477226.210483:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000021fdc21f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07d5e05c-913f-419f-adbc-d3cf15e9cd51+11:5825:x1876402802525824:12345-0@lo:101: Request processed in 130us (403us total) trans 0 rc 0/0 00000100:00100000:1.0:1789477226.210489:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1789477226.211065:0:5825:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000056a7c3b9 pname:cluuid:pid:xid:nid:opc:job mount.lustre:07d5e05c-913f-419f-adbc-d3cf15e9cd51:5825:1876402802525824:0@lo:101: 00010000:00010000:0.0:1789477226.211087:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.123@tcp lock: 00000000b056e994/0xafddb3c8f9281419 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xafddb3c8f9281420 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477226.211097:0:5825:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.123@tcp lock: 00000000b056e994/0xafddb3c8f9281419 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xafddb3c8f9281420 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789477226.211185:0:5825:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000056a7c3b9 pname:cluuid:pid:xid:nid:opc:job mount.lustre:07d5e05c-913f-419f-adbc-d3cf15e9cd51:5825:1876402802525952:0@lo:501: 00000100:00100000:0.0:1789477226.211227:0:5825:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789477226.211264:0:5825:0:(client.c:2715:ptlrpc_set_wait()) set 00000000cc244361 going to sleep for 11 seconds 00000100:00100000:3.0:1789477226.211388:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802525952 00000100:00100000:3.0:1789477226.211405:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802525952 00000100:00100000:3.0:1789477226.211452:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1789477226.211459:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ae9b43fd pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07d5e05c-913f-419f-adbc-d3cf15e9cd51+11:5825:x1876402802525952:12345-0@lo:501: 00000100:00100000:3.0:1789477226.212474:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ae9b43fd pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07d5e05c-913f-419f-adbc-d3cf15e9cd51+11:5825:x1876402802525952:12345-0@lo:501: Request processed in 1013us (1244us total) trans 0 rc 0/0 00000100:00100000:3.0:1789477226.212487:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1789477226.212803:0:5825:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000056a7c3b9 pname:cluuid:pid:xid:nid:opc:job mount.lustre:07d5e05c-913f-419f-adbc-d3cf15e9cd51:5825:1876402802525952:0@lo:501: 00000100:00100000:0.0:1789477226.212938:0:5825:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000056a7c3b9 pname:cluuid:pid:xid:nid:opc:job mount.lustre:07d5e05c-913f-419f-adbc-d3cf15e9cd51:5825:1876402802526080:0@lo:503: 00000100:00100000:0.0:1789477226.212993:0:5825:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789477226.213035:0:5825:0:(client.c:2715:ptlrpc_set_wait()) set 00000000cc244361 going to sleep for 11 seconds 00000100:00100000:3.0:1789477226.213993:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802526080 00000100:00100000:3.0:1789477226.214009:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802526080 00000100:00100000:3.0:1789477226.214078:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1789477226.214089:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000008f31f0c6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:07d5e05c-913f-419f-adbc-d3cf15e9cd51+11:5825:x1876402802526080:12345-0@lo:503: 00000040:00080000:3.0:1789477226.214164:0:5839:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1789477226.214245:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000008f31f0c6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:07d5e05c-913f-419f-adbc-d3cf15e9cd51+11:5825:x1876402802526080:12345-0@lo:503: Request processed in 158us (1252us total) trans 0 rc 0/0 00000100:00100000:3.0:1789477226.214253:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1789477226.214501:0:5825:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000056a7c3b9 pname:cluuid:pid:xid:nid:opc:job mount.lustre:07d5e05c-913f-419f-adbc-d3cf15e9cd51:5825:1876402802526080:0@lo:503: 00000040:00080000:3.0:1789477226.220286:0:5873:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 1 00000020:01000000:0.0:1789477226.220547:0:5825:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-0 (rc=0) 10000000:01000000:0.0:1789477226.220609:0:5825:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.123@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1789477226.220630:0:5825:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.123@tcp lock: 00000000b056e994/0xafddb3c8f9281419 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xafddb3c8f9281420 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477226.220645:0:5825:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.123@tcp lock: 00000000b056e994/0xafddb3c8f9281419 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xafddb3c8f9281420 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789477226.220711:0:5825:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1789477226.220715:0:5825:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9d0d4444e800 10000000:01000000:0.0:1789477226.220718:0:5825:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9d0d4444e800 10000000:01000000:0.0:1789477226.220723:0:5825:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1789477226.220730:0:5825:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9d0d4444e800 from 1 10000000:01000000:0.0:1789477226.220733:0:5825:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1789477226.220783:0:5825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.123@tcp lock: 00000000b3c4ca14/0xafddb3c8f9281427 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477226.220791:0:5825:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.123@tcp lock: 00000000b3c4ca14/0xafddb3c8f9281427 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477226.220803:0:5825:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.123@tcp lock: 00000000b3c4ca14/0xafddb3c8f9281427 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789477226.220834:0:5825:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000056a7c3b9 pname:cluuid:pid:xid:nid:opc:job mount.lustre:07d5e05c-913f-419f-adbc-d3cf15e9cd51:5825:1876402802526208:0@lo:101: 00000100:00100000:0.0:1789477226.221085:0:5825:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789477226.221153:0:5825:0:(client.c:2715:ptlrpc_set_wait()) set 00000000967c6b46 going to sleep for 11 seconds 00000100:00100000:3.0:1789477226.221336:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802526208 00000100:00100000:3.0:1789477226.221346:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802526208 00000100:00100000:3.0:1789477226.221406:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1789477226.221416:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000004bbe70ab pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07d5e05c-913f-419f-adbc-d3cf15e9cd51+11:5825:x1876402802526208:12345-0@lo:101: 00010000:00010000:3.0:1789477226.221433:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789477226.221450:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000036f62c55/0xafddb3c8f928142e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xafddb3c8f9281427 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477226.221477:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000036f62c55/0xafddb3c8f928142e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xafddb3c8f9281427 expref: 12 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477226.221488:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000036f62c55/0xafddb3c8f928142e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xafddb3c8f9281427 expref: 12 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477226.221523:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000036f62c55, rc 0) 00000100:00100000:3.0:1789477226.221702:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000004bbe70ab pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07d5e05c-913f-419f-adbc-d3cf15e9cd51+12:5825:x1876402802526208:12345-0@lo:101: Request processed in 286us (617us total) trans 0 rc 0/0 00000100:00100000:3.0:1789477226.221709:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1789477226.222151:0:5825:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000056a7c3b9 pname:cluuid:pid:xid:nid:opc:job mount.lustre:07d5e05c-913f-419f-adbc-d3cf15e9cd51:5825:1876402802526208:0@lo:101: 00010000:00010000:2.0:1789477226.222173:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.123@tcp lock: 00000000b3c4ca14/0xafddb3c8f9281427 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xafddb3c8f928142e expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477226.222183:0:5825:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.123@tcp lock: 00000000b3c4ca14/0xafddb3c8f9281427 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xafddb3c8f928142e expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789477226.222273:0:5825:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000fc942d20 pname:cluuid:pid:xid:nid:opc:job mount.lustre:07d5e05c-913f-419f-adbc-d3cf15e9cd51:5825:1876402802526336:0@lo:501: 00000100:00100000:2.0:1789477226.222442:0:5825:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789477226.222545:0:5825:0:(client.c:2715:ptlrpc_set_wait()) set 000000009aec3627 going to sleep for 11 seconds 00000100:00100000:1.0:1789477226.222915:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802526336 00000100:00100000:1.0:1789477226.222924:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802526336 00000100:00100000:0.0:1789477226.223101:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1789477226.223111:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000002354b4da pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07d5e05c-913f-419f-adbc-d3cf15e9cd51+12:5825:x1876402802526336:12345-0@lo:501: 00000100:00100000:0.0:1789477226.223488:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000002354b4da pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07d5e05c-913f-419f-adbc-d3cf15e9cd51+12:5825:x1876402802526336:12345-0@lo:501: Request processed in 377us (1046us total) trans 0 rc 0/0 00000100:00100000:0.0:1789477226.223507:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1789477226.223631:0:5825:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000fc942d20 pname:cluuid:pid:xid:nid:opc:job mount.lustre:07d5e05c-913f-419f-adbc-d3cf15e9cd51:5825:1876402802526336:0@lo:501: 00000100:00100000:2.0:1789477226.223675:0:5825:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000fc942d20 pname:cluuid:pid:xid:nid:opc:job mount.lustre:07d5e05c-913f-419f-adbc-d3cf15e9cd51:5825:1876402802526464:0@lo:503: 00000100:00100000:2.0:1789477226.223735:0:5825:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789477226.224650:0:5825:0:(client.c:2715:ptlrpc_set_wait()) set 000000009aec3627 going to sleep for 11 seconds 00000100:00100000:3.0:1789477226.224959:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802526464 00000100:00100000:3.0:1789477226.224969:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802526464 00000100:00100000:3.0:1789477226.225021:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1789477226.225030:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000429f62c9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:07d5e05c-913f-419f-adbc-d3cf15e9cd51+12:5825:x1876402802526464:12345-0@lo:503: 00000100:00100000:3.0:1789477226.225501:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000429f62c9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:07d5e05c-913f-419f-adbc-d3cf15e9cd51+12:5825:x1876402802526464:12345-0@lo:503: Request processed in 461us (1756us total) trans 0 rc 0/0 00000100:00100000:3.0:1789477226.225512:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1789477226.225761:0:5825:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000fc942d20 pname:cluuid:pid:xid:nid:opc:job mount.lustre:07d5e05c-913f-419f-adbc-d3cf15e9cd51:5825:1876402802526464:0@lo:503: 00000100:00100000:2.0:1789477226.226285:0:5874:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000fc942d20 pname:cluuid:pid:xid:nid:opc:job llog_process_th:07d5e05c-913f-419f-adbc-d3cf15e9cd51:5874:1876402802526592:0@lo:502: 00000100:00100000:2.0:1789477226.226433:0:5874:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789477226.226472:0:5874:0:(client.c:2715:ptlrpc_set_wait()) set 00000000fb876e09 going to sleep for 11 seconds 00000100:00100000:0.0:1789477226.226538:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802526592 00000100:00100000:0.0:1789477226.226546:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802526592 00000100:00100000:0.0:1789477226.226608:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1789477226.226618:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000001480b0ee pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07d5e05c-913f-419f-adbc-d3cf15e9cd51+12:5874:x1876402802526592:12345-0@lo:502: 00000100:00100000:0.0:1789477226.227059:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000001480b0ee pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07d5e05c-913f-419f-adbc-d3cf15e9cd51+12:5874:x1876402802526592:12345-0@lo:502: Request processed in 442us (626us total) trans 0 rc 0/0 00000100:00100000:0.0:1789477226.227069:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1789477226.227272:0:5874:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000fc942d20 pname:cluuid:pid:xid:nid:opc:job llog_process_th:07d5e05c-913f-419f-adbc-d3cf15e9cd51:5874:1876402802526592:0@lo:502: 00000020:01000004:2.0:1789477226.227469:0:5874:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:2.0:1789477226.227502:0:5874:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (000000009f72665a) 00000020:00000080:2.0:1789477226.227529:0:5874:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type lwp with refcount 2 00000020:01000004:2.0:1789477226.227676:0:5874:0:(tgt_mount.c:153:server_get_mount()) get mount 000000006f803582 from lustre-MDT0000, refs=4 00000020:01000004:2.0:1789477226.227755:0:5874:0:(tgt_mount.c:187:server_put_mount()) put mount 000000006f803582 from lustre-MDT0000, refs=4 00000020:01000004:2.0:1789477226.227760:0:5874:0:(obd_mount.c:710:lustre_put_lsi()) put 000000006f803582 4 00010000:00080000:2.0:1789477226.227802:0:5874:0:(ldlm_lib.c:102:import_set_conn()) imp 000000006322761c@lustre-MDT0000-lwp-MDT0000: add connection 192.168.201.123@tcp at head 00010000:00010000:0.0:1789477226.235427:0:5874:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-1 is initialized 00000020:00000080:0.0:1789477226.239008:0:5874:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:0.0:1789477226.239091:0:5874:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1789477226.239113:0:5874:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0xafddb3c8f928143c 00000100:00080000:0.0:1789477226.239129:0:5874:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1789477226.239144:0:5874:0:(import.c:625:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 000000006322761c using connection 192.168.201.123@tcp/0@lo 00000100:00100000:0.0:1789477226.239196:0:5874:0:(import.c:827:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000e4a99334 x1876402802526720/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1789477226.239236:0:5874:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:3.0:1789477226.239807:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000e4a99334 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3309:1876402802526720:0@lo:38: 00000100:00100000:3.0:1789477226.239973:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789477226.241170:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802526720 00000100:00100000:0.0:1789477226.241188:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802526720 00000100:00100000:0.0:1789477226.241276:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789477226.241285:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000401bd516 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3309:x1876402802526720:12345-0@lo:38: 00000100:00100000:0.0:1789477226.241417:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000401bd516 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3309:x1876402802526720:12345-0@lo:38: Request processed in 131us (1444us total) trans 0 rc -11/-11 00000100:00100000:0.0:1789477226.241425:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789477226.242809:0:3309:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1789477226.242828:0:3309:0:(import.c:65:import_set_state_nolock()) 000000006322761c lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1789477226.242836:0:3309:0:(import.c:1512:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:2.0:1789477226.242987:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000e4a99334 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3309:1876402802526720:0@lo:38: 00000100:00100000:0.0:1789477226.246737:0:5874:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000ff04b30c pname:cluuid:pid:xid:nid:opc:job llog_process_th:07d5e05c-913f-419f-adbc-d3cf15e9cd51:5874:1876402802526848:0@lo:502: 00000100:00100000:0.0:1789477226.246868:0:5874:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789477226.246930:0:5874:0:(client.c:2715:ptlrpc_set_wait()) set 00000000f1afc8a4 going to sleep for 11 seconds 00000100:00100000:1.0:1789477226.246935:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802526848 00000100:00100000:1.0:1789477226.246947:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802526848 00000100:00100000:1.0:1789477226.247012:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1789477226.247024:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000006c49492d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07d5e05c-913f-419f-adbc-d3cf15e9cd51+12:5874:x1876402802526848:12345-0@lo:502: 00000100:00100000:1.0:1789477226.247338:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000006c49492d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07d5e05c-913f-419f-adbc-d3cf15e9cd51+12:5874:x1876402802526848:12345-0@lo:502: Request processed in 316us (471us total) trans 0 rc 0/0 00000100:00100000:1.0:1789477226.247356:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1789477226.248678:0:5874:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000ff04b30c pname:cluuid:pid:xid:nid:opc:job llog_process_th:07d5e05c-913f-419f-adbc-d3cf15e9cd51:5874:1876402802526848:0@lo:502: 00000040:00080000:0.0:1789477226.248738:0:5874:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000020:01000000:3.0:1789477226.248930:0:5825:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-20 (rc=0) 10000000:01000000:3.0:1789477226.248955:0:5825:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.123@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1789477226.248978:0:5825:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.123@tcp lock: 00000000b3c4ca14/0xafddb3c8f9281427 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xafddb3c8f928142e expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477226.248992:0:5825:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.123@tcp lock: 00000000b3c4ca14/0xafddb3c8f9281427 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xafddb3c8f928142e expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1789477226.249056:0:5825:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1789477226.249059:0:5825:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1789477226.249060:0:5825:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789477226.249062:0:5825:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789477226.249063:0:5825:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789477226.249065:0:5825:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789477226.249066:0:5825:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1789477226.249083:0:5825:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1789477226.249085:0:5825:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1789477226.249086:0:5825:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1789477226.249088:0:5825:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789477226.249089:0:5825:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1789477226.249093:0:5825:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020065 00000020:01000004:3.0:1789477226.249096:0:5825:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1789477226.249097:0:5825:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1789477226.249098:0:5825:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789477226.249099:0:5825:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789477226.249099:0:5825:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789477226.249100:0:5825:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789477226.249101:0:5825:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1789477226.249102:0:5825:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1789477226.249102:0:5825:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1789477226.249103:0:5825:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1789477226.249104:0:5825:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789477226.249105:0:5825:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1789477226.249132:0:5825:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:3.0:1789477226.249151:0:5825:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000003512be13 pname:cluuid:pid:xid:nid:opc:job mount.lustre:07d5e05c-913f-419f-adbc-d3cf15e9cd51:5825:1876402802526976:0@lo:253: 00000100:00100000:3.0:1789477226.249244:0:5825:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789477226.249295:0:5825:0:(client.c:2715:ptlrpc_set_wait()) set 00000000d030d854 going to sleep for 11 seconds 00000100:00100000:0.0:1789477226.249881:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802526976 00000100:00100000:0.0:1789477226.249892:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802526976 00000100:00100000:0.0:1789477226.249957:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1789477226.249967:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000cf4f0c79 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07d5e05c-913f-419f-adbc-d3cf15e9cd51+12:5825:x1876402802526976:12345-0@lo:253: 20000000:01000000:0.0:1789477226.250006:0:5837:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:0.0:1789477226.250024:0:5837:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:0.0:1789477226.313952:0:5837:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1789477226.313980:0:5837:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:3.0:1789477226.314057:0:5861:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1789477226.314064:0:5861:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1789477226.314104:0:5861:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000c88b4a1f/0xafddb3c8f9281443 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477226.314130:0:5861:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000e4751848/0xafddb3c8f9281412 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xafddb3c8f928140b expref: 12 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477226.314139:0:5861:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 00000000c88b4a1f/0xafddb3c8f9281443 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477226.314193:0:5861:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000e4751848/0xafddb3c8f9281412 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xafddb3c8f928140b expref: 12 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477226.314235:0:5861:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000e4751848/0xafddb3c8f9281412 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xafddb3c8f928140b expref: 12 pid: 5837 timeout: 321 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789477226.314253:0:5861:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000b4ae5515 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5861:1876402802527104:0@lo:104: 00000100:00100000:3.0:1789477226.314479:0:5861:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789477226.314565:0:5861:0:(client.c:2715:ptlrpc_set_wait()) set 000000006146e095 going to sleep for 11 seconds 00000100:00100000:0.0:1789477226.314992:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802527104 00000100:00100000:0.0:1789477226.315004:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802527104 00000100:00100000:2.0:1789477226.315172:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789477226.315189:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d6d8a42f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:07d5e05c-913f-419f-adbc-d3cf15e9cd51+3:5861:x1876402802527104:12345-0@lo:104: 00010000:00010000:2.0:1789477226.315207:0:5828:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.123@tcp lock: 000000005982ec0e/0xafddb3c8f928140b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xafddb3c8f9281412 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477226.315290:0:5828:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1789477226.315296:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d6d8a42f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:07d5e05c-913f-419f-adbc-d3cf15e9cd51+3:5861:x1876402802527104:12345-0@lo:104: Request processed in 109us (820us total) trans 0 rc 0/0 00000100:00100000:3.0:1789477226.315410:0:5861:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000b4ae5515 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5861:1876402802527104:0@lo:104: 00010000:00010000:3.0:1789477226.315436:0:5861:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 00000000c88b4a1f/0xafddb3c8f9281443 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789477226.315488:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:2.0:1789477226.315525:0:5833:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789477226.315531:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.123@tcp lock: 000000005982ec0e/0xafddb3c8f928140b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xafddb3c8f9281412 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477226.315540:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000005982ec0e already unused, calling callback (0000000038babd70) 10000000:00010000:2.0:1789477226.315544:0:5833:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.123@tcp lock: 000000005982ec0e/0xafddb3c8f928140b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xafddb3c8f9281412 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477226.315552:0:5833:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.123@tcp lock: 000000005982ec0e/0xafddb3c8f928140b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xafddb3c8f9281412 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789477226.315558:0:5833:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.123@tcp lock: 000000005982ec0e/0xafddb3c8f928140b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xafddb3c8f9281412 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789477226.315564:0:5833:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1789477226.315652:0:5833:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.123@tcp lock: 000000005982ec0e/0xafddb3c8f928140b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xafddb3c8f9281412 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477226.315660:0:5833:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789477226.315808:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.123@tcp lock: 000000005982ec0e/0xafddb3c8f928140b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xafddb3c8f9281412 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477226.315962:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.123@tcp lock: 000000005982ec0e/0xafddb3c8f928140b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xafddb3c8f9281412 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477226.315986:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789477226.315988:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789477226.315990:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789477226.316061:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000fc942d20 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:07d5e05c-913f-419f-adbc-d3cf15e9cd51:3311:1876402802527232:0@lo:103: 00000100:00100000:2.0:1789477226.316331:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789477226.316548:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802527232 00000100:00100000:3.0:1789477226.316557:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802527232 00010000:00010000:3.0:1789477226.316611:0:5829:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000e4751848/0xafddb3c8f9281412 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xafddb3c8f928140b expref: 13 pid: 5837 timeout: 321 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789477226.316651:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789477226.316660:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000079f2afc7 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:07d5e05c-913f-419f-adbc-d3cf15e9cd51+13:3311:x1876402802527232:12345-0@lo:103: 00010000:00010000:3.0:1789477226.316674:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789477226.316760:0:5829:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000e4751848/0xafddb3c8f9281412 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xafddb3c8f928140b expref: 13 pid: 5837 timeout: 321 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477226.316772:0:5829:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000e4751848/0xafddb3c8f9281412 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xafddb3c8f928140b expref: 13 pid: 5837 timeout: 321 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477226.316788:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000e4751848/0xafddb3c8f9281412 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xafddb3c8f928140b expref: 13 pid: 5837 timeout: 321 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477226.316804:0:5829:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 00000000c88b4a1f/0xafddb3c8f9281443 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477226.316832:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000c88b4a1f/0xafddb3c8f9281443 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1789477226.316923:0:5829:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.002859838s 00010000:00010000:3.0:1789477226.316928:0:5829:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000c88b4a1f/0xafddb3c8f9281443 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477226.316937:0:5829:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000c88b4a1f/0xafddb3c8f9281443 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477226.316943:0:5829:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000c88b4a1f/0xafddb3c8f9281443 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477226.316949:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000c88b4a1f/0xafddb3c8f9281443 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477226.316955:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000c88b4a1f already unused, calling callback (00000000dfb29c3b) 00010000:00010000:3.0:1789477226.316959:0:5829:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000c88b4a1f/0xafddb3c8f9281443 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477226.316967:0:5829:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000c88b4a1f/0xafddb3c8f9281443 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477226.316983:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000c88b4a1f/0xafddb3c8f9281443 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477226.316995:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789477226.317043:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000079f2afc7 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:07d5e05c-913f-419f-adbc-d3cf15e9cd51+12:3311:x1876402802527232:12345-0@lo:103: Request processed in 384us (714us total) trans 0 rc 0/0 00000100:00100000:3.0:1789477226.317050:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789477226.317803:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000fc942d20 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:07d5e05c-913f-419f-adbc-d3cf15e9cd51:3311:1876402802527232:0@lo:103: 00010000:00010000:3.0:1789477226.318040:0:5861:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 00000000c88b4a1f/0xafddb3c8f9281443 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477226.318052:0:5861:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000c88b4a1f/0xafddb3c8f9281443 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477226.318059:0:5861:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000c88b4a1f/0xafddb3c8f9281443 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789477226.348243:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000cf4f0c79 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07d5e05c-913f-419f-adbc-d3cf15e9cd51+11:5825:x1876402802526976:12345-0@lo:253: Request processed in 98265us (98988us total) trans 0 rc 0/0 00000100:00100000:0.0:1789477226.348263:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1789477226.348677:0:5825:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000003512be13 pname:cluuid:pid:xid:nid:opc:job mount.lustre:07d5e05c-913f-419f-adbc-d3cf15e9cd51:5825:1876402802526976:0@lo:253: 10000000:01000000:3.0:1789477226.348711:0:5825:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:3.0:1789477226.348715:0:5825:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1789477226.348717:0:5825:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1789477226.348718:0:5825:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789477226.348720:0:5825:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789477226.348721:0:5825:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789477226.348723:0:5825:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789477226.348724:0:5825:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1789477226.348726:0:5825:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1789477226.348728:0:5825:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1789477226.348729:0:5825:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1789477226.348731:0:5825:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789477226.348733:0:5825:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1789477226.348754:0:5825:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:3.0:1789477226.361465:0:5825:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/8/4) registered 00080000:10000000:0.0:1789477226.365291:0:5825:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:0.0:1789477226.366280:0:5825:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00080000:10000000:0.0:1789477226.366563:0:5825:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:0.0:1789477226.367034:0:5825:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/8/4) registered 00080000:10000000:1.0:1789477226.368538:0:5825:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00080000:10000000:1.0:1789477226.370193:0:5825:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/8/4) registered 00080000:10000000:1.0:1789477226.372470:0:5825:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8/1) registered 00080000:10000000:1.0:1789477226.373282:0:5825:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/8/4) registered 00080000:10000000:1.0:1789477226.373520:0:5825:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8/1) registered 00080000:10000000:1.0:1789477226.374462:0:5825:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xf:0x0] (8/8/4) registered 00080000:10000000:1.0:1789477226.374937:0:5825:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8/1) registered 40000000:02000000:1.0:1789477226.467089:0:5825:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt 00000040:01000000:1.0:1789477226.513470:0:5825:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000020:00080000:2.0:1789477226.514102:0:5879:0:(update_trans.c:1539:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 0 00000020:00080000:2.0:1789477226.514109:0:5879:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000040:01000000:1.0:1789477226.514339:0:5880:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:3.0:1789477226.527787:0:5825:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:3.0:1789477226.528373:0:5825:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:3.0:1789477226.529110:0:5825:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:3.0:1789477226.529126:0:5825:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:3.0:1789477226.529344:0:5825:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789477226.531138:0:5825:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:3.0:1789477226.532883:0:5825:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:3.0:1789477226.532961:0:5825:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:3.0:1789477226.533354:0:5825:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:3.0:1789477226.533673:0:5825:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x11:0x0] (8/8/4) registered 00100000:10000000:3.0:1789477226.535159:0:5825:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_00: rc = 0 00100000:10000000:3.0:1789477226.535321:0:5825:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_01: rc = 0 00100000:10000000:3.0:1789477226.535463:0:5825:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_02: rc = 0 00100000:10000000:3.0:1789477226.536955:0:5825:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_03: rc = 0 00100000:10000000:3.0:1789477226.537151:0:5825:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_04: rc = 0 00100000:10000000:3.0:1789477226.537316:0:5825:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_05: rc = 0 00100000:10000000:3.0:1789477226.537485:0:5825:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_06: rc = 0 00100000:10000000:3.0:1789477226.537993:0:5825:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_07: rc = 0 00100000:10000000:3.0:1789477226.538136:0:5825:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_08: rc = 0 00100000:10000000:3.0:1789477226.538294:0:5825:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_09: rc = 0 00100000:10000000:3.0:1789477226.538432:0:5825:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_10: rc = 0 00100000:10000000:3.0:1789477226.538663:0:5825:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_11: rc = 0 00100000:10000000:3.0:1789477226.542034:0:5825:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_12: rc = 0 00100000:10000000:3.0:1789477226.542381:0:5825:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_13: rc = 0 00100000:10000000:3.0:1789477226.542897:0:5825:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_14: rc = 0 00100000:10000000:3.0:1789477226.543084:0:5825:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_15: rc = 0 00100000:10000000:3.0:1789477226.543438:0:5825:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_00: rc = 0 00100000:10000000:3.0:1789477226.543648:0:5825:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_01: rc = 0 00100000:10000000:3.0:1789477226.543813:0:5825:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_02: rc = 0 00100000:10000000:3.0:1789477226.543963:0:5825:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_03: rc = 0 00100000:10000000:3.0:1789477226.544125:0:5825:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_04: rc = 0 00100000:10000000:3.0:1789477226.544282:0:5825:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_05: rc = 0 00100000:10000000:3.0:1789477226.544426:0:5825:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_06: rc = 0 00100000:10000000:3.0:1789477226.544634:0:5825:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_07: rc = 0 00100000:10000000:3.0:1789477226.544790:0:5825:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_08: rc = 0 00100000:10000000:3.0:1789477226.544962:0:5825:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_09: rc = 0 00100000:10000000:3.0:1789477226.545107:0:5825:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_10: rc = 0 00100000:10000000:3.0:1789477226.545267:0:5825:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_11: rc = 0 00100000:10000000:3.0:1789477226.545447:0:5825:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_12: rc = 0 00100000:10000000:3.0:1789477226.545667:0:5825:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_13: rc = 0 00100000:10000000:3.0:1789477226.545820:0:5825:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_14: rc = 0 00100000:10000000:3.0:1789477226.545993:0:5825:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_15: rc = 0 00000001:00000004:3.0:1789477226.546221:0:5825:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000040:00080000:1.0:1789477226.582619:0:5880:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000001:00080000:2.0:1789477226.677217:0:5825:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:2.0:1789477226.677291:0:5825:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffbc0b8190b988 00100000:10000000:2.0:1789477226.677302:0:5825:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:3.0:1789477226.681110:0:5825:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1789477226.681142:0:5825:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.201.123@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1789477226.681163:0:5825:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=46 00000080:00000004:3.0:1789477226.681196:0:5825:0:(super25.c:182:lustre_fill_super()) lustre-mdt1/mdt1: Mount complete 00000040:00080000:3.0:1789477226.766872:0:5880:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:3.0:1789477226.766976:0:5880:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:3.0:1789477226.766982:0:5880:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00010000:00010000:1.0:1789477227.184392:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789477228.211759:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789477229.232384:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789477230.255815:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789477231.283075:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1789477231.526280:0:6122:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg123-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00080000:3.0:1789477231.537946:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1789477231.537958:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1789477231.537962:0:38:0:(import.c:65:import_set_state_nolock()) 000000006322761c lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1789477231.537984:0:38:0:(import.c:625:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 000000006322761c using connection 192.168.201.123@tcp/0@lo 00000100:00100000:3.0:1789477231.538011:0:38:0:(import.c:827:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000b4ae5515 x1876402802527488/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1789477231.538512:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000003512be13 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:07d5e05c-913f-419f-adbc-d3cf15e9cd51:3312:1876402802527360:0@lo:400: 00000100:00100000:2.0:1789477231.538609:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789477231.538735:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000b4ae5515 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3309:1876402802527488:0@lo:38: 00000100:00100000:2.0:1789477231.538823:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789477231.538922:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802527360 00000100:00100000:0.0:1789477231.538932:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802527360 00000100:00100000:2.0:1789477231.538946:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802527488 00000100:00100000:2.0:1789477231.538950:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802527488 00000100:00100000:2.0:1789477231.538978:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789477231.538978:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1789477231.538984:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000003727dbff pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3309:x1876402802527488:12345-0@lo:38: 00000100:00100000:0.0:1789477231.538985:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000feb8b126 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07d5e05c-913f-419f-adbc-d3cf15e9cd51+11:3312:x1876402802527360:12345-0@lo:400: 00010000:00080000:2.0:1789477231.539022:0:5846:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 176 last 0 00000100:00100000:0.0:1789477231.539041:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000feb8b126 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07d5e05c-913f-419f-adbc-d3cf15e9cd51+11:3312:x1876402802527360:12345-0@lo:400: Request processed in 57us (434us total) trans 0 rc 0/0 00000100:00100000:0.0:1789477231.539048:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000020:00000080:2.0:1789477231.539332:0:5846:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0xafddb3c8f928144a 00000004:00100000:2.0:1789477231.539438:0:5846:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1789477231.539701:0:5846:0:(import.c:65:import_set_state_nolock()) 000000003eccdd0c : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789477231.539788:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000003727dbff pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1876402802527488:12345-0@lo:38: Request processed in 802us (964us total) trans 0 rc 0/0 00000100:00100000:2.0:1789477231.539795:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1789477231.539844:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000b4ae5515 x1876402802527488/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789477241 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1789477231.539860:0:3309:0:(import.c:1133:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 1 00000100:00080000:0.0:1789477231.539868:0:3309:0:(import.c:957:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:0.0:1789477231.539872:0:3309:0:(import.c:1214:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1789477231.539874:0:3309:0:(import.c:65:import_set_state_nolock()) 000000006322761c lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1789477231.539880:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000b4ae5515 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3309:1876402802527488:0@lo:38: 00000100:00100000:2.0:1789477231.539887:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000003512be13 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:07d5e05c-913f-419f-adbc-d3cf15e9cd51:3312:1876402802527360:0@lo:400: 00010000:00010000:0.0:1789477232.313539:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1789477233.072557:0:5841:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1789477233.072564:0:5841:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9d0d4444e800 from 3 10000000:01000000:2.0:1789477233.072568:0:5841:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1789477233.072650:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.123@tcp lock: 00000000442a6e6b/0xafddb3c8f9281451 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477233.072663:0:5841:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.123@tcp lock: 00000000442a6e6b/0xafddb3c8f9281451 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477233.072674:0:5841:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.123@tcp lock: 00000000442a6e6b/0xafddb3c8f9281451 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789477233.072699:0:5841:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000029f87d4e pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07d5e05c-913f-419f-adbc-d3cf15e9cd51:5841:1876402802527616:0@lo:101: 00000100:00100000:2.0:1789477233.072773:0:5841:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789477233.072815:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802527616 00000100:00100000:3.0:1789477233.072824:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802527616 00000100:00100000:2.0:1789477233.072836:0:5841:0:(client.c:2715:ptlrpc_set_wait()) set 00000000fd5222cf going to sleep for 11 seconds 00000100:00100000:3.0:1789477233.072978:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1789477233.072988:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000007d640f4d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07d5e05c-913f-419f-adbc-d3cf15e9cd51+11:5841:x1876402802527616:12345-0@lo:101: 00010000:00010000:3.0:1789477233.073020:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789477233.073036:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000c88b4a1f/0xafddb3c8f9281458 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xafddb3c8f9281451 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477233.073062:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000c88b4a1f/0xafddb3c8f9281458 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xafddb3c8f9281451 expref: 12 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477233.073073:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000c88b4a1f/0xafddb3c8f9281458 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xafddb3c8f9281451 expref: 12 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477233.073082:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000c88b4a1f, rc 0) 00000100:00100000:3.0:1789477233.073130:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000007d640f4d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07d5e05c-913f-419f-adbc-d3cf15e9cd51+12:5841:x1876402802527616:12345-0@lo:101: Request processed in 145us (359us total) trans 0 rc 0/0 00000100:00100000:3.0:1789477233.073137:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1789477233.073216:0:5841:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000029f87d4e pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07d5e05c-913f-419f-adbc-d3cf15e9cd51:5841:1876402802527616:0@lo:101: 00010000:00010000:2.0:1789477233.073244:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.123@tcp lock: 00000000442a6e6b/0xafddb3c8f9281451 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xafddb3c8f9281458 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477233.073252:0:5841:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.123@tcp lock: 00000000442a6e6b/0xafddb3c8f9281451 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xafddb3c8f9281458 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789477233.073304:0:5841:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000029f87d4e pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07d5e05c-913f-419f-adbc-d3cf15e9cd51:5841:1876402802527744:0@lo:256: 00000100:00100000:2.0:1789477233.073346:0:5841:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789477233.073932:0:5841:0:(client.c:2715:ptlrpc_set_wait()) set 00000000fd5222cf going to sleep for 11 seconds 00000100:00100000:1.0:1789477233.074074:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802527744 00000100:00100000:1.0:1789477233.074081:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802527744 00000100:00100000:1.0:1789477233.074112:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1789477233.074119:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000edabaa5c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07d5e05c-913f-419f-adbc-d3cf15e9cd51+12:5841:x1876402802527744:12345-0@lo:256: 20000000:01000000:1.0:1789477233.074136:0:5838:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1789477233.074152:0:5838:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1789477233.074155:0:5838:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 3 00000100:00100000:1.0:1789477233.074546:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000edabaa5c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07d5e05c-913f-419f-adbc-d3cf15e9cd51+12:5841:x1876402802527744:12345-0@lo:256: Request processed in 426us (1198us total) trans 0 rc 0/0 00000100:00100000:1.0:1789477233.074553:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1789477233.074811:0:5841:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000029f87d4e pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07d5e05c-913f-419f-adbc-d3cf15e9cd51:5841:1876402802527744:0@lo:256: 10000000:01000000:2.0:1789477233.074860:0:5841:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.123@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1789477233.074938:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.123@tcp lock: 00000000442a6e6b/0xafddb3c8f9281451 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xafddb3c8f9281458 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477233.074948:0:5841:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.123@tcp lock: 00000000442a6e6b/0xafddb3c8f9281451 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xafddb3c8f9281458 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477233.329283:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789477234.353191:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789477235.376371:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789477236.402532:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789477236.677576:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000002933050f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:07d5e05c-913f-419f-adbc-d3cf15e9cd51:3313:1876402802527872:0@lo:400: 00000100:00100000:2.0:1789477236.677731:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789477236.678944:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000439f06a6 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3310:1876402802528000:0@lo:400: 00000100:00100000:3.0:1789477236.679027:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789477236.679103:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802527872 00000100:00100000:3.0:1789477236.679114:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802527872 00000100:00100000:3.0:1789477236.679179:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1789477236.679190:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000bbdfb1d8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07d5e05c-913f-419f-adbc-d3cf15e9cd51+12:3313:x1876402802527872:12345-0@lo:400: 00000100:00100000:3.0:1789477236.679255:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000bbdfb1d8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07d5e05c-913f-419f-adbc-d3cf15e9cd51+12:3313:x1876402802527872:12345-0@lo:400: Request processed in 66us (1524us total) trans 0 rc 0/0 00000100:00100000:3.0:1789477236.679723:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1789477236.679779:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802528000 00000100:00100000:3.0:1789477236.679784:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802528000 00000100:00100000:3.0:1789477236.679986:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789477236.679994:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000025f63fc2 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1876402802528000:12345-0@lo:400: 00000100:00100000:3.0:1789477236.680073:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000025f63fc2 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1876402802528000:12345-0@lo:400: Request processed in 80us (1048us total) trans 0 rc 0/0 00000100:00100000:3.0:1789477236.680079:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:2.0:1789477236.680190:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000439f06a6 x1876402802528000/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789477252 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789477236.680207:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000439f06a6 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3310:1876402802528000:0@lo:400: 00000100:00100000:1.0:1789477236.689874:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000002933050f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:07d5e05c-913f-419f-adbc-d3cf15e9cd51:3313:1876402802527872:0@lo:400: 00000020:00000080:2.0:1789477236.722206:0:6324:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffd7172df80 20000000:00000080:2.0:1789477236.722231:0:6324:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9d0d5801a800 uarg=0000000000000000 20000000:01000000:2.0:1789477236.722278:0:6324:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:2.0:1789477236.722286:0:6324:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:2.0:1789477236.722293:0:6324:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:0.0:1789477236.723334:0:6324:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:02000000:0.0:1789477236.723355:0:6324:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Modifying parameter general.debug_raw_pointers=Y in log params 00000040:00080000:0.0:1789477236.733063:0:6324:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1789477236.734276:0:6324:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:0.0:1789477236.734402:0:6324:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 112 off8528 00000040:00080000:0.0:1789477236.734456:0:6324:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 224 off8752 10000000:01000000:0.0:1789477236.734477:0:6324:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1789477236.734501:0:6324:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 000000005982ec0e/0xafddb3c8f928145f lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477236.734524:0:6324:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 0000000025858e8c/0xafddb3c8f9281420 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xafddb3c8f9281419 expref: 11 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477236.734532:0:6324:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 000000005982ec0e/0xafddb3c8f928145f lrc: 4/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477236.734614:0:6324:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 0000000025858e8c/0xafddb3c8f9281420 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xafddb3c8f9281419 expref: 11 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477236.734818:0:6324:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 0000000025858e8c/0xafddb3c8f9281420 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xafddb3c8f9281419 expref: 11 pid: 5838 timeout: 331 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789477236.734837:0:6324:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000ff04b30c pname:cluuid:pid:xid:nid:opc:job lctl:MGS:6324:1876402802528128:0@lo:104: 00000100:00100000:0.0:1789477236.734933:0:6324:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789477236.735028:0:6324:0:(client.c:2715:ptlrpc_set_wait()) set 0000000044aeabad going to sleep for 11 seconds 00000100:00100000:1.0:1789477236.735083:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802528128 00000100:00100000:1.0:1789477236.735102:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802528128 00000100:00100000:1.0:1789477236.735173:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789477236.735183:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000040d9d9c1 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:07d5e05c-913f-419f-adbc-d3cf15e9cd51+3:6324:x1876402802528128:12345-0@lo:104: 00010000:00010000:1.0:1789477236.735199:0:5827:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.123@tcp lock: 00000000b056e994/0xafddb3c8f9281419 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xafddb3c8f9281420 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477236.735288:0:5827:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1789477236.735294:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000040d9d9c1 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:07d5e05c-913f-419f-adbc-d3cf15e9cd51+3:6324:x1876402802528128:12345-0@lo:104: Request processed in 113us (362us total) trans 0 rc 0/0 00000100:00100000:1.0:1789477236.735311:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00010000:3.0:1789477236.735324:0:5832:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789477236.735332:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.123@tcp lock: 00000000b056e994/0xafddb3c8f9281419 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xafddb3c8f9281420 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477236.735340:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000b056e994 already unused, calling callback (0000000038babd70) 10000000:00010000:3.0:1789477236.735352:0:5832:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.123@tcp lock: 00000000b056e994/0xafddb3c8f9281419 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xafddb3c8f9281420 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477236.735362:0:5832:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.123@tcp lock: 00000000b056e994/0xafddb3c8f9281419 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xafddb3c8f9281420 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789477236.735369:0:5832:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.123@tcp lock: 00000000b056e994/0xafddb3c8f9281419 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xafddb3c8f9281420 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789477236.735375:0:5832:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1789477236.735419:0:5832:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.123@tcp lock: 00000000b056e994/0xafddb3c8f9281419 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xafddb3c8f9281420 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477236.735426:0:5832:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789477236.735455:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.123@tcp lock: 00000000b056e994/0xafddb3c8f9281419 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xafddb3c8f9281420 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477236.735462:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.123@tcp lock: 00000000b056e994/0xafddb3c8f9281419 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xafddb3c8f9281420 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477236.735484:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789477236.735486:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789477236.735494:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789477236.735502:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789477236.735516:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000001ecd45c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:07d5e05c-913f-419f-adbc-d3cf15e9cd51:3310:1876402802528256:0@lo:103: 00000100:00100000:3.0:1789477236.735552:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789477236.735682:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802528256 00000100:00100000:2.0:1789477236.735688:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802528256 00010000:00010000:2.0:1789477236.735711:0:5829:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 0000000025858e8c/0xafddb3c8f9281420 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xafddb3c8f9281419 expref: 12 pid: 5838 timeout: 331 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789477236.735735:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789477236.735742:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000001d5e6c2 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:07d5e05c-913f-419f-adbc-d3cf15e9cd51+12:3310:x1876402802528256:12345-0@lo:103: 00010000:00010000:2.0:1789477236.735763:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789477236.735769:0:5829:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 0000000025858e8c/0xafddb3c8f9281420 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xafddb3c8f9281419 expref: 12 pid: 5838 timeout: 331 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477236.735780:0:5829:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 0000000025858e8c/0xafddb3c8f9281420 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xafddb3c8f9281419 expref: 12 pid: 5838 timeout: 331 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477236.735799:0:5829:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 000000005982ec0e/0xafddb3c8f928145f lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477236.735819:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000005982ec0e/0xafddb3c8f928145f lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477236.735833:0:5829:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000005982ec0e/0xafddb3c8f928145f lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477236.735840:0:5829:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000005982ec0e/0xafddb3c8f928145f lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477236.735846:0:5829:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 000000005982ec0e/0xafddb3c8f928145f lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477236.735852:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 000000005982ec0e/0xafddb3c8f928145f lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477236.735857:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000005982ec0e already unused, calling callback (00000000dfb29c3b) 00010000:00010000:2.0:1789477236.735861:0:5829:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 000000005982ec0e/0xafddb3c8f928145f lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477236.735868:0:5829:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 000000005982ec0e/0xafddb3c8f928145f lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477236.735887:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 000000005982ec0e/0xafddb3c8f928145f lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477236.735898:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789477236.735941:0:6324:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000025858e8c/0xafddb3c8f9281420 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xafddb3c8f9281419 expref: 12 pid: 5838 timeout: 331 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789477236.735953:0:6324:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000ff04b30c pname:cluuid:pid:xid:nid:opc:job lctl:MGS:6324:1876402802528128:0@lo:104: 00010000:00010000:0.0:1789477236.735977:0:6324:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 000000005982ec0e/0xafddb3c8f928145f lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477236.735986:0:6324:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 000000005982ec0e/0xafddb3c8f928145f lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477236.735991:0:6324:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 000000005982ec0e/0xafddb3c8f928145f lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477236.735997:0:6324:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000005982ec0e/0xafddb3c8f928145f lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789477236.737221:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000001d5e6c2 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:07d5e05c-913f-419f-adbc-d3cf15e9cd51+11:3310:x1876402802528256:12345-0@lo:103: Request processed in 1468us (1658us total) trans 0 rc 0/0 00000100:00100000:2.0:1789477236.737237:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789477236.737244:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000001ecd45c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:07d5e05c-913f-419f-adbc-d3cf15e9cd51:3310:1876402802528256:0@lo:103: 00010000:00010000:1.0:1789477237.423898:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789477238.448910:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789477239.471853:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789477240.503507:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789477241.522764:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789477241.775741:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000006e8375e7 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3313:1876402802528512:0@lo:400: 00000100:00100000:2.0:1789477241.775817:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789477241.775872:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789477241.775878:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000029f87d4e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:07d5e05c-913f-419f-adbc-d3cf15e9cd51:3313:1876402802528384:0@lo:400: 00000100:00100000:2.0:1789477241.775907:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789477241.775939:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802528512 00000100:00100000:2.0:1789477241.775958:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802528512 00000100:00100000:2.0:1789477241.776007:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789477241.776015:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000de4f1834 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1876402802528512:12345-0@lo:400: 00000100:00100000:2.0:1789477241.776067:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000de4f1834 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1876402802528512:12345-0@lo:400: Request processed in 53us (251us total) trans 0 rc 0/0 00000100:00100000:2.0:1789477241.776075:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1789477241.776117:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@000000006e8375e7 x1876402802528512/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789477257 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789477241.776131:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000006e8375e7 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3313:1876402802528512:0@lo:400: 00000100:00100000:0.0:1789477241.776254:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802528384 00000100:00100000:0.0:1789477241.776259:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802528384 00000100:00100000:0.0:1789477241.776298:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1789477241.776304:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000585c5122 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:07d5e05c-913f-419f-adbc-d3cf15e9cd51+11:3313:x1876402802528384:12345-0@lo:400: 00000100:00100000:0.0:1789477241.776351:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000585c5122 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:07d5e05c-913f-419f-adbc-d3cf15e9cd51+11:3313:x1876402802528384:12345-0@lo:400: Request processed in 48us (443us total) trans 0 rc 0/0 00000100:00100000:0.0:1789477241.776358:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1789477241.776390:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000029f87d4e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:07d5e05c-913f-419f-adbc-d3cf15e9cd51:3313:1876402802528384:0@lo:400: 00010000:00010000:0.0:1789477242.544069:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1789477242.745219:0:6692:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:1.0:1789477242.745224:0:6692:0:(obd_mount.c:926:lmd_print()) device: lustre-ost1/ost1 00000080:01200004:1.0:1789477242.745337:0:6692:0:(super25.c:131:lustre_fill_super()) VFS Op: sb 0000000041b88923 00000020:01000004:1.0:1789477242.745355:0:6692:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-OST0000, type=osd-zfs, lsifl=200062, mountfl=0 00000020:01000004:1.0:1789477242.745368:0:6692:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-zfs) 00000020:00000080:1.0:1789477242.745382:0:6692:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (000000001bcc5432) 00000020:00000080:1.0:1789477242.745398:0:6692:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osd-zfs with refcount 2 00100000:10000000:0.0:1789477242.758910:0:6692:0:(scrub.c:230:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00100000:10000000:0.0:1789477242.759214:0:6692:0:(scrub.c:230:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00100000:10000000:1.0:1789477242.777274:0:6692:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:0.0:1789477242.782962:0:6692:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:0.0:1789477242.782998:0:6692:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:0.0:1789477242.783060:0:6692:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:0.0:1789477242.783089:0:6692:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:0.0:1789477242.783634:0:6692:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:0.0:1789477242.783648:0:6692:0:(osd_handler.c:1564:osd_obd_connect()) connect #0 00000020:00000080:0.0:1789477242.783660:0:6692:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xafddb3c8f928146d 00000020:01000004:0.0:1789477242.783669:0:6692:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-OST0000 on device lustre-ost1/ost1 00000020:01000004:0.0:1789477242.783694:0:6692:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.201.123@tcp:Set MGC reconnect 1 10000000:01000000:0.0:1789477242.783698:0:6692:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.201.123@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:0.0:1789477242.783703:0:6692:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-OST0000 00000020:01000004:0.0:1789477242.783708:0:6692:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:0.0:1789477242.783730:0:6692:0:(genops.c:413:class_newdev()) Allocate new device OSS (000000001c22a709) 00000020:00000080:0.0:1789477242.783743:0:6692:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type ost with refcount 2 00000100:00100000:0.0:1789477242.786781:0:6692:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1789477242.786972:0:6692:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:0.0:1789477242.786980:0:6692:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:3.0:1789477242.795623:0:6692:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:3.0:1789477242.795652:0:6692:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:3.0:1789477242.795926:0:6692:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:3.0:1789477242.795931:0:6692:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:3.0:1789477242.799323:0:6692:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1789477242.800119:0:6692:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:3.0:1789477242.800126:0:6692:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:3.0:1789477242.800904:0:6692:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:3.0:1789477242.800912:0:6692:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:1.0:1789477242.852188:0:6692:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1789477242.852470:0:6692:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:1.0:1789477242.852478:0:6692:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:1.0:1789477242.859349:0:6692:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:0.0:1789477242.859446:0:6692:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:1.0:1789477242.860292:0:6692:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:1.0:1789477242.860300:0:6692:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:0.0:1789477242.866325:0:6692:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1789477242.866554:0:6692:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:0.0:1789477242.866560:0:6692:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:0.0:1789477242.867627:0:6692:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:0.0:1789477242.867635:0:6692:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:2.0:1789477242.943942:0:6692:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789477242.944352:0:6692:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:2.0:1789477242.944360:0:6692:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:1.0:1789477242.945988:0:6692:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:1.0:1789477242.946002:0:6692:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:2.0:1789477242.948722:0:6692:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:2.0:1789477242.948761:0:6692:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost1/ost1 10000000:01000000:2.0:1789477242.948769:0:6692:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.201.123@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:3.0:1789477242.972424:0:6692:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.123@tcp ctxt 0 is initialized 00000020:01000004:3.0:1789477242.972681:0:6692:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.201.123@tcp, index=0000, flags=0x20062 00000020:01000004:3.0:1789477242.972685:0:6692:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1789477242.972687:0:6692:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1789477242.972689:0:6692:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789477242.972690:0:6692:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789477242.972691:0:6692:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789477242.972692:0:6692:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789477242.972693:0:6692:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1789477242.972695:0:6692:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1789477242.972696:0:6692:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1789477242.972698:0:6692:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789477242.972700:0:6692:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1789477242.972703:0:6692:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020062 00000020:01000004:3.0:1789477242.972705:0:6692:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1789477242.972707:0:6692:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1789477242.972708:0:6692:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789477242.972709:0:6692:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789477242.972715:0:6692:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789477242.972716:0:6692:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789477242.972717:0:6692:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1789477242.972718:0:6692:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1789477242.972718:0:6692:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1789477242.972719:0:6692:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789477242.972720:0:6692:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1789477242.972749:0:6692:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:3.0:1789477242.972767:0:6692:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000001ecd45c pname:cluuid:pid:xid:nid:opc:job mount.lustre:07d5e05c-913f-419f-adbc-d3cf15e9cd51:6692:1876402802528640:0@lo:253: 00000100:00100000:3.0:1789477242.972853:0:6692:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789477242.972970:0:6692:0:(client.c:2715:ptlrpc_set_wait()) set 00000000c5958e3f going to sleep for 11 seconds 00000100:00100000:2.0:1789477242.973118:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802528640 00000100:00100000:2.0:1789477242.973127:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802528640 00000100:00100000:2.0:1789477242.973235:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1789477242.973244:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c59fa90f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07d5e05c-913f-419f-adbc-d3cf15e9cd51+11:6692:x1876402802528640:12345-0@lo:253: 20000000:01000000:2.0:1789477242.973291:0:5838:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:2.0:1789477242.973296:0:5838:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0000, index=0 20000000:01000000:2.0:1789477242.973302:0:5838:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0000 to 0 20000000:01000000:2.0:1789477242.973305:0:5838:0:(mgs_llog.c:3862:mgs_write_log_ost()) writing new ost lustre-OST0000 00000040:00080000:2.0:1789477242.974408:0:5838:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1789477242.974677:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 20000000:01000000:2.0:1789477242.974690:0:5838:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf001 obdfilter lustre-OST0000_UUID (null) (null) 00000040:00080000:2.0:1789477242.974730:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 128 off8544 20000000:01000000:2.0:1789477242.974738:0:5838:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf003 dev type f (null) 00000040:00080000:2.0:1789477242.974769:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 112 off8656 00000040:00080000:2.0:1789477242.974816:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8880 00000040:00080000:2.0:1789477242.975908:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 224 off11152 20000000:01000000:2.0:1789477242.975936:0:5838:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.201.123@tcp 20000000:01000000:2.0:1789477242.975938:0:5838:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.201.123@tcp (null) (null) (null) 00000040:00080000:2.0:1789477242.975973:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 88 off11240 20000000:01000000:2.0:1789477242.975981:0:5838:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:2.0:1789477242.976154:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 144 off11384 20000000:01000000:2.0:1789477242.976164:0:5838:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf003 lustre-OST0000_UUID 192.168.201.123@tcp (null) (null) 00000040:00080000:2.0:1789477242.976211:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 152 off11536 20000000:01000000:2.0:1789477242.976223:0:5838:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:2.0:1789477242.976255:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 136 off11672 00000040:00080000:2.0:1789477242.976304:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11896 00000040:00080000:2.0:1789477242.977820:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].21, 224 off11952 20000000:01000000:2.0:1789477242.977849:0:5838:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.201.123@tcp 20000000:01000000:2.0:1789477242.977851:0:5838:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.201.123@tcp (null) (null) (null) 00000040:00080000:2.0:1789477242.977900:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].22, 88 off12040 20000000:01000000:2.0:1789477242.977909:0:5838:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:2.0:1789477242.977952:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].23, 128 off12168 20000000:01000000:2.0:1789477242.977959:0:5838:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf003 lustre-OST0000_UUID 192.168.201.123@tcp (null) (null) 00000040:00080000:2.0:1789477242.978099:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].24, 144 off12312 20000000:01000000:2.0:1789477242.978111:0:5838:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:2.0:1789477242.978147:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].25, 128 off12440 00000040:00080000:2.0:1789477242.978178:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].26, 224 off12664 20000000:01000000:2.0:1789477242.978207:0:5838:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' sys.timeout=20 ', param: 'autodegrade=on' 20000000:01000000:2.0:1789477242.978210:0:5838:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'autodegrade=on' 20000000:01000000:2.0:1789477242.978221:0:5838:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:2.0:1789477242.978223:0:5838:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:2.0:1789477242.978225:0:5838:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:2.0:1789477242.978241:0:5838:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:2.0:1789477242.978244:0:5838:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:2.0:1789477242.978283:0:5838:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:2.0:1789477242.978285:0:5838:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 00000040:00080000:0.0:1789477242.979283:0:6707:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 5 count 5 00000040:00080000:2.0:1789477242.979821:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 224 off9104 00000040:00080000:2.0:1789477242.979864:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 80 off9184 00000040:00080000:2.0:1789477242.979933:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9408 20000000:01000000:2.0:1789477242.979947:0:5838:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:2.0:1789477242.979949:0:5838:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:0.0:1789477242.981312:0:6708:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 18 marker 8 1->4: lustre sys.timeout 20000000:01000000:0.0:1789477242.981387:0:6708:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 20 marker 8 2->4: lustre sys.timeout 00000040:00080000:0.0:1789477242.981425:0:6708:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 27 count 27 00000040:00080000:2.0:1789477242.981991:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].27, 224 off12888 00000040:00080000:2.0:1789477242.982049:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].28, 80 off12968 00000040:00080000:2.0:1789477242.982082:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].29, 224 off13192 20000000:01000000:2.0:1789477242.982093:0:5838:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:2.0:1789477242.982095:0:5838:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:2.0:1789477242.982966:0:6709:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 10 marker 9 1->4: lustre sys.timeout 20000000:01000000:2.0:1789477242.983085:0:6709:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 12 marker 9 2->4: lustre sys.timeout 00000040:00080000:2.0:1789477242.983143:0:6709:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 22 count 22 00000040:00080000:3.0:1789477242.983408:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 224 off12120 00000040:00080000:3.0:1789477242.983742:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 80 off12200 00000040:00080000:3.0:1789477242.983808:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 224 off12424 10000000:01000000:3.0:1789477242.983828:0:5838:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:3.0:1789477242.983846:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 000000008e88987e/0xafddb3c8f928147b lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477242.983865:0:5838:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 000000006a13f80c/0xafddb3c8f92813a2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xafddb3c8f928139b expref: 11 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477242.983873:0:5838:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 000000006c968605/0xafddb3c8f92813be lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xafddb3c8f92813b7 expref: 11 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477242.983879:0:5838:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 0000000036f62c55/0xafddb3c8f928142e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xafddb3c8f9281427 expref: 11 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477242.983887:0:5838:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 000000008e88987e/0xafddb3c8f928147b lrc: 6/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477242.984105:0:5838:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 0000000036f62c55/0xafddb3c8f928142e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xafddb3c8f9281427 expref: 11 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477242.984121:0:5838:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 0000000036f62c55/0xafddb3c8f928142e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xafddb3c8f9281427 expref: 11 pid: 5837 timeout: 338 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789477242.984144:0:5838:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000041377b9 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5838:1876402802528768:0@lo:104: 00000100:00100000:3.0:1789477242.984231:0:5838:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789477242.984336:0:5838:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 000000006c968605/0xafddb3c8f92813be lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xafddb3c8f92813b7 expref: 11 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477242.984344:0:5838:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 000000006c968605/0xafddb3c8f92813be lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xafddb3c8f92813b7 expref: 11 pid: 5839 timeout: 338 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789477242.984351:0:5838:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000006a24bed1 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5838:1876402802528896:0@lo:104: 00000100:00100000:3.0:1789477242.984373:0:5838:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789477242.984456:0:5838:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 000000006a13f80c/0xafddb3c8f92813a2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xafddb3c8f928139b expref: 11 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477242.984464:0:5838:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 000000006a13f80c/0xafddb3c8f92813a2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xafddb3c8f928139b expref: 11 pid: 5838 timeout: 338 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789477242.984472:0:5838:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000f9e5df99 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5838:1876402802529024:0@lo:104: 00000100:00100000:3.0:1789477242.984492:0:5838:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789477242.984743:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802528768 00000100:00100000:2.0:1789477242.984751:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802528768 00000100:00100000:2.0:1789477242.984788:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802528896 00000100:00100000:2.0:1789477242.984799:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802528896 00000100:00100000:2.0:1789477242.984814:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789477242.984821:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000fe95939f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:07d5e05c-913f-419f-adbc-d3cf15e9cd51+4:5838:x1876402802528768:12345-0@lo:104: 00010000:00010000:2.0:1789477242.984832:0:5828:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.123@tcp lock: 00000000b3c4ca14/0xafddb3c8f9281427 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xafddb3c8f928142e expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477242.984878:0:5828:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1789477242.984883:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000fe95939f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:07d5e05c-913f-419f-adbc-d3cf15e9cd51+4:5838:x1876402802528768:12345-0@lo:104: Request processed in 62us (654us total) trans 0 rc 0/0 00000100:00100000:2.0:1789477242.984889:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789477242.984902:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1789477242.984906:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000006d6dd11b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:07d5e05c-913f-419f-adbc-d3cf15e9cd51+3:5838:x1876402802528896:12345-0@lo:104: 00010000:00010000:2.0:1789477242.984912:0:5828:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.123@tcp lock: 00000000d7ded8a6/0xafddb3c8f92813b7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xafddb3c8f92813be expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477242.984936:0:5828:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1789477242.984940:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000006d6dd11b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:07d5e05c-913f-419f-adbc-d3cf15e9cd51+3:5838:x1876402802528896:12345-0@lo:104: Request processed in 34us (567us total) trans 0 rc 0/0 00000100:00100000:2.0:1789477242.984944:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789477242.985029:0:5838:0:(client.c:2715:ptlrpc_set_wait()) set 00000000a8d6d48e going to sleep for 11 seconds 00000100:00100000:3.0:1789477242.985050:0:5838:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000041377b9 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5838:1876402802528768:0@lo:104: 00000100:00100000:3.0:1789477242.985057:0:5838:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000006a24bed1 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5838:1876402802528896:0@lo:104: 00000100:00100000:2.0:1789477242.985159:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802529024 00000100:00100000:2.0:1789477242.985163:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802529024 00000100:00100000:2.0:1789477242.985180:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1789477242.985185:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000005ba37be7 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:07d5e05c-913f-419f-adbc-d3cf15e9cd51+3:5838:x1876402802529024:12345-0@lo:104: 00010000:00010000:2.0:1789477242.985201:0:5828:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.123@tcp lock: 000000006b55e165/0xafddb3c8f928139b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xafddb3c8f92813a2 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477242.985237:0:5828:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:2.0:1789477242.985241:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000005ba37be7 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:07d5e05c-913f-419f-adbc-d3cf15e9cd51+3:5838:x1876402802529024:12345-0@lo:104: Request processed in 57us (749us total) trans 0 rc 0/0 00000100:00100000:2.0:1789477242.985251:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1789477242.985304:0:5838:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000f9e5df99 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5838:1876402802529024:0@lo:104: 00010000:00010000:3.0:1789477242.985326:0:5838:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 000000008e88987e/0xafddb3c8f928147b lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477242.985389:0:5833:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1789477242.985394:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.123@tcp lock: 00000000b3c4ca14/0xafddb3c8f9281427 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xafddb3c8f928142e expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477242.985407:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000b3c4ca14 already unused, calling callback (0000000038babd70) 10000000:00010000:1.0:1789477242.985410:0:5833:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.123@tcp lock: 00000000b3c4ca14/0xafddb3c8f9281427 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xafddb3c8f928142e expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477242.985416:0:5833:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.123@tcp lock: 00000000b3c4ca14/0xafddb3c8f9281427 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xafddb3c8f928142e expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789477242.985422:0:5833:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.123@tcp lock: 00000000b3c4ca14/0xafddb3c8f9281427 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xafddb3c8f928142e expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789477242.985426:0:5833:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1789477242.985626:0:5833:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.123@tcp lock: 00000000b3c4ca14/0xafddb3c8f9281427 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xafddb3c8f928142e expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477242.985633:0:5833:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789477242.985659:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.123@tcp lock: 00000000b3c4ca14/0xafddb3c8f9281427 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xafddb3c8f928142e expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477242.985665:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.123@tcp lock: 00000000b3c4ca14/0xafddb3c8f9281427 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xafddb3c8f928142e expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477242.985680:0:5833:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1789477242.985682:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.123@tcp lock: 00000000d7ded8a6/0xafddb3c8f92813b7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xafddb3c8f92813be expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477242.985688:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000d7ded8a6 already unused, calling callback (0000000038babd70) 10000000:00010000:1.0:1789477242.985689:0:5833:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.123@tcp lock: 00000000d7ded8a6/0xafddb3c8f92813b7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xafddb3c8f92813be expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477242.985705:0:5833:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.123@tcp lock: 00000000d7ded8a6/0xafddb3c8f92813b7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xafddb3c8f92813be expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789477242.985711:0:5833:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.123@tcp lock: 00000000d7ded8a6/0xafddb3c8f92813b7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xafddb3c8f92813be expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789477242.985715:0:5833:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:3.0:1789477242.985758:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000c03d86c4 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:07d5e05c-913f-419f-adbc-d3cf15e9cd51:3310:1876402802529152:0@lo:103: 00000100:00100000:3.0:1789477242.985798:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789477242.985911:0:5832:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789477242.986259:0:6710:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789477242.986261:0:6710:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789477242.986262:0:6710:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789477242.986298:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.123@tcp lock: 000000006b55e165/0xafddb3c8f928139b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xafddb3c8f92813a2 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477242.986306:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000006b55e165 already unused, calling callback (0000000038babd70) 10000000:00010000:0.0:1789477242.986309:0:5832:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.123@tcp lock: 000000006b55e165/0xafddb3c8f928139b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xafddb3c8f92813a2 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477242.986315:0:5832:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.123@tcp lock: 000000006b55e165/0xafddb3c8f928139b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xafddb3c8f92813a2 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789477242.986321:0:5832:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.123@tcp lock: 000000006b55e165/0xafddb3c8f928139b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xafddb3c8f92813a2 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789477242.986325:0:5832:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1789477242.986362:0:5841:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1789477242.986365:0:5841:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9d0d4444e800 from 21 10000000:01000000:2.0:1789477242.986369:0:5841:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1789477242.986391:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.123@tcp lock: 0000000054b110aa/0xafddb3c8f9281482 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477242.986398:0:5841:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.123@tcp lock: 0000000054b110aa/0xafddb3c8f9281482 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477242.986406:0:5841:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.123@tcp lock: 0000000054b110aa/0xafddb3c8f9281482 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789477242.986419:0:5841:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000006e8375e7 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07d5e05c-913f-419f-adbc-d3cf15e9cd51:5841:1876402802529280:0@lo:101: 00000100:00100000:2.0:1789477242.986609:0:5841:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789477242.986636:0:5841:0:(client.c:2715:ptlrpc_set_wait()) set 00000000c233a775 going to sleep for 11 seconds 00000100:00100000:3.0:1789477242.986690:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802529280 00000100:00100000:3.0:1789477242.986696:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802529280 00000100:00100000:3.0:1789477242.986735:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1789477242.986741:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f71e5504 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07d5e05c-913f-419f-adbc-d3cf15e9cd51+12:5841:x1876402802529280:12345-0@lo:101: 00010000:00010000:3.0:1789477242.986754:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789477242.986765:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000d3d282be/0xafddb3c8f9281489 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xafddb3c8f9281482 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477242.986782:0:5837:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 000000008e88987e/0xafddb3c8f928147b lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477242.986790:0:5837:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 00000000d3d282be/0xafddb3c8f9281489 lrc: 4/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xafddb3c8f9281482 expref: 13 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477242.986802:0:5837:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: MGS lock: 000000008e88987e/0xafddb3c8f928147b lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40210400000020 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477242.986813:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000d3d282be/0xafddb3c8f9281489 lrc: 3/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xafddb3c8f9281482 expref: 13 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477242.986822:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000d3d282be, rc 0) 00000100:00100000:3.0:1789477242.986853:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f71e5504 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07d5e05c-913f-419f-adbc-d3cf15e9cd51+13:5841:x1876402802529280:12345-0@lo:101: Request processed in 113us (244us total) trans 0 rc 0/0 00000100:00100000:3.0:1789477242.986859:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1789477242.986939:0:5841:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000006e8375e7 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07d5e05c-913f-419f-adbc-d3cf15e9cd51:5841:1876402802529280:0@lo:101: 00010000:00010000:2.0:1789477242.986950:0:5841:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGC192.168.201.123@tcp lock: 0000000054b110aa/0xafddb3c8f9281482 lrc: 4/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xafddb3c8f9281489 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477242.986956:0:5841:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGC192.168.201.123@tcp lock: 0000000054b110aa/0xafddb3c8f9281482 lrc: 4/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xafddb3c8f9281489 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477242.987299:0:5833:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.123@tcp lock: 00000000d7ded8a6/0xafddb3c8f92813b7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xafddb3c8f92813be expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477242.987308:0:5833:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:3.0:1789477242.987348:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00010000:00010000:1.0:1789477242.987366:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.123@tcp lock: 00000000d7ded8a6/0xafddb3c8f92813b7 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xafddb3c8f92813be expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477242.987374:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.123@tcp lock: 00000000d7ded8a6/0xafddb3c8f92813b7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xafddb3c8f92813be expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477242.987387:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789477242.987388:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789477242.987390:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789477242.987407:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802529152 00000100:00100000:1.0:1789477242.987410:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802529152 00010000:00010000:1.0:1789477242.987428:0:5830:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 0000000036f62c55/0xafddb3c8f928142e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xafddb3c8f9281427 expref: 13 pid: 5837 timeout: 338 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789477242.987464:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789477242.987469:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f9e5df99 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:07d5e05c-913f-419f-adbc-d3cf15e9cd51+13:3310:x1876402802529152:12345-0@lo:103: 00010000:00010000:1.0:1789477242.987477:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789477242.987481:0:5830:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 0000000036f62c55/0xafddb3c8f928142e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xafddb3c8f9281427 expref: 13 pid: 5837 timeout: 338 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477242.987499:0:5830:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 0000000036f62c55/0xafddb3c8f928142e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xafddb3c8f9281427 expref: 13 pid: 5837 timeout: 338 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477242.987521:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000036f62c55/0xafddb3c8f928142e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xafddb3c8f9281427 expref: 13 pid: 5837 timeout: 338 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477242.987531:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789477242.987679:0:5832:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.123@tcp lock: 000000006b55e165/0xafddb3c8f928139b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xafddb3c8f92813a2 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477242.987687:0:5832:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789477242.987701:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.123@tcp lock: 000000006b55e165/0xafddb3c8f928139b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xafddb3c8f92813a2 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477242.987708:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.123@tcp lock: 000000006b55e165/0xafddb3c8f928139b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xafddb3c8f92813a2 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477242.987716:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789477242.987724:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789477242.987726:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789477242.987737:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000ff04b30c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:07d5e05c-913f-419f-adbc-d3cf15e9cd51:3312:1876402802529536:0@lo:103: 00000100:00100000:0.0:1789477242.987766:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789477242.987816:0:5831:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:0.0:1789477242.987824:0:5831:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00000100:00100000:0.0:1789477242.987926:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802529536 00000100:00100000:0.0:1789477242.987930:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802529536 00010000:00010000:0.0:1789477242.987945:0:5831:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 000000006a13f80c/0xafddb3c8f92813a2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xafddb3c8f928139b expref: 13 pid: 5838 timeout: 338 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789477242.987959:0:5831:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:0.0:1789477242.987974:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1789477242.987980:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c5dd129c pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:07d5e05c-913f-419f-adbc-d3cf15e9cd51+13:3312:x1876402802529536:12345-0@lo:103: 00010000:00010000:0.0:1789477242.987988:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789477242.987992:0:5831:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 000000006a13f80c/0xafddb3c8f92813a2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xafddb3c8f928139b expref: 13 pid: 5838 timeout: 338 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477242.987999:0:5831:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 000000006a13f80c/0xafddb3c8f92813a2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xafddb3c8f928139b expref: 13 pid: 5838 timeout: 338 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477242.988019:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000006a13f80c/0xafddb3c8f92813a2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xafddb3c8f928139b expref: 13 pid: 5838 timeout: 338 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477242.988029:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789477242.988057:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c5dd129c pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:07d5e05c-913f-419f-adbc-d3cf15e9cd51+12:3312:x1876402802529536:12345-0@lo:103: Request processed in 77us (290us total) trans 0 rc 0/0 00000100:00100000:0.0:1789477242.988064:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1789477242.988091:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000ff04b30c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:07d5e05c-913f-419f-adbc-d3cf15e9cd51:3312:1876402802529536:0@lo:103: 00000100:00100000:3.0:1789477242.988398:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000002e80ca71 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:07d5e05c-913f-419f-adbc-d3cf15e9cd51:3310:1876402802529408:0@lo:103: 00000100:00100000:3.0:1789477242.988551:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789477242.988680:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802529408 00000100:00100000:0.0:1789477242.988689:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802529408 00010000:00010000:0.0:1789477242.988703:0:5831:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 000000006c968605/0xafddb3c8f92813be lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xafddb3c8f92813b7 expref: 12 pid: 5839 timeout: 338 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789477242.988731:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1789477242.988737:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000006a24bed1 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:07d5e05c-913f-419f-adbc-d3cf15e9cd51+12:3310:x1876402802529408:12345-0@lo:103: 00010000:00010000:0.0:1789477242.988745:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789477242.988748:0:5831:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 000000006c968605/0xafddb3c8f92813be lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xafddb3c8f92813b7 expref: 12 pid: 5839 timeout: 338 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477242.988756:0:5831:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 000000006c968605/0xafddb3c8f92813be lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xafddb3c8f92813b7 expref: 12 pid: 5839 timeout: 338 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477242.988766:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000006c968605/0xafddb3c8f92813be lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xafddb3c8f92813b7 expref: 12 pid: 5839 timeout: 338 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477242.988777:0:5831:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 000000008e88987e/0xafddb3c8f928147b lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40290400000020 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477242.988783:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000008e88987e/0xafddb3c8f928147b lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40290400000020 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477242.988795:0:5831:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000008e88987e/0xafddb3c8f928147b lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000020 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477242.988800:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000008e88987e/0xafddb3c8f928147b lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000020 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477242.988804:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 000000008e88987e/0xafddb3c8f928147b lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000020 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477242.988809:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 000000008e88987e/0xafddb3c8f928147b lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000020 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477242.988820:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000008e88987e already unused, calling callback (00000000dfb29c3b) 00010000:00010000:0.0:1789477242.988823:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 000000008e88987e/0xafddb3c8f928147b lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000020 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477242.988829:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 000000008e88987e/0xafddb3c8f928147b lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000020 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477242.988845:0:5831:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 00000000d3d282be/0xafddb3c8f9281489 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40080000000000 nid: 0@lo remote: 0xafddb3c8f9281482 expref: 11 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477242.988850:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000d3d282be/0xafddb3c8f9281489 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40080000000000 nid: 0@lo remote: 0xafddb3c8f9281482 expref: 11 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477242.988867:0:5831:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: MGS lock: 00000000d3d282be/0xafddb3c8f9281489 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xafddb3c8f9281482 expref: 11 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789477242.988875:0:5831:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000ff04b30c pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:MGS:5831:1876402802529664:0@lo:105: 00000100:00100000:0.0:1789477242.988898:0:5831:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789477242.988918:0:5831:0:(client.c:2715:ptlrpc_set_wait()) set 0000000095196c49 going to sleep for 11 seconds 00000100:00100000:0.0:1789477242.988931:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802529664 00000100:00100000:0.0:1789477242.988935:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802529664 00000100:00100000:0.0:1789477242.988957:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1789477242.988962:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f80f8f66 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:07d5e05c-913f-419f-adbc-d3cf15e9cd51+3:5831:x1876402802529664:12345-0@lo:105: 00010000:00010000:0.0:1789477242.988970:0:5828:0:(ldlm_lockd.c:2518:ldlm_callback_handler()) ### completion ast ns: MGC192.168.201.123@tcp lock: 0000000054b110aa/0xafddb3c8f9281482 lrc: 5/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xafddb3c8f9281489 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477242.988977:0:5828:0:(ldlm_lockd.c:1968:ldlm_handle_cp_callback()) ### client completion callback handler START ns: MGC192.168.201.123@tcp lock: 0000000054b110aa/0xafddb3c8f9281482 lrc: 5/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xafddb3c8f9281489 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477242.988995:0:5828:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGC192.168.201.123@tcp lock: 0000000054b110aa/0xafddb3c8f9281482 lrc: 5/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11080000000000 nid: local remote: 0xafddb3c8f9281489 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477242.989000:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.123@tcp lock: 0000000054b110aa/0xafddb3c8f9281482 lrc: 6/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11080000000000 nid: local remote: 0xafddb3c8f9281489 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477242.989005:0:5828:0:(ldlm_lockd.c:2073:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: MGC192.168.201.123@tcp lock: 0000000054b110aa/0xafddb3c8f9281482 lrc: 6/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1080000000000 nid: local remote: 0xafddb3c8f9281489 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477242.989036:0:5828:0:(ldlm_lockd.c:2084:ldlm_handle_cp_callback()) ### client completion callback handler END (lock 0000000054b110aa) 00000100:00100000:0.0:1789477242.989061:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f80f8f66 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:07d5e05c-913f-419f-adbc-d3cf15e9cd51+3:5831:x1876402802529664:12345-0@lo:105: Request processed in 99us (164us total) trans 0 rc 0/0 00000100:00100000:0.0:1789477242.989067:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00010000:0.0:1789477242.989082:0:5841:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: MGC192.168.201.123@tcp lock: 0000000054b110aa/0xafddb3c8f9281482 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xafddb3c8f9281489 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477242.989089:0:5841:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.123@tcp lock: 0000000054b110aa/0xafddb3c8f9281482 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xafddb3c8f9281489 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789477242.989133:0:5841:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000e9b11cc9 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07d5e05c-913f-419f-adbc-d3cf15e9cd51:5841:1876402802529792:0@lo:501: 00000100:00100000:0.0:1789477242.989158:0:5841:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789477242.989172:0:5841:0:(client.c:2715:ptlrpc_set_wait()) set 00000000ee449730 going to sleep for 11 seconds 00000100:00100000:0.0:1789477242.989185:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802529792 00000100:00100000:0.0:1789477242.989188:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802529792 00000100:00100000:0.0:1789477242.989217:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1789477242.989222:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c4732a12 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07d5e05c-913f-419f-adbc-d3cf15e9cd51+12:5841:x1876402802529792:12345-0@lo:501: 00000100:00100000:0.0:1789477242.989329:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c4732a12 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07d5e05c-913f-419f-adbc-d3cf15e9cd51+12:5841:x1876402802529792:12345-0@lo:501: Request processed in 107us (171us total) trans 0 rc 0/0 00000100:00100000:0.0:1789477242.989342:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1789477242.989379:0:5831:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000ff04b30c pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:MGS:5831:1876402802529664:0@lo:105: 00010000:00010000:0.0:1789477242.989392:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 000000008e88987e/0xafddb3c8f928147b lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000020 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477242.989401:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789477242.989421:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000006a24bed1 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:07d5e05c-913f-419f-adbc-d3cf15e9cd51+11:3310:x1876402802529408:12345-0@lo:103: Request processed in 685us (986us total) trans 0 rc 0/0 00000100:00100000:0.0:1789477242.989427:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1789477242.989459:0:5841:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000e9b11cc9 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07d5e05c-913f-419f-adbc-d3cf15e9cd51:5841:1876402802529792:0@lo:501: 00000100:00100000:0.0:1789477242.989495:0:5841:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000e9b11cc9 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07d5e05c-913f-419f-adbc-d3cf15e9cd51:5841:1876402802529920:0@lo:503: 00000100:00100000:0.0:1789477242.989540:0:5841:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789477242.989552:0:5841:0:(client.c:2715:ptlrpc_set_wait()) set 00000000ee449730 going to sleep for 11 seconds 00000100:00100000:0.0:1789477242.989563:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802529920 00000100:00100000:0.0:1789477242.989566:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802529920 00000100:00100000:0.0:1789477242.989616:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1789477242.989622:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e05137f9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07d5e05c-913f-419f-adbc-d3cf15e9cd51+11:5841:x1876402802529920:12345-0@lo:503: 00000100:00100000:0.0:1789477242.989766:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e05137f9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07d5e05c-913f-419f-adbc-d3cf15e9cd51+11:5841:x1876402802529920:12345-0@lo:503: Request processed in 144us (225us total) trans 0 rc 0/0 00000100:00100000:0.0:1789477242.989773:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1789477242.989818:0:5841:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000e9b11cc9 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07d5e05c-913f-419f-adbc-d3cf15e9cd51:5841:1876402802529920:0@lo:503: 00010000:00010000:0.0:1789477242.989930:0:5838:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 000000008e88987e/0xafddb3c8f928147b lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000020 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477242.989938:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 000000008e88987e/0xafddb3c8f928147b lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000020 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477242.989954:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000008e88987e/0xafddb3c8f928147b lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000020 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1789477242.989965:0:5838:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:0.0:1789477242.990063:0:6712:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000e9b11cc9 pname:cluuid:pid:xid:nid:opc:job llog_process_th:07d5e05c-913f-419f-adbc-d3cf15e9cd51:6712:1876402802530048:0@lo:502: 00000100:00100000:0.0:1789477242.990097:0:6712:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789477242.990116:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802530048 00000100:00100000:0.0:1789477242.990119:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802530048 00000100:00100000:0.0:1789477242.990145:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1789477242.990150:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000002ef9eb83 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07d5e05c-913f-419f-adbc-d3cf15e9cd51+11:6712:x1876402802530048:12345-0@lo:502: 00000100:00100000:0.0:1789477242.990290:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000002ef9eb83 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07d5e05c-913f-419f-adbc-d3cf15e9cd51+11:6712:x1876402802530048:12345-0@lo:502: Request processed in 139us (193us total) trans 0 rc 0/0 00000100:00100000:0.0:1789477242.990296:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1789477242.990328:0:6712:0:(client.c:2715:ptlrpc_set_wait()) set 00000000212fe234 going to sleep for 11 seconds 00000100:00100000:0.0:1789477242.990339:0:6712:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000e9b11cc9 pname:cluuid:pid:xid:nid:opc:job llog_process_th:07d5e05c-913f-419f-adbc-d3cf15e9cd51:6712:1876402802530048:0@lo:502: 00000100:00100000:0.0:1789477242.990376:0:6712:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000e9b11cc9 pname:cluuid:pid:xid:nid:opc:job llog_process_th:07d5e05c-913f-419f-adbc-d3cf15e9cd51:6712:1876402802530176:0@lo:502: 00000100:00100000:0.0:1789477242.990404:0:6712:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789477242.990421:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802530176 00000100:00100000:0.0:1789477242.990424:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802530176 00000100:00100000:0.0:1789477242.990439:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1789477242.990443:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000976fd52a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07d5e05c-913f-419f-adbc-d3cf15e9cd51+11:6712:x1876402802530176:12345-0@lo:502: 00000100:00100000:0.0:1789477242.990529:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000976fd52a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07d5e05c-913f-419f-adbc-d3cf15e9cd51+11:6712:x1876402802530176:12345-0@lo:502: Request processed in 86us (125us total) trans 0 rc 0/0 00000100:00100000:0.0:1789477242.990536:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1789477242.990560:0:6712:0:(client.c:2715:ptlrpc_set_wait()) set 00000000adbcd307 going to sleep for 11 seconds 00000100:00100000:0.0:1789477242.990573:0:6712:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000e9b11cc9 pname:cluuid:pid:xid:nid:opc:job llog_process_th:07d5e05c-913f-419f-adbc-d3cf15e9cd51:6712:1876402802530176:0@lo:502: 00000040:00080000:0.0:1789477242.990609:0:6712:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 30 count 30 00000020:01000000:0.0:1789477242.990647:0:5841:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 21-29 (rc=0) 10000000:01000000:0.0:1789477242.990658:0:5841:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.123@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1789477242.990663:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.123@tcp lock: 0000000054b110aa/0xafddb3c8f9281482 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xafddb3c8f9281489 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477242.990669:0:5841:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.123@tcp lock: 0000000054b110aa/0xafddb3c8f9281482 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xafddb3c8f9281489 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789477242.990676:0:5841:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:0.0:1789477242.990678:0:5841:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 16 10000000:01000000:0.0:1789477242.990681:0:5841:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:0.0:1789477242.990700:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.123@tcp lock: 0000000034bdbdb9/0xafddb3c8f9281490 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477242.990707:0:5841:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.123@tcp lock: 0000000034bdbdb9/0xafddb3c8f9281490 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477242.990715:0:5841:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.123@tcp lock: 0000000034bdbdb9/0xafddb3c8f9281490 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789477242.990726:0:5841:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000e9b11cc9 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07d5e05c-913f-419f-adbc-d3cf15e9cd51:5841:1876402802530304:0@lo:101: 00000100:00100000:0.0:1789477242.990749:0:5841:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789477242.990765:0:5841:0:(client.c:2715:ptlrpc_set_wait()) set 00000000adbcd307 going to sleep for 11 seconds 00000100:00100000:0.0:1789477242.990776:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802530304 00000100:00100000:0.0:1789477242.990779:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802530304 00000100:00100000:0.0:1789477242.990797:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1789477242.990802:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e6fc4895 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07d5e05c-913f-419f-adbc-d3cf15e9cd51+11:5841:x1876402802530304:12345-0@lo:101: 00010000:00010000:0.0:1789477242.990809:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789477242.990824:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000b056e994/0xafddb3c8f9281497 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xafddb3c8f9281490 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477242.990840:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000b056e994/0xafddb3c8f9281497 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xafddb3c8f9281490 expref: 12 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477242.990847:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000b056e994/0xafddb3c8f9281497 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xafddb3c8f9281490 expref: 12 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477242.990855:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000b056e994, rc 0) 00000100:00100000:0.0:1789477242.990881:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e6fc4895 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07d5e05c-913f-419f-adbc-d3cf15e9cd51+12:5841:x1876402802530304:12345-0@lo:101: Request processed in 79us (132us total) trans 0 rc 0/0 00000100:00100000:0.0:1789477242.990887:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1789477242.990914:0:5841:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000e9b11cc9 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07d5e05c-913f-419f-adbc-d3cf15e9cd51:5841:1876402802530304:0@lo:101: 00010000:00010000:0.0:1789477242.990925:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.123@tcp lock: 0000000034bdbdb9/0xafddb3c8f9281490 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xafddb3c8f9281497 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477242.990932:0:5841:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.123@tcp lock: 0000000034bdbdb9/0xafddb3c8f9281490 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xafddb3c8f9281497 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789477242.990964:0:5841:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000e9b11cc9 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07d5e05c-913f-419f-adbc-d3cf15e9cd51:5841:1876402802530432:0@lo:501: 00000100:00100000:0.0:1789477242.990986:0:5841:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789477242.990997:0:5841:0:(client.c:2715:ptlrpc_set_wait()) set 00000000adbcd307 going to sleep for 11 seconds 00000100:00100000:0.0:1789477242.991007:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802530432 00000100:00100000:0.0:1789477242.991010:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802530432 00000100:00100000:0.0:1789477242.991028:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1789477242.991033:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000004cda9112 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07d5e05c-913f-419f-adbc-d3cf15e9cd51+12:5841:x1876402802530432:12345-0@lo:501: 00000100:00100000:0.0:1789477242.991101:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000004cda9112 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07d5e05c-913f-419f-adbc-d3cf15e9cd51+12:5841:x1876402802530432:12345-0@lo:501: Request processed in 68us (114us total) trans 0 rc 0/0 00000100:00100000:0.0:1789477242.991114:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1789477242.991140:0:5841:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000e9b11cc9 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07d5e05c-913f-419f-adbc-d3cf15e9cd51:5841:1876402802530432:0@lo:501: 00000100:00100000:0.0:1789477242.991158:0:5841:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000e9b11cc9 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07d5e05c-913f-419f-adbc-d3cf15e9cd51:5841:1876402802530560:0@lo:503: 00000100:00100000:0.0:1789477242.991185:0:5841:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789477242.991209:0:5841:0:(client.c:2715:ptlrpc_set_wait()) set 00000000adbcd307 going to sleep for 11 seconds 00000100:00100000:0.0:1789477242.991219:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802530560 00000100:00100000:0.0:1789477242.991221:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802530560 00000100:00100000:0.0:1789477242.991236:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1789477242.991240:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000826efce1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07d5e05c-913f-419f-adbc-d3cf15e9cd51+12:5841:x1876402802530560:12345-0@lo:503: 00000100:00100000:0.0:1789477242.991348:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000826efce1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07d5e05c-913f-419f-adbc-d3cf15e9cd51+12:5841:x1876402802530560:12345-0@lo:503: Request processed in 107us (163us total) trans 0 rc 0/0 00000100:00100000:0.0:1789477242.991355:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1789477242.991390:0:5841:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000e9b11cc9 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07d5e05c-913f-419f-adbc-d3cf15e9cd51:5841:1876402802530560:0@lo:503: 00000100:00100000:1.0:1789477242.991958:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f9e5df99 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:07d5e05c-913f-419f-adbc-d3cf15e9cd51+11:3310:x1876402802529152:12345-0@lo:103: Request processed in 4487us (6159us total) trans 0 rc 0/0 00000100:00100000:1.0:1789477242.991966:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789477242.995784:0:6713:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000008bfb7c02 pname:cluuid:pid:xid:nid:opc:job llog_process_th:07d5e05c-913f-419f-adbc-d3cf15e9cd51:6713:1876402802530688:0@lo:502: 00000100:00100000:2.0:1789477242.995869:0:6713:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789477242.995923:0:6713:0:(client.c:2715:ptlrpc_set_wait()) set 00000000c233a775 going to sleep for 11 seconds 00000100:00100000:3.0:1789477242.996142:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000c03d86c4 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:07d5e05c-913f-419f-adbc-d3cf15e9cd51:3310:1876402802529152:0@lo:103: 00000100:00100000:3.0:1789477242.996185:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000002e80ca71 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:07d5e05c-913f-419f-adbc-d3cf15e9cd51:3310:1876402802529408:0@lo:103: 00000100:00100000:0.0:1789477243.008744:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802530688 00000100:00100000:0.0:1789477243.008761:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802530688 00000100:00100000:0.0:1789477243.008814:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1789477243.008825:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000656a9710 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07d5e05c-913f-419f-adbc-d3cf15e9cd51+11:6713:x1876402802530688:12345-0@lo:502: 00000100:00100000:0.0:1789477243.009106:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000656a9710 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07d5e05c-913f-419f-adbc-d3cf15e9cd51+11:6713:x1876402802530688:12345-0@lo:502: Request processed in 281us (13237us total) trans 0 rc 0/0 00000100:00100000:0.0:1789477243.009114:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1789477243.009787:0:6713:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000008bfb7c02 pname:cluuid:pid:xid:nid:opc:job llog_process_th:07d5e05c-913f-419f-adbc-d3cf15e9cd51:6713:1876402802530688:0@lo:502: 00000020:01000000:2.0:1789477243.009820:0:6713:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1789477243.009833:0:6713:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-mdt1/mdt1 00000020:00000080:2.0:1789477243.009839:0:6713:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789477243.009841:0:6713:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-OST0000 add osc 00000020:00000080:2.0:1789477243.009845:0:6713:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1789477243.009848:0:6713:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.201.123@tcp to nid 0x20000c0a8c97b (192.168.201.123@tcp) 00000020:01000000:2.0:1789477243.009869:0:6713:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:2.0:1789477243.009872:0:6713:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1789477243.009884:0:6713:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (000000001e7cfd1d) 00000020:00000080:2.0:1789477243.009925:0:6713:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type osp with refcount 2 00000020:00000080:2.0:1789477243.009932:0:6713:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1789477243.010002:0:6713:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:2.0:1789477243.010007:0:6713:0:(osd_handler.c:1564:osd_obd_connect()) connect #5 00000020:00000080:2.0:1789477243.010013:0:6713:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xafddb3c8f92814a5 00010000:00080000:2.0:1789477243.010043:0:6713:0:(ldlm_lib.c:102:import_set_conn()) imp 00000000cbbb7c4a@lustre-OST0000-osc-MDT0000: add connection 192.168.201.123@tcp at head 00010000:00010000:2.0:1789477243.010283:0:6713:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-2 is initialized 00000100:00100000:0.0:1789477243.071618:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c59fa90f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07d5e05c-913f-419f-adbc-d3cf15e9cd51+10:6692:x1876402802528640:12345-0@lo:253: Request processed in 98368us (98758us total) trans 0 rc 0/0 00000100:00100000:0.0:1789477243.071635:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000040:01000000:1.0:1789477243.071735:0:6713:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:1.0:1789477243.071753:0:6713:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:1.0:1789477243.072284:0:6713:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789477243.072450:0:6713:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789477243.072736:0:6713:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].1, 64 off8256 00000040:00080000:1.0:1789477243.072807:0:6713:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1, 64 off8256 00000100:00100000:3.0:1789477243.073155:0:6692:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000001ecd45c pname:cluuid:pid:xid:nid:opc:job mount.lustre:07d5e05c-913f-419f-adbc-d3cf15e9cd51:6692:1876402802528640:0@lo:253: 10000000:01000000:3.0:1789477243.073172:0:6692:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:3.0:1789477243.073175:0:6692:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1789477243.073177:0:6692:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1789477243.073179:0:6692:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789477243.073180:0:6692:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0000_UUID 00000020:01000004:3.0:1789477243.073181:0:6692:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789477243.073182:0:6692:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789477243.073184:0:6692:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1789477243.073185:0:6692:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:3.0:1789477243.073187:0:6692:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789477243.073197:0:6692:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1789477243.073214:0:6692:0:(tgt_mount.c:101:server_register_mount()) register mount 0000000041b88923 from lustre-OST0000 10000000:01000000:3.0:1789477243.073239:0:6692:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:3.0:1789477243.073241:0:6692:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:3.0:1789477243.073248:0:6692:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9d0d482499b8 local copy 10000000:01000000:3.0:1789477243.073251:0:6692:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1789477243.073283:0:6692:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.123@tcp lock: 0000000078a540b8/0xafddb3c8f92814ac lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477243.073293:0:6692:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.201.123@tcp lock: 0000000078a540b8/0xafddb3c8f92814ac lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477243.073302:0:6692:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.123@tcp lock: 0000000078a540b8/0xafddb3c8f92814ac lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789477243.073321:0:6692:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000001ecd45c pname:cluuid:pid:xid:nid:opc:job mount.lustre:07d5e05c-913f-419f-adbc-d3cf15e9cd51:6692:1876402802530816:0@lo:101: 00000100:00100000:3.0:1789477243.073377:0:6692:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789477243.073468:0:6692:0:(client.c:2715:ptlrpc_set_wait()) set 0000000021be02de going to sleep for 11 seconds 00000040:00080000:3.0:1789477243.073787:0:6716:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1789477243.073791:0:6716:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x3:0x0] at index 1 of catalog [0x1:0x2:0x0] 00000020:00000080:3.0:1789477243.074367:0:6713:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1789477243.074378:0:6713:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1789477243.074410:0:6713:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:3.0:1789477243.074429:0:6713:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xafddb3c8f92814b3 00000100:00080000:3.0:1789477243.074437:0:6713:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1789477243.074446:0:6713:0:(import.c:625:import_select_connection()) lustre-OST0000-osc-MDT0000: import 00000000cbbb7c4a using connection 192.168.201.123@tcp/0@lo 00000100:00100000:3.0:1789477243.074472:0:6713:0:(import.c:827:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000041377b9 x1876402802530944/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1789477243.074532:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000041377b9 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3309:1876402802530944:0@lo:8: 00000100:00100000:1.0:1789477243.074603:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1789477243.074717:0:6713:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:3.0:1789477243.074774:0:6713:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789477243.074778:0:6713:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789477243.074779:0:6713:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-OST0000 add osc 00000020:01000000:3.0:1789477243.074782:0:6713:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789477243.074786:0:6713:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789477243.074787:0:6713:0:(obd_config.c:1563:class_process_config()) marker 16 (0x1) lustre sys.timeout 00000020:00000080:3.0:1789477243.074790:0:6713:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1789477243.074791:0:6713:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:3.0:1789477243.074811:0:6713:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000009fd7e63e pname:cluuid:pid:xid:nid:opc:job llog_process_th:07d5e05c-913f-419f-adbc-d3cf15e9cd51:6713:1876402802531072:0@lo:502: 00000100:00100000:3.0:1789477243.074858:0:6713:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789477243.074919:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802530944 00000100:00100000:2.0:1789477243.074927:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802530944 00000100:00100000:2.0:1789477243.074958:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789477243.074965:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000657dd38f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3309:x1876402802530944:12345-0@lo:8: 00010000:00020000:2.0:1789477243.074979:0:6694:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1789477243.075121:0:6713:0:(client.c:2715:ptlrpc_set_wait()) set 00000000af6cd08b going to sleep for 11 seconds 00000100:00100000:0.0:1789477243.075197:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802530816 00000100:00100000:0.0:1789477243.075201:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802530816 00000100:00100000:0.0:1789477243.075250:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802531072 00000100:00100000:0.0:1789477243.075254:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802531072 00000100:00100000:0.0:1789477243.075266:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1789477243.075271:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f7d6772f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07d5e05c-913f-419f-adbc-d3cf15e9cd51+11:6692:x1876402802530816:12345-0@lo:101: 00010000:00010000:0.0:1789477243.075282:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789477243.075297:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000006b55e165/0xafddb3c8f92814ba lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xafddb3c8f92814ac expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477243.075319:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000006b55e165/0xafddb3c8f92814ba lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xafddb3c8f92814ac expref: 12 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477243.075329:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000006b55e165/0xafddb3c8f92814ba lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xafddb3c8f92814ac expref: 12 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477243.075338:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000006b55e165, rc 0) 00000100:00100000:0.0:1789477243.075374:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f7d6772f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07d5e05c-913f-419f-adbc-d3cf15e9cd51+12:6692:x1876402802530816:12345-0@lo:101: Request processed in 103us (1998us total) trans 0 rc 0/0 00000100:00100000:0.0:1789477243.075381:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1789477243.075402:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1789477243.075408:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000004a84e1e5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07d5e05c-913f-419f-adbc-d3cf15e9cd51+11:6713:x1876402802531072:12345-0@lo:502: 00000100:00100000:0.0:1789477243.076505:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000004a84e1e5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07d5e05c-913f-419f-adbc-d3cf15e9cd51+11:6713:x1876402802531072:12345-0@lo:502: Request processed in 1093us (1643us total) trans 0 rc 0/0 00000100:00100000:3.0:1789477243.076614:0:6713:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000009fd7e63e pname:cluuid:pid:xid:nid:opc:job llog_process_th:07d5e05c-913f-419f-adbc-d3cf15e9cd51:6713:1876402802531072:0@lo:502: 00000020:01000000:3.0:1789477243.076649:0:6713:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789477243.076655:0:6713:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789477243.076657:0:6713:0:(obd_config.c:1563:class_process_config()) marker 16 (0x2) lustre sys.timeout 00000040:00080000:3.0:1789477243.076662:0:6713:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 25 count 25 00000100:00100000:0.0:1789477243.076811:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1789477243.076858:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000d6bb9e47 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3313:1876402802531200:0@lo:400: 00000100:00100000:0.0:1789477243.076889:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789477243.076951:0:6692:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000001ecd45c pname:cluuid:pid:xid:nid:opc:job mount.lustre:07d5e05c-913f-419f-adbc-d3cf15e9cd51:6692:1876402802530816:0@lo:101: 00010000:00010000:0.0:1789477243.076966:0:6692:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.123@tcp lock: 0000000078a540b8/0xafddb3c8f92814ac lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0xafddb3c8f92814ba expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477243.076988:0:6692:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.123@tcp lock: 0000000078a540b8/0xafddb3c8f92814ac lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0xafddb3c8f92814ba expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789477243.077075:0:6692:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000ff04b30c pname:cluuid:pid:xid:nid:opc:job mount.lustre:07d5e05c-913f-419f-adbc-d3cf15e9cd51:6692:1876402802531328:0@lo:501: 00000100:00100000:0.0:1789477243.077100:0:6692:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789477243.077119:0:6692:0:(client.c:2715:ptlrpc_set_wait()) set 00000000961ecad1 going to sleep for 11 seconds 00000100:00100000:3.0:1789477243.077173:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802531200 00000100:00100000:3.0:1789477243.077180:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802531200 00000100:00100000:3.0:1789477243.077241:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789477243.077248:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e9b11cc9 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1876402802531200:12345-0@lo:400: 00000100:00100000:3.0:1789477243.077288:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e9b11cc9 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1876402802531200:12345-0@lo:400: Request processed in 42us (399us total) trans 0 rc 0/0 00000100:00100000:3.0:1789477243.077295:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789477243.077313:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802531328 00000100:00100000:3.0:1789477243.077317:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802531328 00000100:00100000:3.0:1789477243.077337:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1789477243.077343:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e29894e9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07d5e05c-913f-419f-adbc-d3cf15e9cd51+11:6692:x1876402802531328:12345-0@lo:501: 00000100:00100000:3.0:1789477243.077540:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e29894e9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07d5e05c-913f-419f-adbc-d3cf15e9cd51+11:6692:x1876402802531328:12345-0@lo:501: Request processed in 198us (439us total) trans 0 rc -2/-2 00000100:00100000:3.0:1789477243.077547:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1789477243.077600:0:6692:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000ff04b30c pname:cluuid:pid:xid:nid:opc:job mount.lustre:07d5e05c-913f-419f-adbc-d3cf15e9cd51:6692:1876402802531328:0@lo:501: 10000000:01000000:3.0:1789477243.077615:0:6692:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.201.123@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:3.0:1789477243.077639:0:6692:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.201.123@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:3.0:1789477243.077644:0:6692:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.123@tcp lock: 0000000078a540b8/0xafddb3c8f92814ac lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0xafddb3c8f92814ba expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477243.077651:0:6692:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.123@tcp lock: 0000000078a540b8/0xafddb3c8f92814ac lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000400000000 nid: local remote: 0xafddb3c8f92814ba expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477243.077658:0:6692:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.123@tcp lock: 0000000078a540b8/0xafddb3c8f92814ac lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000400000000 nid: local remote: 0xafddb3c8f92814ba expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477243.077676:0:6692:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1789477243.077693:0:6692:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9d0d585fc800 10000000:01000000:3.0:1789477243.077698:0:6692:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1789477243.077703:0:6692:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff9d0d482499b8 10000000:01000000:3.0:1789477243.077710:0:6692:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:3.0:1789477243.077714:0:6692:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff9d0d482499b8 from 1 10000000:01000000:3.0:1789477243.077716:0:6692:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:3.0:1789477243.077739:0:6692:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.123@tcp lock: 0000000055b83ca3/0xafddb3c8f92814c1 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477243.077746:0:6692:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.123@tcp lock: 0000000055b83ca3/0xafddb3c8f92814c1 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477243.077755:0:6692:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.123@tcp lock: 0000000055b83ca3/0xafddb3c8f92814c1 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789477243.077767:0:6692:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000009fd7e63e pname:cluuid:pid:xid:nid:opc:job mount.lustre:07d5e05c-913f-419f-adbc-d3cf15e9cd51:6692:1876402802531456:0@lo:101: 00000100:00100000:3.0:1789477243.077795:0:6692:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789477243.077808:0:6692:0:(client.c:2715:ptlrpc_set_wait()) set 00000000ae2deddb going to sleep for 11 seconds 00010000:00010000:3.0:1789477243.077822:0:6710:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789477243.077828:0:6710:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.123@tcp lock: 0000000078a540b8/0xafddb3c8f92814ac lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x400000000 nid: local remote: 0xafddb3c8f92814ba expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477243.077834:0:6710:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000078a540b8 already unused, calling callback (0000000038babd70) 10000000:00010000:3.0:1789477243.077837:0:6710:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.123@tcp lock: 0000000078a540b8/0xafddb3c8f92814ac lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x400000000 nid: local remote: 0xafddb3c8f92814ba expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477243.077844:0:6710:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.123@tcp lock: 0000000078a540b8/0xafddb3c8f92814ac lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x8400000000 nid: local remote: 0xafddb3c8f92814ba expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789477243.077850:0:6710:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.123@tcp lock: 0000000078a540b8/0xafddb3c8f92814ac lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x9400000000 nid: local remote: 0xafddb3c8f92814ba expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789477243.077854:0:6710:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1789477243.077870:0:6710:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.123@tcp lock: 0000000078a540b8/0xafddb3c8f92814ac lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x4809400000020 nid: local remote: 0xafddb3c8f92814ba expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477243.077882:0:6710:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789477243.077900:0:6710:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.123@tcp lock: 0000000078a540b8/0xafddb3c8f92814ac lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x4809400000020 nid: local remote: 0xafddb3c8f92814ba expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477243.077907:0:6710:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.123@tcp lock: 0000000078a540b8/0xafddb3c8f92814ac lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x4809400000020 nid: local remote: 0xafddb3c8f92814ba expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477243.077919:0:6710:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789477243.077921:0:6710:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789477243.077922:0:6710:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789477243.077934:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000001ecd45c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:07d5e05c-913f-419f-adbc-d3cf15e9cd51:3310:1876402802531584:0@lo:103: 00000100:00100000:3.0:1789477243.077961:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789477243.077994:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802531584 00000100:00100000:3.0:1789477243.077997:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802531584 00000100:00100000:3.0:1789477243.078025:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789477243.078032:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000002933050f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:07d5e05c-913f-419f-adbc-d3cf15e9cd51+11:3310:x1876402802531584:12345-0@lo:103: 00010000:00010000:3.0:1789477243.078042:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789477243.078054:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000006b55e165/0xafddb3c8f92814ba lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xafddb3c8f92814ac expref: 11 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477243.078067:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789477243.078093:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000002933050f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:07d5e05c-913f-419f-adbc-d3cf15e9cd51+10:3310:x1876402802531584:12345-0@lo:103: Request processed in 63us (132us total) trans 0 rc 0/0 00000100:00100000:3.0:1789477243.078098:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789477243.078124:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000001ecd45c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:07d5e05c-913f-419f-adbc-d3cf15e9cd51:3310:1876402802531584:0@lo:103: 00000100:00100000:3.0:1789477243.078139:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802531456 00000100:00100000:3.0:1789477243.078142:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802531456 00000100:00100000:3.0:1789477243.078168:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1789477243.078174:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000008b32ac91 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07d5e05c-913f-419f-adbc-d3cf15e9cd51+10:6692:x1876402802531456:12345-0@lo:101: 00010000:00010000:3.0:1789477243.078181:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789477243.078205:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000dc728632/0xafddb3c8f92814c8 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xafddb3c8f92814c1 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477243.078221:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000dc728632/0xafddb3c8f92814c8 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xafddb3c8f92814c1 expref: 11 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477243.078229:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000dc728632/0xafddb3c8f92814c8 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xafddb3c8f92814c1 expref: 11 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477243.078235:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000dc728632, rc 0) 00000100:00100000:3.0:1789477243.078261:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000008b32ac91 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07d5e05c-913f-419f-adbc-d3cf15e9cd51+11:6692:x1876402802531456:12345-0@lo:101: Request processed in 88us (466us total) trans 0 rc 0/0 00000100:00100000:3.0:1789477243.078266:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1789477243.078298:0:6692:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000009fd7e63e pname:cluuid:pid:xid:nid:opc:job mount.lustre:07d5e05c-913f-419f-adbc-d3cf15e9cd51:6692:1876402802531456:0@lo:101: 00010000:00010000:3.0:1789477243.078307:0:6692:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.123@tcp lock: 0000000055b83ca3/0xafddb3c8f92814c1 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xafddb3c8f92814c8 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477243.078314:0:6692:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.123@tcp lock: 0000000055b83ca3/0xafddb3c8f92814c1 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xafddb3c8f92814c8 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789477243.078327:0:6692:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.123@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:3.0:1789477243.078330:0:6692:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.123@tcp lock: 0000000055b83ca3/0xafddb3c8f92814c1 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xafddb3c8f92814c8 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477243.078336:0:6692:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.123@tcp lock: 0000000055b83ca3/0xafddb3c8f92814c1 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xafddb3c8f92814c8 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789477243.078351:0:6692:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:3.0:1789477243.078355:0:6692:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1789477243.078359:0:6692:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:3.0:1789477243.078361:0:6692:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:3.0:1789477243.078373:0:6692:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.123@tcp lock: 000000002a5c7c2f/0xafddb3c8f92814cf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477243.078377:0:6692:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.123@tcp lock: 000000002a5c7c2f/0xafddb3c8f92814cf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477243.078383:0:6692:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.123@tcp lock: 000000002a5c7c2f/0xafddb3c8f92814cf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789477243.078392:0:6692:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000009fd7e63e pname:cluuid:pid:xid:nid:opc:job mount.lustre:07d5e05c-913f-419f-adbc-d3cf15e9cd51:6692:1876402802531712:0@lo:101: 00000100:00100000:3.0:1789477243.078416:0:6692:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789477243.078427:0:6692:0:(client.c:2715:ptlrpc_set_wait()) set 00000000ae2deddb going to sleep for 11 seconds 00000100:00100000:3.0:1789477243.078439:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802531712 00000100:00100000:3.0:1789477243.078442:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802531712 00000100:00100000:3.0:1789477243.078462:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1789477243.078467:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000089024b6e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07d5e05c-913f-419f-adbc-d3cf15e9cd51+11:6692:x1876402802531712:12345-0@lo:101: 00010000:00010000:3.0:1789477243.078474:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789477243.078480:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000779be659/0xafddb3c8f92814d6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xafddb3c8f92814cf expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477243.078491:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000779be659/0xafddb3c8f92814d6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xafddb3c8f92814cf expref: 12 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477243.078498:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000779be659/0xafddb3c8f92814d6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xafddb3c8f92814cf expref: 12 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477243.078510:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000779be659, rc 0) 00000100:00100000:3.0:1789477243.078536:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000089024b6e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07d5e05c-913f-419f-adbc-d3cf15e9cd51+12:6692:x1876402802531712:12345-0@lo:101: Request processed in 69us (120us total) trans 0 rc 0/0 00000100:00100000:3.0:1789477243.078542:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1789477243.078570:0:6692:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000009fd7e63e pname:cluuid:pid:xid:nid:opc:job mount.lustre:07d5e05c-913f-419f-adbc-d3cf15e9cd51:6692:1876402802531712:0@lo:101: 00010000:00010000:3.0:1789477243.078599:0:6692:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.123@tcp lock: 000000002a5c7c2f/0xafddb3c8f92814cf lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xafddb3c8f92814d6 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477243.078605:0:6692:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.123@tcp lock: 000000002a5c7c2f/0xafddb3c8f92814cf lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xafddb3c8f92814d6 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789477243.078660:0:6692:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000009fd7e63e pname:cluuid:pid:xid:nid:opc:job mount.lustre:07d5e05c-913f-419f-adbc-d3cf15e9cd51:6692:1876402802531840:0@lo:501: 00000100:00100000:3.0:1789477243.078683:0:6692:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789477243.078694:0:6692:0:(client.c:2715:ptlrpc_set_wait()) set 00000000ae2deddb going to sleep for 11 seconds 00000100:00100000:3.0:1789477243.078706:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802531840 00000100:00100000:3.0:1789477243.078710:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802531840 00000100:00100000:3.0:1789477243.078730:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1789477243.078734:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000003b3f842e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07d5e05c-913f-419f-adbc-d3cf15e9cd51+12:6692:x1876402802531840:12345-0@lo:501: 00000100:00100000:3.0:1789477243.078898:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000003b3f842e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07d5e05c-913f-419f-adbc-d3cf15e9cd51+12:6692:x1876402802531840:12345-0@lo:501: Request processed in 163us (214us total) trans 0 rc 0/0 00000100:00100000:3.0:1789477243.078904:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1789477243.078933:0:6692:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000009fd7e63e pname:cluuid:pid:xid:nid:opc:job mount.lustre:07d5e05c-913f-419f-adbc-d3cf15e9cd51:6692:1876402802531840:0@lo:501: 00000100:00100000:3.0:1789477243.078957:0:6692:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000009fd7e63e pname:cluuid:pid:xid:nid:opc:job mount.lustre:07d5e05c-913f-419f-adbc-d3cf15e9cd51:6692:1876402802531968:0@lo:503: 00000100:00100000:3.0:1789477243.078991:0:6692:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789477243.079003:0:6692:0:(client.c:2715:ptlrpc_set_wait()) set 00000000ba0c6b25 going to sleep for 11 seconds 00000100:00100000:3.0:1789477243.079025:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802531968 00000100:00100000:3.0:1789477243.079028:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802531968 00000100:00100000:3.0:1789477243.079046:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1789477243.079051:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000004f1e2bcc pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07d5e05c-913f-419f-adbc-d3cf15e9cd51+12:6692:x1876402802531968:12345-0@lo:503: 00000100:00100000:3.0:1789477243.079175:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000004f1e2bcc pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07d5e05c-913f-419f-adbc-d3cf15e9cd51+12:6692:x1876402802531968:12345-0@lo:503: Request processed in 124us (183us total) trans 0 rc 0/0 00000100:00100000:3.0:1789477243.079182:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1789477243.079231:0:6692:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000009fd7e63e pname:cluuid:pid:xid:nid:opc:job mount.lustre:07d5e05c-913f-419f-adbc-d3cf15e9cd51:6692:1876402802531968:0@lo:503: 00000040:00080000:3.0:1789477243.079468:0:6692:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1789477243.079529:0:6692:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000009fd7e63e pname:cluuid:pid:xid:nid:opc:job mount.lustre:07d5e05c-913f-419f-adbc-d3cf15e9cd51:6692:1876402802532096:0@lo:502: 00000100:00100000:3.0:1789477243.079562:0:6692:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789477243.079595:0:6692:0:(client.c:2715:ptlrpc_set_wait()) set 00000000ba0c6b25 going to sleep for 11 seconds 00000100:00100000:3.0:1789477243.079609:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802532096 00000100:00100000:3.0:1789477243.079613:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802532096 00000100:00100000:3.0:1789477243.079632:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1789477243.079637:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d51f2075 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07d5e05c-913f-419f-adbc-d3cf15e9cd51+12:6692:x1876402802532096:12345-0@lo:502: 00000100:00100000:3.0:1789477243.079754:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d51f2075 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07d5e05c-913f-419f-adbc-d3cf15e9cd51+12:6692:x1876402802532096:12345-0@lo:502: Request processed in 116us (191us total) trans 0 rc 0/0 00000100:00100000:3.0:1789477243.079760:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1789477243.079799:0:6692:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000009fd7e63e pname:cluuid:pid:xid:nid:opc:job mount.lustre:07d5e05c-913f-419f-adbc-d3cf15e9cd51:6692:1876402802532096:0@lo:502: 00000040:00080000:3.0:1789477243.080014:0:6692:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:3.0:1789477243.080058:0:6692:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:3.0:1789477243.080088:0:6692:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:3.0:1789477243.080140:0:6692:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:3.0:1789477243.080178:0:6692:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00010000:00080000:0.0:1789477243.080364:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000d6bb9e47 x1876402802531200/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789477259 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789477243.080377:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000d6bb9e47 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3313:1876402802531200:0@lo:400: 00000100:00100000:2.0:1789477243.080500:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000657dd38f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3309:x1876402802530944:12345-0@lo:8: Request processed in 5533us (5896us total) trans 0 rc -19/-19 00000100:00100000:2.0:1789477243.080519:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000020:01000000:2.0:1789477243.080545:0:5841:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 16-24 (rc=0) 10000000:01000000:2.0:1789477243.080561:0:5841:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.123@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:2.0:1789477243.080569:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.123@tcp lock: 0000000034bdbdb9/0xafddb3c8f9281490 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xafddb3c8f9281497 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477243.080589:0:5841:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.123@tcp lock: 0000000034bdbdb9/0xafddb3c8f9281490 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xafddb3c8f9281497 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789477243.080605:0:5841:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1789477243.080607:0:5841:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9d0d4444e800 from 1 10000000:01000000:2.0:1789477243.080610:0:5841:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1789477243.080634:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.123@tcp lock: 000000009f89a1db/0xafddb3c8f92814dd lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477243.080641:0:5841:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.123@tcp lock: 000000009f89a1db/0xafddb3c8f92814dd lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477243.080649:0:5841:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.123@tcp lock: 000000009f89a1db/0xafddb3c8f92814dd lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789477243.080662:0:5841:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000008bfb7c02 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07d5e05c-913f-419f-adbc-d3cf15e9cd51:5841:1876402802532224:0@lo:101: 00000100:00100000:2.0:1789477243.080689:0:5841:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789477243.080712:0:5841:0:(client.c:2715:ptlrpc_set_wait()) set 000000003d1158d3 going to sleep for 11 seconds 00000100:00080000:1.0:1789477243.081168:0:3309:0:(import.c:65:import_set_state_nolock()) 00000000cbbb7c4a lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1789477243.081175:0:3309:0:(import.c:1512:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1789477243.081179:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000041377b9 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3309:1876402802530944:0@lo:8: 00000100:00100000:2.0:1789477243.081302:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802532224 00000100:00100000:2.0:1789477243.081309:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802532224 00000100:00100000:2.0:1789477243.081347:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1789477243.081355:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d214b83e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07d5e05c-913f-419f-adbc-d3cf15e9cd51+12:5841:x1876402802532224:12345-0@lo:101: 00010000:00010000:2.0:1789477243.081367:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789477243.081380:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000062480330/0xafddb3c8f92814e4 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xafddb3c8f92814dd expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477243.081401:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000062480330/0xafddb3c8f92814e4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xafddb3c8f92814dd expref: 13 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477243.081409:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000062480330/0xafddb3c8f92814e4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xafddb3c8f92814dd expref: 13 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477243.081429:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000062480330, rc 0) 00000100:00100000:2.0:1789477243.081473:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d214b83e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07d5e05c-913f-419f-adbc-d3cf15e9cd51+13:5841:x1876402802532224:12345-0@lo:101: Request processed in 119us (783us total) trans 0 rc 0/0 00000100:00100000:2.0:1789477243.081479:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1789477243.081647:0:5841:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000008bfb7c02 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07d5e05c-913f-419f-adbc-d3cf15e9cd51:5841:1876402802532224:0@lo:101: 00010000:00010000:1.0:1789477243.081658:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.123@tcp lock: 000000009f89a1db/0xafddb3c8f92814dd lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xafddb3c8f92814e4 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477243.081666:0:5841:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.123@tcp lock: 000000009f89a1db/0xafddb3c8f92814dd lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xafddb3c8f92814e4 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789477243.081721:0:5841:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000fbedd680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07d5e05c-913f-419f-adbc-d3cf15e9cd51:5841:1876402802532352:0@lo:501: 00000100:00100000:1.0:1789477243.081748:0:5841:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789477243.081776:0:5841:0:(client.c:2715:ptlrpc_set_wait()) set 000000000f4ebcbf going to sleep for 11 seconds 00000100:00100000:0.0:1789477243.081821:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802532352 00000100:00100000:0.0:1789477243.081825:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802532352 00000100:00100000:0.0:1789477243.081843:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1789477243.081848:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000004bf3ce32 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:07d5e05c-913f-419f-adbc-d3cf15e9cd51+13:5841:x1876402802532352:12345-0@lo:501: 00000100:00100000:0.0:1789477243.082071:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000004bf3ce32 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:07d5e05c-913f-419f-adbc-d3cf15e9cd51+13:5841:x1876402802532352:12345-0@lo:501: Request processed in 222us (322us total) trans 0 rc 0/0 00000100:00100000:0.0:1789477243.082078:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1789477243.082168:0:5841:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000fbedd680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07d5e05c-913f-419f-adbc-d3cf15e9cd51:5841:1876402802532352:0@lo:501: 00000100:00100000:1.0:1789477243.082203:0:5841:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000fbedd680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07d5e05c-913f-419f-adbc-d3cf15e9cd51:5841:1876402802532480:0@lo:503: 00000100:00100000:1.0:1789477243.082243:0:5841:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789477243.082263:0:5841:0:(client.c:2715:ptlrpc_set_wait()) set 000000000f4ebcbf going to sleep for 11 seconds 00000100:00100000:0.0:1789477243.082302:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802532480 00000100:00100000:0.0:1789477243.082307:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802532480 00000100:00100000:0.0:1789477243.082333:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1789477243.082339:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000fc47a869 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07d5e05c-913f-419f-adbc-d3cf15e9cd51+13:5841:x1876402802532480:12345-0@lo:503: 00000100:00100000:0.0:1789477243.082617:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000fc47a869 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07d5e05c-913f-419f-adbc-d3cf15e9cd51+13:5841:x1876402802532480:12345-0@lo:503: Request processed in 278us (374us total) trans 0 rc 0/0 00000100:00100000:0.0:1789477243.082623:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1789477243.082755:0:5841:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000fbedd680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07d5e05c-913f-419f-adbc-d3cf15e9cd51:5841:1876402802532480:0@lo:503: 00000100:00100000:1.0:1789477243.083121:0:6718:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000fbedd680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:07d5e05c-913f-419f-adbc-d3cf15e9cd51:6718:1876402802532608:0@lo:502: 00000100:00100000:1.0:1789477243.083154:0:6718:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789477243.083231:0:6718:0:(client.c:2715:ptlrpc_set_wait()) set 0000000010f4b4c7 going to sleep for 11 seconds 00000040:00080000:3.0:1789477243.083366:0:6692:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:3.0:1789477243.083397:0:6692:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000009fd7e63e pname:cluuid:pid:xid:nid:opc:job mount.lustre:07d5e05c-913f-419f-adbc-d3cf15e9cd51:6692:1876402802532736:0@lo:502: 00000100:00100000:3.0:1789477243.083439:0:6692:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789477243.083517:0:6692:0:(client.c:2715:ptlrpc_set_wait()) set 00000000ba0c6b25 going to sleep for 11 seconds 00000100:00100000:2.0:1789477243.083693:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802532608 00000100:00100000:2.0:1789477243.083700:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802532608 00000100:00100000:3.0:1789477243.083784:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802532736 00000100:00100000:3.0:1789477243.083788:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802532736 00000100:00100000:3.0:1789477243.083801:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1789477243.083806:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e885ed68 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07d5e05c-913f-419f-adbc-d3cf15e9cd51+14:6718:x1876402802532608:12345-0@lo:502: 00000100:00100000:3.0:1789477243.083991:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e885ed68 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07d5e05c-913f-419f-adbc-d3cf15e9cd51+14:6718:x1876402802532608:12345-0@lo:502: Request processed in 184us (836us total) trans 0 rc 0/0 00000100:00100000:3.0:1789477243.083998:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1789477243.084028:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1789477243.084034:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000028ca8e9f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07d5e05c-913f-419f-adbc-d3cf15e9cd51+13:6692:x1876402802532736:12345-0@lo:502: 00000100:00100000:3.0:1789477243.084165:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000028ca8e9f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07d5e05c-913f-419f-adbc-d3cf15e9cd51+13:6692:x1876402802532736:12345-0@lo:502: Request processed in 131us (725us total) trans 0 rc 0/0 00000100:00100000:3.0:1789477243.084171:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1789477243.084221:0:6692:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000009fd7e63e pname:cluuid:pid:xid:nid:opc:job mount.lustre:07d5e05c-913f-419f-adbc-d3cf15e9cd51:6692:1876402802532736:0@lo:502: 00000040:00080000:3.0:1789477243.084328:0:6692:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:3.0:1789477243.084337:0:6692:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 7 count 8 00000100:00100000:2.0:1789477243.084833:0:6718:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000fbedd680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:07d5e05c-913f-419f-adbc-d3cf15e9cd51:6718:1876402802532608:0@lo:502: 00000020:01000000:2.0:1789477243.084857:0:6718:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789477243.084866:0:6718:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789477243.084868:0:6718:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1789477243.084875:0:6718:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9d0d4444e800 00000020:00000080:2.0:1789477243.084877:0:6718:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1789477243.084921:0:6718:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d7bddc000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:07d5e05c-913f-419f-adbc-d3cf15e9cd51:6718:1876402802532864:0@lo:502: 00000100:00100000:2.0:1789477243.084960:0:6718:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789477243.084984:0:6718:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d0d50ac93c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789477243.085032:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802532864 00000100:00100000:3.0:1789477243.085037:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802532864 00000100:00100000:3.0:1789477243.085073:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1789477243.085079:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d4e676050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07d5e05c-913f-419f-adbc-d3cf15e9cd51+13:6718:x1876402802532864:12345-0@lo:502: 00000100:00100000:3.0:1789477243.085238:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d4e676050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07d5e05c-913f-419f-adbc-d3cf15e9cd51+13:6718:x1876402802532864:12345-0@lo:502: Request processed in 146us (264us total) trans 0 rc 0/0 00000100:00100000:3.0:1789477243.085245:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000020:01000000:3.0:1789477243.085341:0:6719:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1789477243.085347:0:6719:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-ost1/ost1 00000020:00000080:3.0:1789477243.085352:0:6719:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789477243.085359:0:6719:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-OST0000 add ost 00000020:00000080:3.0:1789477243.085364:0:6719:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1789477243.085380:0:6719:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff9d0d5847b370) 00000020:00000080:3.0:1789477243.085399:0:6719:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type obdfilter with refcount 2 00000020:00000080:3.0:1789477243.085404:0:6719:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1789477243.085463:0:6719:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9d0d585fc800 from lustre-OST0000, refs=2 00080000:01000000:3.0:1789477243.085470:0:6719:0:(osd_handler.c:1564:osd_obd_connect()) connect #1 00000020:00000080:3.0:1789477243.085485:0:6719:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xafddb3c8f92814f2 00000100:00100000:2.0:1789477243.085662:0:6718:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d7bddc000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:07d5e05c-913f-419f-adbc-d3cf15e9cd51:6718:1876402802532864:0@lo:502: 00000020:01000000:2.0:1789477243.085681:0:6718:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789477243.085685:0:6718:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789477243.085686:0:6718:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:2.0:1789477243.085690:0:6718:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 00000020:01000000:1.0:1789477243.087013:0:5841:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:1.0:1789477243.087037:0:5841:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.123@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1789477243.087047:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.123@tcp lock: ffff9d0d59d6be00/0xafddb3c8f92814dd lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xafddb3c8f92814e4 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477243.087058:0:5841:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.123@tcp lock: ffff9d0d59d6be00/0xafddb3c8f92814dd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xafddb3c8f92814e4 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789477243.087067:0:5841:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:1.0:1789477243.087070:0:5841:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff9d0d482499b8 from 1 10000000:01000000:1.0:1789477243.087072:0:5841:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1789477243.087105:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.123@tcp lock: ffff9d0d41647400/0xafddb3c8f92814f9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477243.087112:0:5841:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.123@tcp lock: ffff9d0d41647400/0xafddb3c8f92814f9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477243.087136:0:5841:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.123@tcp lock: ffff9d0d41647400/0xafddb3c8f92814f9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789477243.087153:0:5841:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d7f739c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07d5e05c-913f-419f-adbc-d3cf15e9cd51:5841:1876402802532992:0@lo:101: 00000100:00100000:1.0:1789477243.087223:0:5841:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789477243.087261:0:5841:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d0d44531600 going to sleep for 11 seconds 00000100:00100000:2.0:1789477243.087374:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802532992 00000100:00100000:2.0:1789477243.087381:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802532992 00000100:00100000:2.0:1789477243.087417:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1789477243.087433:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d4e675c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07d5e05c-913f-419f-adbc-d3cf15e9cd51+13:5841:x1876402802532992:12345-0@lo:101: 00010000:00010000:2.0:1789477243.087445:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789477243.087456:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d0d59d6a000/0xafddb3c8f9281500 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xafddb3c8f92814f9 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477243.087502:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d0d59d6a000/0xafddb3c8f9281500 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xafddb3c8f92814f9 expref: 14 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477243.087571:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d0d59d6a000/0xafddb3c8f9281500 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xafddb3c8f92814f9 expref: 14 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477243.087595:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d0d59d6a000, rc 0) 00000100:00100000:2.0:1789477243.087633:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d4e675c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07d5e05c-913f-419f-adbc-d3cf15e9cd51+14:5841:x1876402802532992:12345-0@lo:101: Request processed in 202us (411us total) trans 0 rc 0/0 00000100:00100000:2.0:1789477243.087639:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1789477243.087674:0:5841:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d7f739c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07d5e05c-913f-419f-adbc-d3cf15e9cd51:5841:1876402802532992:0@lo:101: 00010000:00010000:2.0:1789477243.087686:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.123@tcp lock: ffff9d0d41647400/0xafddb3c8f92814f9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xafddb3c8f9281500 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477243.087694:0:5841:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.123@tcp lock: ffff9d0d41647400/0xafddb3c8f92814f9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xafddb3c8f9281500 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789477243.087738:0:5841:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d7bddc000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07d5e05c-913f-419f-adbc-d3cf15e9cd51:5841:1876402802533120:0@lo:501: 00000100:00100000:2.0:1789477243.087759:0:5841:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789477243.087770:0:5841:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d0d50ac99c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789477243.087780:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802533120 00000100:00100000:2.0:1789477243.087783:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802533120 00000100:00100000:2.0:1789477243.087797:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1789477243.087802:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d4e677c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07d5e05c-913f-419f-adbc-d3cf15e9cd51+14:5841:x1876402802533120:12345-0@lo:501: 00000100:00100000:2.0:1789477243.088008:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d4e677c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07d5e05c-913f-419f-adbc-d3cf15e9cd51+14:5841:x1876402802533120:12345-0@lo:501: Request processed in 205us (247us total) trans 0 rc -2/-2 00000100:00100000:2.0:1789477243.088015:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1789477243.088057:0:5841:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d7bddc000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07d5e05c-913f-419f-adbc-d3cf15e9cd51:5841:1876402802533120:0@lo:501: 10000000:01000000:2.0:1789477243.088074:0:5841:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.123@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1789477243.088080:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.123@tcp lock: ffff9d0d41647400/0xafddb3c8f92814f9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xafddb3c8f9281500 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477243.088087:0:5841:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.123@tcp lock: ffff9d0d41647400/0xafddb3c8f92814f9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xafddb3c8f9281500 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477243.094947:0:6719:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-2 is initialized 00000001:02000400:3.0:1789477243.095300:0:6719:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0000: new disk, initializing 00000001:00000004:3.0:1789477243.099362:0:6719:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 0 40000000:02000000:3.0:1789477243.099843:0:6719:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0000: No data found on store. Initialize space. 00080000:10000000:3.0:1789477243.108315:0:6719:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/8/3) registered 00080000:10000000:3.0:1789477243.108849:0:6719:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000020:00000080:0.0:1789477243.110480:0:6719:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:0.0:1789477243.110491:0:6719:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789477243.110503:0:6719:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789477243.110506:0:6719:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-OST0000 add ost 00000020:01000000:0.0:1789477243.110700:0:6719:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789477243.110706:0:6719:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789477243.110708:0:6719:0:(obd_config.c:1563:class_process_config()) marker 14 (0x1) lustre sys.timeout 00000020:00000080:0.0:1789477243.110711:0:6719:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1789477243.110713:0:6719:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1789477243.110769:0:6719:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789477243.110773:0:6719:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789477243.110775:0:6719:0:(obd_config.c:1563:class_process_config()) marker 14 (0x2) lustre sys.timeout 00000040:00080000:0.0:1789477243.110778:0:6719:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:3.0:1789477243.116766:0:6692:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-7 (rc=0) 10000000:01000000:3.0:1789477243.116828:0:6692:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.123@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:3.0:1789477243.116971:0:6692:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.123@tcp lock: ffff9d0d49ecb800/0xafddb3c8f92814cf lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xafddb3c8f92814d6 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477243.116985:0:6692:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.123@tcp lock: ffff9d0d49ecb800/0xafddb3c8f92814cf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xafddb3c8f92814d6 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789477243.116994:0:6692:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9d0d585fc800 from 1 10000000:01000000:3.0:1789477243.116997:0:6692:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1789477243.117041:0:6692:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.123@tcp lock: ffff9d0d49ecac00/0xafddb3c8f9281507 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477243.117049:0:6692:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.123@tcp lock: ffff9d0d49ecac00/0xafddb3c8f9281507 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477243.117060:0:6692:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.123@tcp lock: ffff9d0d49ecac00/0xafddb3c8f9281507 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789477243.117099:0:6692:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d58246d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:07d5e05c-913f-419f-adbc-d3cf15e9cd51:6692:1876402802533248:0@lo:101: 00000100:00100000:3.0:1789477243.117211:0:6692:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789477243.117274:0:6692:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d0d453069c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789477243.117329:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802533248 00000100:00100000:2.0:1789477243.117339:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802533248 00000100:00100000:2.0:1789477243.117403:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1789477243.117414:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d4e677450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07d5e05c-913f-419f-adbc-d3cf15e9cd51+14:6692:x1876402802533248:12345-0@lo:101: 00010000:00010000:2.0:1789477243.117430:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789477243.117445:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d0d59d6a800/0xafddb3c8f928150e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xafddb3c8f9281507 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477243.117472:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d0d59d6a800/0xafddb3c8f928150e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xafddb3c8f9281507 expref: 15 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477243.117482:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d0d59d6a800/0xafddb3c8f928150e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xafddb3c8f9281507 expref: 15 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477243.117491:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d0d59d6a800, rc 0) 00000100:00100000:2.0:1789477243.117551:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d4e677450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07d5e05c-913f-419f-adbc-d3cf15e9cd51+15:6692:x1876402802533248:12345-0@lo:101: Request processed in 138us (340us total) trans 0 rc 0/0 00000100:00100000:2.0:1789477243.117558:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1789477243.117784:0:6692:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d58246d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:07d5e05c-913f-419f-adbc-d3cf15e9cd51:6692:1876402802533248:0@lo:101: 00010000:00010000:3.0:1789477243.117798:0:6692:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.123@tcp lock: ffff9d0d49ecac00/0xafddb3c8f9281507 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xafddb3c8f928150e expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477243.117807:0:6692:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.123@tcp lock: ffff9d0d49ecac00/0xafddb3c8f9281507 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xafddb3c8f928150e expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789477243.117908:0:6692:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d58246d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:07d5e05c-913f-419f-adbc-d3cf15e9cd51:6692:1876402802533376:0@lo:501: 00000100:00100000:3.0:1789477243.117933:0:6692:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789477243.117960:0:6692:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d0d453069c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789477243.118030:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802533376 00000100:00100000:0.0:1789477243.118034:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802533376 00000100:00100000:0.0:1789477243.118065:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1789477243.118072:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d4e675850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:07d5e05c-913f-419f-adbc-d3cf15e9cd51+15:6692:x1876402802533376:12345-0@lo:501: 00000100:00100000:0.0:1789477243.118289:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d4e675850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:07d5e05c-913f-419f-adbc-d3cf15e9cd51+15:6692:x1876402802533376:12345-0@lo:501: Request processed in 217us (354us total) trans 0 rc 0/0 00000100:00100000:0.0:1789477243.118296:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1789477243.118370:0:6692:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d58246d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:07d5e05c-913f-419f-adbc-d3cf15e9cd51:6692:1876402802533376:0@lo:501: 00000100:00100000:3.0:1789477243.118395:0:6692:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d58246d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:07d5e05c-913f-419f-adbc-d3cf15e9cd51:6692:1876402802533504:0@lo:503: 00000100:00100000:3.0:1789477243.118432:0:6692:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789477243.118450:0:6692:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d0d453069c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789477243.118501:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802533504 00000100:00100000:0.0:1789477243.118505:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802533504 00000100:00100000:0.0:1789477243.118537:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1789477243.118543:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d4e675050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:07d5e05c-913f-419f-adbc-d3cf15e9cd51+15:6692:x1876402802533504:12345-0@lo:503: 00000100:00100000:0.0:1789477243.118695:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d4e675050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:07d5e05c-913f-419f-adbc-d3cf15e9cd51+15:6692:x1876402802533504:12345-0@lo:503: Request processed in 151us (262us total) trans 0 rc 0/0 00000100:00100000:0.0:1789477243.118702:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1789477243.118831:0:6692:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d58246d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:07d5e05c-913f-419f-adbc-d3cf15e9cd51:6692:1876402802533504:0@lo:503: 00000040:00080000:3.0:1789477243.119085:0:6692:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1789477243.119155:0:6692:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d58246d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:07d5e05c-913f-419f-adbc-d3cf15e9cd51:6692:1876402802533632:0@lo:502: 00000100:00100000:3.0:1789477243.119198:0:6692:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789477243.119225:0:6692:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d0d50a28d80 going to sleep for 11 seconds 00000100:00100000:0.0:1789477243.119530:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802533632 00000100:00100000:0.0:1789477243.119535:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802533632 00000100:00100000:0.0:1789477243.119566:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1789477243.119573:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d4e674850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:07d5e05c-913f-419f-adbc-d3cf15e9cd51+15:6692:x1876402802533632:12345-0@lo:502: 00000100:00100000:0.0:1789477243.119740:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d4e674850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:07d5e05c-913f-419f-adbc-d3cf15e9cd51+15:6692:x1876402802533632:12345-0@lo:502: Request processed in 168us (552us total) trans 0 rc 0/0 00000100:00100000:0.0:1789477243.119753:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1789477243.119909:0:6692:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d58246d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:07d5e05c-913f-419f-adbc-d3cf15e9cd51:6692:1876402802533632:0@lo:502: 00000040:00080000:3.0:1789477243.120153:0:6692:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:3.0:1789477243.120220:0:6692:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:3.0:1789477243.120246:0:6692:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d58246d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:07d5e05c-913f-419f-adbc-d3cf15e9cd51:6692:1876402802533760:0@lo:502: 00000100:00100000:3.0:1789477243.120283:0:6692:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789477243.120311:0:6692:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d0d453069c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789477243.120361:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802533760 00000100:00100000:0.0:1789477243.120365:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802533760 00000100:00100000:0.0:1789477243.120398:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1789477243.120405:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d4e676850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:07d5e05c-913f-419f-adbc-d3cf15e9cd51+15:6692:x1876402802533760:12345-0@lo:502: 00000100:00100000:0.0:1789477243.120758:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d4e676850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:07d5e05c-913f-419f-adbc-d3cf15e9cd51+15:6692:x1876402802533760:12345-0@lo:502: Request processed in 352us (473us total) trans 0 rc 0/0 00000100:00100000:0.0:1789477243.120765:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1789477243.126416:0:6692:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d58246d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:07d5e05c-913f-419f-adbc-d3cf15e9cd51:6692:1876402802533760:0@lo:502: 00000040:00080000:2.0:1789477243.126660:0:6692:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:2.0:1789477243.126693:0:6692:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:1.0:1789477243.127274:0:6723:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789477243.127284:0:6723:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789477243.127286:0:6723:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1789477243.127292:0:6723:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9d0d585fc800 00000020:00000080:1.0:1789477243.127294:0:6723:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1789477243.127315:0:6723:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789477243.127318:0:6723:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789477243.127319:0:6723:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:1.0:1789477243.127322:0:6723:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:2.0:1789477243.127708:0:6692:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:2.0:1789477243.127727:0:6692:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.123@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1789477243.127749:0:6692:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.123@tcp lock: ffff9d0d49ecac00/0xafddb3c8f9281507 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xafddb3c8f928150e expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477243.127762:0:6692:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.123@tcp lock: ffff9d0d49ecac00/0xafddb3c8f9281507 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xafddb3c8f928150e expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789477243.127805:0:6692:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1789477243.127808:0:6692:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9d0d585fc800 10000000:01000000:2.0:1789477243.127811:0:6692:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9d0d585fc800 10000000:01000000:2.0:1789477243.127815:0:6692:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1789477243.127821:0:6692:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9d0d585fc800 from 1 10000000:01000000:2.0:1789477243.127824:0:6692:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1789477243.127859:0:6692:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.123@tcp lock: ffff9d0d59d6ae00/0xafddb3c8f9281515 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477243.127868:0:6692:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.123@tcp lock: ffff9d0d59d6ae00/0xafddb3c8f9281515 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477243.127880:0:6692:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.123@tcp lock: ffff9d0d59d6ae00/0xafddb3c8f9281515 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789477243.127900:0:6692:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d7bddc000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:07d5e05c-913f-419f-adbc-d3cf15e9cd51:6692:1876402802533888:0@lo:101: 00000100:00100000:2.0:1789477243.127964:0:6692:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789477243.128007:0:6692:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d0d473446c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789477243.128080:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802533888 00000100:00100000:3.0:1789477243.128088:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802533888 00000100:00100000:3.0:1789477243.128136:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1789477243.128146:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d4e674c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07d5e05c-913f-419f-adbc-d3cf15e9cd51+15:6692:x1876402802533888:12345-0@lo:101: 00010000:00010000:3.0:1789477243.128160:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789477243.128174:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d0d49eca400/0xafddb3c8f928151c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xafddb3c8f9281515 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477243.128207:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d0d49eca400/0xafddb3c8f928151c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xafddb3c8f9281515 expref: 16 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477243.128219:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d0d49eca400/0xafddb3c8f928151c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xafddb3c8f9281515 expref: 16 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477243.128228:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d0d49eca400, rc 0) 00000100:00100000:3.0:1789477243.128273:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d4e674c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07d5e05c-913f-419f-adbc-d3cf15e9cd51+16:6692:x1876402802533888:12345-0@lo:101: Request processed in 128us (308us total) trans 0 rc 0/0 00000100:00100000:3.0:1789477243.128280:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1789477243.128349:0:6692:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d7bddc000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:07d5e05c-913f-419f-adbc-d3cf15e9cd51:6692:1876402802533888:0@lo:101: 00010000:00010000:1.0:1789477243.128362:0:6692:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.123@tcp lock: ffff9d0d59d6ae00/0xafddb3c8f9281515 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xafddb3c8f928151c expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477243.128371:0:6692:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.123@tcp lock: ffff9d0d59d6ae00/0xafddb3c8f9281515 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xafddb3c8f928151c expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789477243.128442:0:6692:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d7f73aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:07d5e05c-913f-419f-adbc-d3cf15e9cd51:6692:1876402802534016:0@lo:501: 00000100:00100000:1.0:1789477243.128470:0:6692:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789477243.128486:0:6692:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d0d44531cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1789477243.128663:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802534016 00000100:00100000:2.0:1789477243.128668:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802534016 00000100:00100000:2.0:1789477243.128701:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1789477243.128708:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d4e674450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07d5e05c-913f-419f-adbc-d3cf15e9cd51+16:6692:x1876402802534016:12345-0@lo:501: 00000100:00100000:2.0:1789477243.128973:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d4e674450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07d5e05c-913f-419f-adbc-d3cf15e9cd51+16:6692:x1876402802534016:12345-0@lo:501: Request processed in 265us (502us total) trans 0 rc 0/0 00000100:00100000:2.0:1789477243.128981:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1789477243.129127:0:6692:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d7f73aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:07d5e05c-913f-419f-adbc-d3cf15e9cd51:6692:1876402802534016:0@lo:501: 00000100:00100000:1.0:1789477243.129156:0:6692:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d7f73aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:07d5e05c-913f-419f-adbc-d3cf15e9cd51:6692:1876402802534144:0@lo:503: 00000100:00100000:1.0:1789477243.129209:0:6692:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789477243.129264:0:6692:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d0d44531cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1789477243.129294:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802534144 00000100:00100000:2.0:1789477243.129298:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802534144 00000100:00100000:2.0:1789477243.129358:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1789477243.129366:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d48461050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07d5e05c-913f-419f-adbc-d3cf15e9cd51+16:6692:x1876402802534144:12345-0@lo:503: 00000100:00100000:2.0:1789477243.129546:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d48461050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07d5e05c-913f-419f-adbc-d3cf15e9cd51+16:6692:x1876402802534144:12345-0@lo:503: Request processed in 180us (335us total) trans 0 rc 0/0 00000100:00100000:2.0:1789477243.129552:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1789477243.129738:0:6692:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d7f73aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:07d5e05c-913f-419f-adbc-d3cf15e9cd51:6692:1876402802534144:0@lo:503: 00000040:00080000:1.0:1789477243.130012:0:6692:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1789477243.130063:0:6692:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d7f73aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:07d5e05c-913f-419f-adbc-d3cf15e9cd51:6692:1876402802534272:0@lo:502: 00000100:00100000:1.0:1789477243.130098:0:6692:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789477243.130275:0:6692:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d0d44531cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1789477243.130345:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802534272 00000100:00100000:3.0:1789477243.130350:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802534272 00000100:00100000:3.0:1789477243.130375:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1789477243.130383:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d48460850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07d5e05c-913f-419f-adbc-d3cf15e9cd51+16:6692:x1876402802534272:12345-0@lo:502: 00000100:00100000:3.0:1789477243.130714:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d48460850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07d5e05c-913f-419f-adbc-d3cf15e9cd51+16:6692:x1876402802534272:12345-0@lo:502: Request processed in 331us (614us total) trans 0 rc 0/0 00000100:00100000:3.0:1789477243.130722:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1789477243.130816:0:6692:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d7f73aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:07d5e05c-913f-419f-adbc-d3cf15e9cd51:6692:1876402802534272:0@lo:502: 00000040:00080000:1.0:1789477243.131055:0:6692:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:1.0:1789477243.131099:0:6692:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:1.0:1789477243.131129:0:6692:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:1.0:1789477243.131172:0:6692:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:1.0:1789477243.131221:0:6692:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:1.0:1789477243.131279:0:6692:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:1.0:1789477243.131314:0:6692:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:1.0:1789477243.131346:0:6692:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:1.0:1789477243.131390:0:6692:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:1.0:1789477243.131425:0:6692:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:1.0:1789477243.131456:0:6692:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:1.0:1789477243.131497:0:6692:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:1.0:1789477243.131629:0:6692:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:1.0:1789477243.131664:0:6692:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:1.0:1789477243.131710:0:6692:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:1.0:1789477243.131748:0:6692:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:1.0:1789477243.131781:0:6692:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:1.0:1789477243.131834:0:6692:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:1.0:1789477243.131867:0:6692:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:1.0:1789477243.131893:0:6692:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:1.0:1789477243.131928:0:6692:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:1.0:1789477243.131969:0:6692:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:1.0:1789477243.132011:0:6692:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:1.0:1789477243.132055:0:6692:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:1.0:1789477243.132087:0:6692:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 128 off12440 00000040:00080000:1.0:1789477243.132115:0:6692:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12664 00000040:00080000:1.0:1789477243.132157:0:6692:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12888 00000040:00080000:1.0:1789477243.132204:0:6692:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off12968 00000100:00100000:1.0:1789477243.132245:0:6692:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d7f73aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:07d5e05c-913f-419f-adbc-d3cf15e9cd51:6692:1876402802534400:0@lo:502: 00000100:00100000:1.0:1789477243.132301:0:6692:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789477243.132329:0:6692:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d0d44531cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1789477243.132464:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802534400 00000100:00100000:3.0:1789477243.132470:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802534400 00000100:00100000:3.0:1789477243.132505:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1789477243.132524:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d48462850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07d5e05c-913f-419f-adbc-d3cf15e9cd51+16:6692:x1876402802534400:12345-0@lo:502: 00000100:00100000:3.0:1789477243.132726:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d48462850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07d5e05c-913f-419f-adbc-d3cf15e9cd51+16:6692:x1876402802534400:12345-0@lo:502: Request processed in 203us (424us total) trans 0 rc 0/0 00000100:00100000:3.0:1789477243.132733:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1789477243.132890:0:6692:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d7f73aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:07d5e05c-913f-419f-adbc-d3cf15e9cd51:6692:1876402802534400:0@lo:502: 00000040:00080000:1.0:1789477243.132953:0:6692:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13192 00000040:00080000:1.0:1789477243.132961:0:6692:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 29 count 30 00000020:01000004:2.0:1789477243.134158:0:6724:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:2.0:1789477243.134175:0:6724:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff9d0d50b80000) 00000020:00000080:2.0:1789477243.134208:0:6724:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type lwp with refcount 2 00000020:01000004:2.0:1789477243.134301:0:6724:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9d0d585fc800 from lustre-OST0000, refs=3 00000020:01000004:2.0:1789477243.134305:0:6724:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9d0d585fc800 from lustre-OST0000, refs=3 00000020:01000004:2.0:1789477243.134308:0:6724:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9d0d585fc800 3 00010000:00080000:2.0:1789477243.134341:0:6724:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9d0d7fafc000@lustre-MDT0000-lwp-OST0000: add connection 192.168.201.123@tcp at head 00010000:00010000:2.0:1789477243.136995:0:6724:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-3 is initialized 00000020:00000080:2.0:1789477243.137211:0:6724:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:2.0:1789477243.137249:0:6724:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1789477243.137270:0:6724:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0xafddb3c8f928152a 00000100:00080000:2.0:1789477243.137282:0:6724:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1789477243.137292:0:6724:0:(import.c:625:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9d0d7fafc000 using connection 192.168.201.123@tcp/0@lo 00000100:00100000:2.0:1789477243.137331:0:6724:0:(import.c:827:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9d0d7bddd880 x1876402802534528/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1789477243.137387:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d7bddd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3309:1876402802534528:0@lo:38: 00000100:00100000:1.0:1789477243.137456:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1789477243.141321:0:6724:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000040:00080000:3.0:1789477243.142009:0:6724:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000100:00100000:1.0:1789477243.142306:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802534528 00000100:00100000:1.0:1789477243.142318:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802534528 00000100:00100000:1.0:1789477243.142360:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789477243.142368:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d7f73aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3309:x1876402802534528:12345-0@lo:38: 00010000:00080000:1.0:1789477243.142397:0:5845:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 188 last 0 00000020:00000080:1.0:1789477243.142445:0:5845:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0xafddb3c8f9281531 00000004:00100000:1.0:1789477243.142463:0:5845:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1789477243.142496:0:5845:0:(import.c:65:import_set_state_nolock()) ffff9d0d6ecf5800 : changing import state from RECOVER to FULL 00000020:01000000:2.0:1789477243.142629:0:6692:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-29 (rc=0) 10000000:01000000:2.0:1789477243.142660:0:6692:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.123@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1789477243.142677:0:6692:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.123@tcp lock: ffff9d0d59d6ae00/0xafddb3c8f9281515 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xafddb3c8f928151c expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477243.142689:0:6692:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.123@tcp lock: ffff9d0d59d6ae00/0xafddb3c8f9281515 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xafddb3c8f928151c expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1789477243.142732:0:6692:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1789477243.142735:0:6692:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1789477243.142736:0:6692:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789477243.142737:0:6692:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789477243.142738:0:6692:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789477243.142740:0:6692:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789477243.142742:0:6692:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1789477243.142743:0:6692:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1789477243.142745:0:6692:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1789477243.142746:0:6692:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789477243.142747:0:6692:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1789477243.142751:0:6692:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020062 00000020:01000004:2.0:1789477243.142753:0:6692:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1789477243.142755:0:6692:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1789477243.142756:0:6692:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789477243.142757:0:6692:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789477243.142758:0:6692:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789477243.142759:0:6692:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789477243.142759:0:6692:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1789477243.142760:0:6692:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1789477243.142761:0:6692:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1789477243.142762:0:6692:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789477243.142763:0:6692:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1789477243.142783:0:6692:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:2.0:1789477243.142798:0:6692:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d7bddf800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:07d5e05c-913f-419f-adbc-d3cf15e9cd51:6692:1876402802534656:0@lo:253: 00000100:00100000:2.0:1789477243.142860:0:6692:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789477243.142891:0:6692:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d0d457a2000 going to sleep for 11 seconds 00000100:00100000:3.0:1789477243.142988:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802534656 00000100:00100000:3.0:1789477243.142993:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802534656 00000100:00100000:3.0:1789477243.143029:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1789477243.143036:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d48460c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07d5e05c-913f-419f-adbc-d3cf15e9cd51+16:6692:x1876402802534656:12345-0@lo:253: 20000000:01000000:3.0:1789477243.143054:0:5838:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:3.0:1789477243.143068:0:5838:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:1.0:1789477243.143995:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d7f73aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1876402802534528:12345-0@lo:38: Request processed in 1623us (6536us total) trans 0 rc 0/0 00000100:00100000:1.0:1789477243.144006:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:1.0:1789477243.144067:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9d0d7bddd880 x1876402802534528/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789477253 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789477243.144079:0:3309:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1789477243.144104:0:3309:0:(import.c:1133:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 1 00000100:00080000:1.0:1789477243.144114:0:3309:0:(import.c:957:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:1.0:1789477243.144119:0:3309:0:(import.c:1214:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1789477243.144122:0:3309:0:(import.c:65:import_set_state_nolock()) ffff9d0d7fafc000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1789477243.144128:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d7bddd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3309:1876402802534528:0@lo:38: 20000000:01000000:1.0:1789477243.177080:0:5838:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1789477243.177102:0:5838:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:3.0:1789477243.177611:0:5861:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1789477243.177617:0:5861:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1789477243.177644:0:5861:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9d0d49ecae00/0xafddb3c8f9281538 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477243.177668:0:5861:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9d0d49eca600/0xafddb3c8f9281458 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xafddb3c8f9281451 expref: 16 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477243.177677:0:5861:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9d0d49ecae00/0xafddb3c8f9281538 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477243.177722:0:5861:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9d0d49eca600/0xafddb3c8f9281458 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xafddb3c8f9281451 expref: 16 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477243.177738:0:5861:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9d0d49eca600/0xafddb3c8f9281458 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xafddb3c8f9281451 expref: 16 pid: 5837 timeout: 338 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789477243.177770:0:5861:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d58244000 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5861:1876402802534784:0@lo:104: 00000100:00100000:3.0:1789477243.177836:0:5861:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789477243.177892:0:5861:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d0d50a1ea80 going to sleep for 11 seconds 00000100:00100000:2.0:1789477243.178085:0:5828:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1789477243.178103:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802534784 00000100:00100000:2.0:1789477243.178115:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802534784 00000100:00100000:2.0:1789477243.178171:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1789477243.178181:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d42ea3050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:07d5e05c-913f-419f-adbc-d3cf15e9cd51+3:5861:x1876402802534784:12345-0@lo:104: 00010000:00010000:2.0:1789477243.178204:0:5828:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.123@tcp lock: ffff9d0d59d6aa00/0xafddb3c8f9281451 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xafddb3c8f9281458 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477243.178261:0:5828:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1789477243.178267:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d42ea3050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:07d5e05c-913f-419f-adbc-d3cf15e9cd51+3:5861:x1876402802534784:12345-0@lo:104: Request processed in 88us (431us total) trans 0 rc 0/0 00000100:00100000:2.0:1789477243.178274:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00010000:1.0:1789477243.178356:0:5833:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789477243.178363:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.123@tcp lock: ffff9d0d59d6aa00/0xafddb3c8f9281451 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xafddb3c8f9281458 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477243.178371:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d0d59d6aa00 already unused, calling callback (ffffffffc1bb3c20) 10000000:00010000:1.0:1789477243.178375:0:5833:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.123@tcp lock: ffff9d0d59d6aa00/0xafddb3c8f9281451 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xafddb3c8f9281458 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477243.178384:0:5833:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.123@tcp lock: ffff9d0d59d6aa00/0xafddb3c8f9281451 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xafddb3c8f9281458 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789477243.178390:0:5833:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.123@tcp lock: ffff9d0d59d6aa00/0xafddb3c8f9281451 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xafddb3c8f9281458 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789477243.178396:0:5833:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1789477243.178435:0:5833:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.123@tcp lock: ffff9d0d59d6aa00/0xafddb3c8f9281451 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xafddb3c8f9281458 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477243.178442:0:5833:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789477243.178455:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.123@tcp lock: ffff9d0d59d6aa00/0xafddb3c8f9281451 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xafddb3c8f9281458 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477243.178461:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.123@tcp lock: ffff9d0d59d6aa00/0xafddb3c8f9281451 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xafddb3c8f9281458 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477243.178483:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789477243.178485:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789477243.178487:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789477243.178546:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d7f738380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:07d5e05c-913f-419f-adbc-d3cf15e9cd51:3311:1876402802534912:0@lo:103: 00000100:00100000:3.0:1789477243.178606:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789477243.178647:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802534912 00000100:00100000:3.0:1789477243.178651:0:6711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802534912 00010000:00010000:3.0:1789477243.178669:0:6711:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9d0d49eca600/0xafddb3c8f9281458 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xafddb3c8f9281451 expref: 17 pid: 5837 timeout: 338 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789477243.178694:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1789477243.178701:0:6711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d48463c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:07d5e05c-913f-419f-adbc-d3cf15e9cd51+17:3311:x1876402802534912:12345-0@lo:103: 00010000:00010000:3.0:1789477243.178711:0:6711:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789477243.178716:0:6711:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9d0d49eca600/0xafddb3c8f9281458 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xafddb3c8f9281451 expref: 17 pid: 5837 timeout: 338 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477243.178726:0:6711:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9d0d49eca600/0xafddb3c8f9281458 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xafddb3c8f9281451 expref: 17 pid: 5837 timeout: 338 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477243.178742:0:6711:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9d0d49ecae00/0xafddb3c8f9281538 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477243.178751:0:6711:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d0d49ecae00/0xafddb3c8f9281538 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1789477243.178765:0:6711:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.002859838s 00010000:00010000:3.0:1789477243.178770:0:6711:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9d0d49ecae00/0xafddb3c8f9281538 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477243.178787:0:6711:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9d0d49ecae00/0xafddb3c8f9281538 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477243.178794:0:6711:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9d0d49ecae00/0xafddb3c8f9281538 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477243.178801:0:6711:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9d0d49ecae00/0xafddb3c8f9281538 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477243.178806:0:6711:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d0d49ecae00 already unused, calling callback (ffffffffc15972a0) 00010000:00010000:3.0:1789477243.178811:0:6711:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9d0d49ecae00/0xafddb3c8f9281538 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477243.178818:0:6711:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9d0d49ecae00/0xafddb3c8f9281538 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477243.178827:0:6711:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9d0d49ecae00/0xafddb3c8f9281538 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477243.178836:0:6711:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789477243.178865:0:6711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d48463c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:07d5e05c-913f-419f-adbc-d3cf15e9cd51+17:3311:x1876402802534912:12345-0@lo:103: Request processed in 165us (259us total) trans 0 rc 0/0 00000100:00100000:3.0:1789477243.178872:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1789477243.178951:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d7f738380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:07d5e05c-913f-419f-adbc-d3cf15e9cd51:3311:1876402802534912:0@lo:103: 00010000:00010000:3.0:1789477243.178979:0:5861:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d0d49eca600/0xafddb3c8f9281458 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xafddb3c8f9281451 expref: 16 pid: 5837 timeout: 338 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789477243.178989:0:5861:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d58244000 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5861:1876402802534784:0@lo:104: 00010000:00010000:3.0:1789477243.178998:0:5861:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9d0d49ecae00/0xafddb3c8f9281538 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477243.179019:0:5861:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9d0d49ecae00/0xafddb3c8f9281538 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477243.179026:0:5861:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9d0d49ecae00/0xafddb3c8f9281538 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477243.179032:0:5861:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d0d49ecae00/0xafddb3c8f9281538 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789477243.186452:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d48460c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07d5e05c-913f-419f-adbc-d3cf15e9cd51+15:6692:x1876402802534656:12345-0@lo:253: Request processed in 43406us (43580us total) trans 0 rc 0/0 00000100:00100000:1.0:1789477243.186469:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1789477243.186675:0:6692:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d7bddf800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:07d5e05c-913f-419f-adbc-d3cf15e9cd51:6692:1876402802534656:0@lo:253: 10000000:01000000:2.0:1789477243.186692:0:6692:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:2.0:1789477243.186696:0:6692:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1789477243.186697:0:6692:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1789477243.186699:0:6692:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789477243.186700:0:6692:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789477243.186701:0:6692:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789477243.186703:0:6692:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789477243.186704:0:6692:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1789477243.186706:0:6692:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1789477243.186707:0:6692:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1789477243.186708:0:6692:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789477243.186710:0:6692:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1789477243.186725:0:6692:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:3.0:1789477243.192203:0:6692:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:3.0:1789477243.192371:0:6692:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:3.0:1789477243.192709:0:6692:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:3.0:1789477243.192877:0:6692:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:3.0:1789477243.193069:0:6692:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:3.0:1789477243.193375:0:6692:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:3.0:1789477243.194338:0:6692:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00002000:00080000:2.0:1789477243.420343:0:6692:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:2.0:1789477243.420351:0:6692:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:2.0:1789477243.420381:0:6692:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1789477243.420443:0:6692:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.201.123@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1789477243.420459:0:6692:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=48 00000080:00000004:2.0:1789477243.420487:0:6692:0:(super25.c:182:lustre_fill_super()) lustre-ost1/ost1: Mount complete 00010000:00010000:0.0:1789477243.569822:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789477244.591805:0:6710:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789477245.618006:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789477246.640903:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789477247.669749:0:6710:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1789477248.434419:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789477248.434429:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:1.0:1789477248.434434:0:36:0:(import.c:65:import_set_state_nolock()) ffff9d0d7f78d000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1789477248.434441:0:36:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 188 00000100:00080000:1.0:1789477248.434447:0:36:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1789477248.434458:0:36:0:(import.c:625:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9d0d7f78d000 using connection 192.168.201.123@tcp/0@lo 00000100:00100000:1.0:1789477248.434480:0:36:0:(import.c:827:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9d0d7f738000 x1876402802535296/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1789477248.434677:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d7f738700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3313:1876402802535168:0@lo:400: 00000100:00100000:1.0:1789477248.434749:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789477248.434802:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789477248.434809:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d7f73b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:07d5e05c-913f-419f-adbc-d3cf15e9cd51:3313:1876402802535040:0@lo:400: 00000100:00100000:1.0:1789477248.434839:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789477248.434869:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d7f738000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3309:1876402802535296:0@lo:8: 00000100:00100000:1.0:1789477248.434893:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789477248.434922:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d7f739880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3310:1876402802535424:0@lo:400: 00000100:00100000:1.0:1789477248.434946:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789477248.435002:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802535168 00000100:00100000:1.0:1789477248.435012:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802535168 00000100:00100000:1.0:1789477248.435068:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802535424 00000100:00100000:1.0:1789477248.435072:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802535424 00000100:00100000:1.0:1789477248.435116:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789477248.435125:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d7f73b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1876402802535168:12345-0@lo:400: 00000100:00100000:2.0:1789477248.435140:0:5845:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:2.0:1789477248.435153:0:5845:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00080000:2.0:1789477248.435170:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789477248.435367:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802535040 00000100:00100000:0.0:1789477248.435373:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802535040 00000100:00100000:0.0:1789477248.435401:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1789477248.435408:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d48460450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:07d5e05c-913f-419f-adbc-d3cf15e9cd51+15:3313:x1876402802535040:12345-0@lo:400: 00000100:00100000:0.0:1789477248.435469:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d48460450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:07d5e05c-913f-419f-adbc-d3cf15e9cd51+15:3313:x1876402802535040:12345-0@lo:400: Request processed in 61us (628us total) trans 0 rc 0/0 00000100:00100000:0.0:1789477248.435477:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1789477248.435517:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802535296 00000100:00100000:0.0:1789477248.435521:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802535296 00000100:00100000:0.0:1789477248.435549:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789477248.435553:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d7f738a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3309:x1876402802535296:12345-0@lo:8: 00010000:00080000:0.0:1789477248.435594:0:6697:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 193 last 0 00000020:00000080:0.0:1789477248.435627:0:6697:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xafddb3c8f928153f 00002000:00100000:0.0:1789477248.435668:0:6697:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff9d0d7c0c7800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113954 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:0.0:1789477248.435673:0:6697:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00000001:00000004:0.0:1789477248.435678:0:6697:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:0.0:1789477248.435813:0:6697:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:0.0:1789477248.435975:0:6697:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1789477248.436000:0:6697:0:(import.c:65:import_set_state_nolock()) ffff9d0d7c0c2000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789477248.436068:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d7f738a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3309:x1876402802535296:12345-0@lo:8: Request processed in 513us (1173us total) trans 0 rc 0/0 00000100:00100000:0.0:1789477248.436075:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1789477248.436226:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9d0d7f738000 x1876402802535296/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1789477263 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789477248.436239:0:3309:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1789477248.436248:0:3309:0:(import.c:1133:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 1 00000100:00080000:2.0:1789477248.436257:0:3309:0:(import.c:957:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1789477248.436263:0:3309:0:(import.c:1214:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:2.0:1789477248.436265:0:3309:0:(import.c:65:import_set_state_nolock()) ffff9d0d7f78d000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1789477248.436279:0:3309:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1789477248.436284:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d7f738000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3309:1876402802535296:0@lo:8: 00000004:00080000:3.0:1789477248.436754:0:6716:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000100:00100000:1.0:1789477248.437821:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d7f73b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1876402802535168:12345-0@lo:400: Request processed in 2693us (3068us total) trans 0 rc 0/0 00000100:00100000:1.0:1789477248.437834:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789477248.437867:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1789477248.437878:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d7f739f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1876402802535424:12345-0@lo:400: 00000100:00100000:1.0:1789477248.437913:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d7f739f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1876402802535424:12345-0@lo:400: Request processed in 39us (2967us total) trans 0 rc 0/0 00000100:00100000:1.0:1789477248.437919:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:1.0:1789477248.438088:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9d0d7f739880 x1876402802535424/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789477264 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789477248.438118:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d7f739880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3310:1876402802535424:0@lo:400: 00000100:00100000:0.0:1789477248.438656:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d7f73b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:07d5e05c-913f-419f-adbc-d3cf15e9cd51:3313:1876402802535040:0@lo:400: 00010000:00080000:0.0:1789477248.438673:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9d0d7f738700 x1876402802535168/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789477264 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789477248.438684:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d7f738700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3313:1876402802535168:0@lo:400: 00000004:00080000:3.0:1789477248.446489:0:6716:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 193517908737ns, next at 0ns, rc = 0 00000004:00080000:1.0:1789477248.548446:0:6717:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x100000000:0x1:0x0] 00000100:00100000:1.0:1789477248.548484:0:6717:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d7f73bb80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6717:1876402802535680:0@lo:7: 00000100:00100000:1.0:1789477248.548629:0:6717:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789477248.548686:0:6717:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d0d58787780 going to sleep for 11 seconds 00000100:00100000:1.0:1789477248.548728:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d7f739880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1876402802535552:0@lo:13: 00000100:00100000:1.0:1789477248.548756:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789477248.548823:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802535680 00000100:00100000:1.0:1789477248.548833:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802535680 00000100:00100000:1.0:1789477248.548890:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789477248.548900:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d7f73a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:6717:x1876402802535680:12345-0@lo:7: 00000100:00100000:0.0:1789477248.549272:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802535552 00000100:00100000:0.0:1789477248.549288:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802535552 00000100:00100000:0.0:1789477248.549359:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789477248.549374:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d7f739500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3311:x1876402802535552:12345-0@lo:13: 00002000:00000024:0.0:1789477248.549420:0:6698:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3860856832 avail 3858759680 00000100:00100000:0.0:1789477248.549529:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d7f739500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3311:x1876402802535552:12345-0@lo:13: Request processed in 160us (771us total) trans 0 rc 0/0 00000100:00100000:0.0:1789477248.549542:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:0.0:1789477248.551123:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1789477248.551206:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9d0d7f739880 x1876402802535552/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789477264 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789477248.551240:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d7f739880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1876402802535552:0@lo:13: 00000004:00080000:1.0:1789477248.562774:0:5868:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00002000:00080000:0.0:1789477248.564435:0:6696:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x0 00002000:00080000:0.0:1789477248.564447:0:6696:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x100000000:0x0:0x0] 00000100:00100000:0.0:1789477248.564629:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d7f73a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:6717:x1876402802535680:12345-0@lo:7: Request processed in 15722us (15992us total) trans 0 rc 0/0 00000100:00100000:0.0:1789477248.564645:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:1.0:1789477248.567352:0:6717:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9d0d7f73bb80 x1876402802535680/t0(0) o7->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1789477264 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789477248.567376:0:6717:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d7f73bb80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6717:1876402802535680:0@lo:7: 00000004:00080000:1.0:1789477248.567398:0:6717:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0000: Got last_fid [0x100000000:0x0:0x0] 00000100:00100000:1.0:1789477248.567458:0:6717:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d7f73bb80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6717:1876402802535808:0@lo:5: 00000100:00100000:1.0:1789477248.567531:0:6717:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789477248.567625:0:6717:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d0d58787780 going to sleep for 11 seconds 00000100:00100000:0.0:1789477248.572862:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802535808 00000100:00100000:0.0:1789477248.572888:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802535808 00000100:00100000:0.0:1789477248.572987:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1789477248.573000:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d7f73ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:6717:x1876402802535808:12345-0@lo:5: 00002000:00080000:0.0:1789477248.573051:0:6697:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:0.0:1789477248.573057:0:6697:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 1 objects in group 0x0 at 1 00000100:00100000:0.0:1789477248.573669:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d7f73ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:6717:x1876402802535808:12345-0@lo:5: Request processed in 669us (6135us total) trans 4294967297 rc 0/0 00010000:00080000:1.0:1789477248.573732:0:6717:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9d0d7f73bb80 x1876402802535808/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1789477264 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789477248.573755:0:6717:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d7f73bb80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6717:1876402802535808:0@lo:5: 00000004:00080000:1.0:1789477248.573772:0:6717:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x100000000:0x1:0x0] from OST, last_created [0x100000000:0x1:0x0]last_used is [0x100000000:0x1:0x0] 00000100:00100000:1.0:1789477248.573824:0:6717:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d7f739880 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6717:1876402802535936:0@lo:700: 00000100:00100000:1.0:1789477248.573884:0:6717:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789477248.573936:0:6717:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d0d58787780 going to sleep for 11 seconds 00000100:00100000:2.0:1789477248.574017:0:6703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802535936 00000100:00100000:2.0:1789477248.574025:0:6703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802535936 00000100:00100000:2.0:1789477248.574087:0:6703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789477248.574108:0:6703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d7f738700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+8:6717:x1876402802535936:12345-0@lo:700: 00000100:00100000:2.0:1789477248.574143:0:6703:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d7bddf800 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:6703:1876402802536064:0@lo:700: 00000100:00100000:2.0:1789477248.574178:0:6703:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789477248.574199:0:6703:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d0d42ad26c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789477248.574221:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802536064 00000100:00100000:2.0:1789477248.574224:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802536064 00000100:00100000:2.0:1789477248.574252:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789477248.574259:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d7bddca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:6703:x1876402802536064:12345-0@lo:700: 00000100:00100000:0.0:1789477248.579776:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 40000000:02000000:1.0:1789477248.648278:0:5851:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:0:ost 00000100:00100000:1.0:1789477248.661957:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d7bddca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:6703:x1876402802536064:12345-0@lo:700: Request processed in 87532us (87613us total) trans 0 rc 0/0 00000100:00100000:1.0:1789477248.661992:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:2.0:1789477248.662909:0:6703:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9d0d7bddf800 x1876402802536064/t0(0) o700->lustre-MDT0000-lwp-OST0000@0@lo:32/10 lens 264/248 e 0 to 0 dl 1789477264 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789477248.662933:0:6703:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d7bddf800 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:6703:1876402802536064:0@lo:700: 40000000:02000000:2.0:1789477248.662961:0:6703:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0000-super: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:0:ost] 00010000:00010000:3.0:1789477248.689524:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1789477248.806151:0:6730:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967297 is committed 00000001:00100000:1.0:1789477248.806184:0:6730:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:3.0:1789477248.806256:0:6703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d7f738700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:6717:x1876402802535936:12345-0@lo:700: Request processed in 232140us (232361us total) trans 0 rc 0/0 00000100:00100000:3.0:1789477248.806277:0:6703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:1.0:1789477248.806419:0:6717:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9d0d7f739880 x1876402802535936/t0(0) o700->lustre-OST0000-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1789477264 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789477248.806436:0:6717:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:1.0:1789477248.806481:0:6717:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d7f739880 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6717:1876402802535936:0@lo:700: 00000004:02000040:1.0:1789477248.876839:0:6717:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x240000400 00000100:00100000:3.0:1789477248.888708:0:6717:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d58244000 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6717:1876402802536192:0@lo:5: 00000100:00100000:3.0:1789477248.888809:0:6717:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789477248.888911:0:6717:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d0d50abdd80 going to sleep for 11 seconds 00000100:00100000:0.0:1789477248.890305:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802536192 00000100:00100000:0.0:1789477248.890326:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802536192 00000100:00100000:0.0:1789477248.890494:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1789477248.890507:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d58245880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:6717:x1876402802536192:12345-0@lo:5: 00002000:00080000:0.0:1789477248.905482:0:6696:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x240000400 00002000:00080000:0.0:1789477248.905504:0:6696:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x240000400 at 2 00000100:00100000:2.0:1789477248.915553:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d58245880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:6717:x1876402802536192:12345-0@lo:5: Request processed in 25030us (26725us total) trans 4294967298 rc 0/0 00010000:00080000:0.0:1789477248.915642:0:6717:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9d0d58244000 x1876402802536192/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1789477264 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789477248.915672:0:6717:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d58244000 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6717:1876402802536192:0@lo:5: 00000004:00080000:0.0:1789477248.915693:0:6717:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x240000400:0x1:0x0]-[0x240000400:0x21:0x0] 00000100:00100000:2.0:1789477248.915746:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00010000:0.0:1789477249.712091:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1789477250.199348:0:7072:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg123-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:2.0:1789477250.735753:0:6710:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1789477250.991710:0:5841:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1789477250.991721:0:5841:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9d0d4444e800 from 4 10000000:01000000:2.0:1789477250.991727:0:5841:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1789477250.991791:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.123@tcp lock: ffff9d0d59d6ba00/0xafddb3c8f9281546 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477250.991807:0:5841:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.123@tcp lock: ffff9d0d59d6ba00/0xafddb3c8f9281546 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477250.991820:0:5841:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.123@tcp lock: ffff9d0d59d6ba00/0xafddb3c8f9281546 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789477250.991855:0:5841:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d7bddf800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07d5e05c-913f-419f-adbc-d3cf15e9cd51:5841:1876402802536320:0@lo:101: 00000100:00100000:2.0:1789477250.991959:0:5841:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789477250.992078:0:5841:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d0d4e658300 going to sleep for 11 seconds 00000100:00100000:0.0:1789477250.992202:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802536320 00000100:00100000:0.0:1789477250.992218:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802536320 00000100:00100000:0.0:1789477250.992292:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1789477250.992304:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d4ec6c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07d5e05c-913f-419f-adbc-d3cf15e9cd51+15:5841:x1876402802536320:12345-0@lo:101: 00010000:00010000:0.0:1789477250.992324:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789477250.992345:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d0d40031400/0xafddb3c8f928154d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xafddb3c8f9281546 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477250.992408:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d0d40031400/0xafddb3c8f928154d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xafddb3c8f9281546 expref: 16 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477250.992421:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d0d40031400/0xafddb3c8f928154d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xafddb3c8f9281546 expref: 16 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477250.992432:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d0d40031400, rc 0) 00000100:00100000:0.0:1789477250.992512:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d4ec6c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07d5e05c-913f-419f-adbc-d3cf15e9cd51+16:5841:x1876402802536320:12345-0@lo:101: Request processed in 209us (561us total) trans 0 rc 0/0 00000100:00100000:0.0:1789477250.992519:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1789477250.992616:0:5841:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d7bddf800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07d5e05c-913f-419f-adbc-d3cf15e9cd51:5841:1876402802536320:0@lo:101: 00010000:00010000:0.0:1789477250.992637:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.123@tcp lock: ffff9d0d59d6ba00/0xafddb3c8f9281546 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xafddb3c8f928154d expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477250.992648:0:5841:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.123@tcp lock: ffff9d0d59d6ba00/0xafddb3c8f9281546 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xafddb3c8f928154d expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789477250.992719:0:5841:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d4e640e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07d5e05c-913f-419f-adbc-d3cf15e9cd51:5841:1876402802536448:0@lo:256: 00000100:00100000:0.0:1789477250.992761:0:5841:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789477250.992781:0:5841:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d0d44527240 going to sleep for 11 seconds 00000100:00100000:0.0:1789477250.992797:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802536448 00000100:00100000:0.0:1789477250.992801:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802536448 00000100:00100000:0.0:1789477250.992823:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1789477250.992830:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d4ec6f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:07d5e05c-913f-419f-adbc-d3cf15e9cd51+16:5841:x1876402802536448:12345-0@lo:256: 20000000:01000000:0.0:1789477250.992846:0:5839:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1789477250.992866:0:5839:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1789477250.992869:0:5839:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 4 00000100:00100000:0.0:1789477250.992950:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d4ec6f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:07d5e05c-913f-419f-adbc-d3cf15e9cd51+16:5841:x1876402802536448:12345-0@lo:256: Request processed in 121us (189us total) trans 0 rc 0/0 00000100:00100000:0.0:1789477250.992957:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1789477250.992989:0:5841:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d4e640e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07d5e05c-913f-419f-adbc-d3cf15e9cd51:5841:1876402802536448:0@lo:256: 10000000:01000000:0.0:1789477250.993078:0:5841:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.123@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1789477250.993086:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.123@tcp lock: ffff9d0d59d6ba00/0xafddb3c8f9281546 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xafddb3c8f928154d expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477250.993095:0:5841:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.123@tcp lock: ffff9d0d59d6ba00/0xafddb3c8f9281546 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xafddb3c8f928154d expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477251.766210:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789477252.787488:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789477253.551896:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789477253.551931:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d4e640e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1876402802536576:0@lo:13: 00000100:00100000:3.0:1789477253.552042:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789477253.552172:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802536576 00000100:00100000:0.0:1789477253.552182:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802536576 00000100:00100000:0.0:1789477253.552260:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789477253.552272:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d58245f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3313:x1876402802536576:12345-0@lo:13: 00002000:00000024:0.0:1789477253.552317:0:6698:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789477253.552379:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d58245f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3313:x1876402802536576:12345-0@lo:13: Request processed in 109us (337us total) trans 0 rc 0/0 00000100:00100000:0.0:1789477253.552387:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1789477253.552491:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9d0d4e640e00 x1876402802536576/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789477269 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789477253.552513:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d4e640e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1876402802536576:0@lo:13: 00000100:00080000:3.0:1789477253.552568:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789477253.554235:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d4e640e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:07d5e05c-913f-419f-adbc-d3cf15e9cd51:3313:1876402802536704:0@lo:400: 00000100:00100000:2.0:1789477253.554318:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789477253.554628:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802536704 00000100:00100000:0.0:1789477253.554638:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802536704 00000100:00100000:0.0:1789477253.554688:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1789477253.554696:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d4ec6e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:07d5e05c-913f-419f-adbc-d3cf15e9cd51+16:3313:x1876402802536704:12345-0@lo:400: 00000100:00100000:1.0:1789477253.554803:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d4e641180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3310:1876402802536832:0@lo:400: 00000100:00100000:1.0:1789477253.554840:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789477253.554865:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789477253.554870:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d4e642680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3310:1876402802536960:0@lo:400: 00000100:00100000:1.0:1789477253.554890:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789477253.554913:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802536832 00000100:00100000:1.0:1789477253.554916:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802536832 00000100:00100000:1.0:1789477253.554945:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802536960 00000100:00100000:1.0:1789477253.554947:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802536960 00000100:00100000:1.0:1789477253.554993:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1789477253.555012:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d7f739880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1876402802536832:12345-0@lo:400: 00000100:00100000:1.0:1789477253.555050:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d7f739880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1876402802536832:12345-0@lo:400: Request processed in 51us (210us total) trans 0 rc 0/0 00000100:00100000:1.0:1789477253.555058:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1789477253.555076:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1789477253.555081:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d7f73bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1876402802536960:12345-0@lo:400: 00000100:00100000:1.0:1789477253.555102:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d7f73bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1876402802536960:12345-0@lo:400: Request processed in 21us (212us total) trans 0 rc 0/0 00000100:00100000:1.0:1789477253.555108:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00080000:1.0:1789477253.555145:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1789477253.555172:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9d0d4e642680 x1876402802536960/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789477269 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789477253.555201:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d4e642680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3310:1876402802536960:0@lo:400: 00010000:00080000:1.0:1789477253.555212:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9d0d4e641180 x1876402802536832/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789477269 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789477253.555220:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d4e641180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3310:1876402802536832:0@lo:400: 00000100:00100000:0.0:1789477253.560542:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d4ec6e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:07d5e05c-913f-419f-adbc-d3cf15e9cd51+16:3313:x1876402802536704:12345-0@lo:400: Request processed in 5828us (6207us total) trans 0 rc 0/0 00000100:00100000:0.0:1789477253.560562:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1789477253.560833:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d4e640e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:07d5e05c-913f-419f-adbc-d3cf15e9cd51:3313:1876402802536704:0@lo:400: 00010000:00010000:2.0:1789477253.808299:0:6710:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1789477254.212157:0:6730:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967298 is committed 00010000:00010000:3.0:1789477254.835885:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789477255.861050:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789477256.879905:0:6710:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789477257.905783:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789477258.672109:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d4e643100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1876402802537088:0@lo:13: 00000100:00100000:2.0:1789477258.672401:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d7bdddf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:07d5e05c-913f-419f-adbc-d3cf15e9cd51:3313:1876402802537216:0@lo:400: 00000100:00100000:2.0:1789477258.672460:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789477258.672536:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789477258.672542:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d7bddd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3313:1876402802537600:0@lo:400: 00000100:00100000:2.0:1789477258.672568:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789477258.672698:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d7bdde300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1876402802537472:0@lo:400: 00000100:00100000:3.0:1789477258.672722:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d7bddfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3310:1876402802537344:0@lo:400: 00000100:00100000:2.0:1789477258.672736:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789477258.672786:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802537216 00000100:00100000:2.0:1789477258.672797:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802537216 00000100:00100000:3.0:1789477258.672818:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789477258.672877:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1789477258.672892:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d4ec6c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07d5e05c-913f-419f-adbc-d3cf15e9cd51+16:3313:x1876402802537216:12345-0@lo:400: 00000100:00100000:3.0:1789477258.672951:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802537600 00000100:00100000:3.0:1789477258.672961:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802537600 00000100:00100000:2.0:1789477258.672976:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d4ec6c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07d5e05c-913f-419f-adbc-d3cf15e9cd51+16:3313:x1876402802537216:12345-0@lo:400: Request processed in 87us (515us total) trans 0 rc 0/0 00000100:00100000:2.0:1789477258.672986:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1789477258.673031:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802537344 00000100:00100000:3.0:1789477258.673037:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802537344 00000100:00100000:2.0:1789477258.673046:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1789477258.673060:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d7bdded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1876402802537600:12345-0@lo:400: 00000100:00100000:3.0:1789477258.673073:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1789477258.673086:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d58246300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1876402802537344:12345-0@lo:400: 00000100:00100000:2.0:1789477258.673103:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d7bdded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1876402802537600:12345-0@lo:400: Request processed in 46us (531us total) trans 0 rc 0/0 00000100:00100000:2.0:1789477258.673111:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1789477258.673150:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802537472 00000100:00100000:2.0:1789477258.673156:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802537472 00000100:00100000:3.0:1789477258.673162:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d58246300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1876402802537344:12345-0@lo:400: Request processed in 78us (346us total) trans 0 rc 0/0 00000100:00100000:3.0:1789477258.673171:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1789477258.673199:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00080000:3.0:1789477258.673204:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789477258.673213:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789477258.673213:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d7bddce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3311:x1876402802537472:12345-0@lo:400: 00010000:00080000:3.0:1789477258.673264:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9d0d7bddfb80 x1876402802537344/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789477274 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789477258.673280:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d7bddfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3310:1876402802537344:0@lo:400: 00000100:00100000:2.0:1789477258.673288:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d7bddce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3311:x1876402802537472:12345-0@lo:400: Request processed in 76us (549us total) trans 0 rc 0/0 00000100:00100000:2.0:1789477258.673299:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:2.0:1789477258.673358:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9d0d7bdde300 x1876402802537472/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789477274 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789477258.673368:0:3311:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:2.0:1789477258.673386:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d7bdde300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1876402802537472:0@lo:400: 00010000:00080000:2.0:1789477258.673409:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9d0d7bddd500 x1876402802537600/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789477274 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789477258.673428:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d7bddd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3313:1876402802537600:0@lo:400: 00000100:00100000:2.0:1789477258.673440:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d7bdddf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:07d5e05c-913f-419f-adbc-d3cf15e9cd51:3313:1876402802537216:0@lo:400: 00000100:00100000:0.0:1789477258.674010:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789477258.674384:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802537088 00000100:00100000:2.0:1789477258.674390:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802537088 00000100:00100000:2.0:1789477258.674437:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789477258.674447:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d4e641c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1876402802537088:12345-0@lo:13: 00002000:00000024:2.0:1789477258.674483:0:6698:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789477258.674546:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d4e641c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1876402802537088:12345-0@lo:13: Request processed in 101us (537us total) trans 0 rc 0/0 00000100:00100000:2.0:1789477258.674553:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:3.0:1789477258.675166:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9d0d4e643100 x1876402802537088/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789477274 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789477258.675193:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d4e643100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1876402802537088:0@lo:13: 00010000:00010000:1.0:1789477258.927787:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789477259.951750:0:6710:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789477260.975798:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789477262.010003:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789477263.024024:0:6710:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1789477263.042891:0:7660:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1789477263.042896:0:7660:0:(obd_mount.c:926:lmd_print()) device: lustre-ost2/ost2 00000080:01200004:2.0:1789477263.043048:0:7660:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9d0d514ce000 00000020:01000004:2.0:1789477263.043069:0:7660:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-OST0001, type=osd-zfs, lsifl=200062, mountfl=0 00000020:01000004:2.0:1789477263.043084:0:7660:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-zfs) 00000020:00000080:2.0:1789477263.043110:0:7660:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff9d0d75440000) 00000020:00000080:2.0:1789477263.043128:0:7660:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type osd-zfs with refcount 2 00100000:10000000:1.0:1789477263.120112:0:7660:0:(scrub.c:230:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00100000:10000000:1.0:1789477263.121745:0:7660:0:(scrub.c:230:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00100000:10000000:3.0:1789477263.178916:0:7660:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:3.0:1789477263.188975:0:7660:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:3.0:1789477263.189011:0:7660:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:3.0:1789477263.189083:0:7660:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:3.0:1789477263.189109:0:7660:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:3.0:1789477263.191342:0:7660:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:3.0:1789477263.191360:0:7660:0:(osd_handler.c:1564:osd_obd_connect()) connect #0 00000020:00000080:3.0:1789477263.191376:0:7660:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xafddb3c8f928155b 00000020:01000004:3.0:1789477263.191386:0:7660:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-OST0001 on device lustre-ost2/ost2 00000020:01000004:3.0:1789477263.191412:0:7660:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.201.123@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1789477263.191416:0:7660:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.201.123@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1789477263.191425:0:7660:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-OST0001 00000020:01000004:3.0:1789477263.191452:0:7660:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost2/ost2 10000000:01000000:3.0:1789477263.191457:0:7660:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.201.123@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:2.0:1789477263.227064:0:7660:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.123@tcp ctxt 0 is initialized 00000020:01000004:2.0:1789477263.227116:0:7660:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.201.123@tcp, index=0001, flags=0x20062 00000020:01000004:2.0:1789477263.227120:0:7660:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1789477263.227122:0:7660:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1789477263.227124:0:7660:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789477263.227125:0:7660:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789477263.227126:0:7660:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789477263.227128:0:7660:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789477263.227129:0:7660:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1789477263.227132:0:7660:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1789477263.227134:0:7660:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1789477263.227136:0:7660:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789477263.227141:0:7660:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1789477263.227145:0:7660:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020062 00000020:01000004:2.0:1789477263.229317:0:7660:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1789477263.229325:0:7660:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1789477263.229327:0:7660:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789477263.229328:0:7660:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789477263.229330:0:7660:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789477263.229333:0:7660:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789477263.229335:0:7660:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1789477263.229336:0:7660:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1789477263.229337:0:7660:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1789477263.229339:0:7660:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789477263.229341:0:7660:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1789477263.229406:0:7660:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:2.0:1789477263.229430:0:7660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d7bdddf80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:07d5e05c-913f-419f-adbc-d3cf15e9cd51:7660:1876402802537728:0@lo:253: 00000100:00100000:2.0:1789477263.229509:0:7660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789477263.229569:0:7660:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d0d7f762cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1789477263.229748:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802537728 00000100:00100000:0.0:1789477263.229758:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802537728 00000100:00100000:0.0:1789477263.229813:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1789477263.229824:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d4ec6f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:07d5e05c-913f-419f-adbc-d3cf15e9cd51+16:7660:x1876402802537728:12345-0@lo:253: 20000000:01000000:0.0:1789477263.229867:0:5839:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:0.0:1789477263.229872:0:5839:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0001, index=1 20000000:01000000:0.0:1789477263.229878:0:5839:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0001 to 1 20000000:01000000:0.0:1789477263.229882:0:5839:0:(mgs_llog.c:3862:mgs_write_log_ost()) writing new ost lustre-OST0001 00000040:00080000:0.0:1789477263.230949:0:5839:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1789477263.231168:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 20000000:01000000:0.0:1789477263.231183:0:5839:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf001 obdfilter lustre-OST0001_UUID (null) (null) 00000040:00080000:0.0:1789477263.231219:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 128 off8544 20000000:01000000:0.0:1789477263.231227:0:5839:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf003 dev type f (null) 00000040:00080000:0.0:1789477263.231255:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 112 off8656 00000040:00080000:0.0:1789477263.231304:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8880 00000040:00080000:0.0:1789477263.231732:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 224 off12648 20000000:01000000:0.0:1789477263.231755:0:5839:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.201.123@tcp 20000000:01000000:0.0:1789477263.231757:0:5839:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.201.123@tcp (null) (null) (null) 00000040:00080000:0.0:1789477263.231791:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 88 off12736 20000000:01000000:0.0:1789477263.231799:0:5839:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:0.0:1789477263.231865:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 144 off12880 20000000:01000000:0.0:1789477263.231875:0:5839:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf003 lustre-OST0001_UUID 192.168.201.123@tcp (null) (null) 00000040:00080000:0.0:1789477263.231906:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 152 off13032 20000000:01000000:0.0:1789477263.231922:0:5839:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:0.0:1789477263.231953:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 136 off13168 00000040:00080000:0.0:1789477263.232014:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13392 00000040:00080000:0.0:1789477263.241247:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].30, 224 off13416 20000000:01000000:0.0:1789477263.241402:0:5839:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.201.123@tcp 20000000:01000000:0.0:1789477263.241405:0:5839:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.201.123@tcp (null) (null) (null) 00000040:00080000:0.0:1789477263.241498:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].31, 88 off13504 20000000:01000000:0.0:1789477263.241507:0:5839:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:0.0:1789477263.241553:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].32, 128 off13632 20000000:01000000:0.0:1789477263.241562:0:5839:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf003 lustre-OST0001_UUID 192.168.201.123@tcp (null) (null) 00000040:00080000:0.0:1789477263.242377:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].33, 144 off13776 20000000:01000000:0.0:1789477263.242396:0:5839:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:0.0:1789477263.242475:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].34, 128 off13904 00000040:00080000:0.0:1789477263.242838:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].35, 224 off14128 20000000:01000000:0.0:1789477263.242864:0:5839:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' autodegrade=on ', param: 'sys.timeout=20' 20000000:01000000:0.0:1789477263.242868:0:5839:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:0.0:1789477263.242872:0:5839:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:0.0:1789477263.242887:0:5839:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:0.0:1789477263.242890:0:5839:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:0.0:1789477263.242932:0:5839:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:0.0:1789477263.242934:0:5839:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 20000000:01000000:3.0:1789477263.248025:0:7662:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 5 marker 14 1->4: lustre sys.timeout 20000000:01000000:3.0:1789477263.248134:0:7662:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 7 marker 14 2->4: lustre sys.timeout 00000040:00080000:3.0:1789477263.249412:0:7662:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 8 count 8 00000040:00080000:0.0:1789477263.250092:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 224 off9632 00000040:00080000:0.0:1789477263.250138:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 80 off9712 00000040:00080000:0.0:1789477263.250214:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off9936 20000000:01000000:0.0:1789477263.250240:0:5839:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:0.0:1789477263.250244:0:5839:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:3.0:1789477263.253977:0:7663:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 27 marker 15 1->4: lustre sys.timeout 20000000:01000000:3.0:1789477263.254089:0:7663:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 29 marker 15 2->4: lustre sys.timeout 00000040:00080000:3.0:1789477263.254190:0:7663:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 36 count 36 00000040:00080000:0.0:1789477263.254795:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].36, 224 off14352 00000040:00080000:0.0:1789477263.254853:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].37, 80 off14432 00000040:00080000:0.0:1789477263.254889:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].38, 224 off14656 20000000:01000000:0.0:1789477263.254902:0:5839:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:0.0:1789477263.254905:0:5839:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.timeout fl=4 00000040:00080000:3.0:1789477263.257005:0:7664:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 5 count 5 00000040:00080000:0.0:1789477263.257452:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9104 00000040:00080000:0.0:1789477263.257501:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 80 off9184 00000040:00080000:0.0:1789477263.259407:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 224 off9408 20000000:01000000:0.0:1789477263.259442:0:5839:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:0.0:1789477263.259445:0:5839:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:2.0:1789477263.268247:0:7665:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 22 marker 16 1->4: lustre sys.timeout 20000000:01000000:2.0:1789477263.268349:0:7665:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 24 marker 16 2->4: lustre sys.timeout 00000040:00080000:2.0:1789477263.268408:0:7665:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 31 count 31 00000040:00080000:0.0:1789477263.271372:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 224 off13616 00000040:00080000:0.0:1789477263.271427:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 80 off13696 00000040:00080000:0.0:1789477263.271505:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 224 off13920 20000000:01000000:0.0:1789477263.271522:0:5839:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'autodegrade=on' 20000000:01000000:0.0:1789477263.271525:0:5839:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'autodegrade=on' 10000000:01000000:0.0:1789477263.271535:0:5839:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:0.0:1789477263.271558:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9d0d40031600/0xafddb3c8f9281562 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477263.271627:0:5839:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9d0d49ecbe00/0xafddb3c8f9281489 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xafddb3c8f9281482 expref: 16 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477263.271637:0:5839:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9d0d40030200/0xafddb3c8f9281497 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xafddb3c8f9281490 expref: 16 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477263.271643:0:5839:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9d0d49eca800/0xafddb3c8f92814d6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xafddb3c8f92814cf expref: 16 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477263.271649:0:5839:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9d0d59d6a000/0xafddb3c8f9281500 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xafddb3c8f92814f9 expref: 16 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477263.271665:0:5839:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9d0d49eca400/0xafddb3c8f928151c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xafddb3c8f9281515 expref: 16 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477263.271673:0:5839:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9d0d40031600/0xafddb3c8f9281562 lrc: 8/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477263.271717:0:5839:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9d0d49eca400/0xafddb3c8f928151c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xafddb3c8f9281515 expref: 16 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477263.271754:0:5839:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9d0d49eca400/0xafddb3c8f928151c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xafddb3c8f9281515 expref: 16 pid: 5838 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789477263.271771:0:5839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d4e642a00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5839:1876402802537856:0@lo:104: 00000100:00100000:0.0:1789477263.271859:0:5839:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789477263.271921:0:5839:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9d0d59d6a000/0xafddb3c8f9281500 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xafddb3c8f92814f9 expref: 16 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477263.271930:0:5839:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9d0d59d6a000/0xafddb3c8f9281500 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xafddb3c8f92814f9 expref: 16 pid: 5837 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789477263.271938:0:5839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d4e643480 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5839:1876402802537984:0@lo:104: 00000100:00100000:0.0:1789477263.271959:0:5839:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789477263.271985:0:5839:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9d0d49eca800/0xafddb3c8f92814d6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xafddb3c8f92814cf expref: 16 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477263.271994:0:5839:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9d0d49eca800/0xafddb3c8f92814d6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xafddb3c8f92814cf expref: 16 pid: 5837 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789477263.272003:0:5839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d4e640000 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5839:1876402802538112:0@lo:104: 00000100:00100000:0.0:1789477263.272021:0:5839:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789477263.272035:0:5839:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9d0d40030200/0xafddb3c8f9281497 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xafddb3c8f9281490 expref: 16 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477263.272043:0:5839:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9d0d40030200/0xafddb3c8f9281497 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xafddb3c8f9281490 expref: 16 pid: 5837 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789477263.272052:0:5839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d4e640e00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5839:1876402802538240:0@lo:104: 00000100:00100000:0.0:1789477263.272077:0:5839:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789477263.272093:0:5839:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9d0d49ecbe00/0xafddb3c8f9281489 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xafddb3c8f9281482 expref: 16 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477263.272102:0:5839:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9d0d49ecbe00/0xafddb3c8f9281489 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xafddb3c8f9281482 expref: 16 pid: 5837 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789477263.272110:0:5839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d4e642680 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5839:1876402802538368:0@lo:104: 00000100:00100000:0.0:1789477263.272127:0:5839:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789477263.272137:0:5839:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d0d59416a80 going to sleep for 11 seconds 00000100:00100000:2.0:1789477263.275110:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802537856 00000100:00100000:2.0:1789477263.275126:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802537856 00000100:00100000:2.0:1789477263.275196:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802537984 00000100:00100000:2.0:1789477263.275200:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802537984 00000100:00100000:2.0:1789477263.275210:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802538112 00000100:00100000:2.0:1789477263.275213:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802538112 00000100:00100000:2.0:1789477263.275220:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802538240 00000100:00100000:2.0:1789477263.275222:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802538240 00000100:00100000:2.0:1789477263.275229:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802538368 00000100:00100000:2.0:1789477263.275232:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802538368 00000100:00100000:2.0:1789477263.275247:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1789477263.275257:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d4e640380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:07d5e05c-913f-419f-adbc-d3cf15e9cd51+7:5839:x1876402802537856:12345-0@lo:104: 00010000:00010000:2.0:1789477263.275276:0:5828:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.123@tcp lock: ffff9d0d59d6ae00/0xafddb3c8f9281515 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xafddb3c8f928151c expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477263.275422:0:5828:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1789477263.275429:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d4e640380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:07d5e05c-913f-419f-adbc-d3cf15e9cd51+7:5839:x1876402802537856:12345-0@lo:104: Request processed in 173us (3570us total) trans 0 rc 0/0 00000100:00100000:2.0:1789477263.275436:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1789477263.275453:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1789477263.275459:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d4e640700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:07d5e05c-913f-419f-adbc-d3cf15e9cd51+6:5839:x1876402802537984:12345-0@lo:104: 00010000:00010000:2.0:1789477263.275468:0:5828:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.123@tcp lock: ffff9d0d41647400/0xafddb3c8f92814f9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xafddb3c8f9281500 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477263.275502:0:5828:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1789477263.275507:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d4e640700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:07d5e05c-913f-419f-adbc-d3cf15e9cd51+6:5839:x1876402802537984:12345-0@lo:104: Request processed in 49us (3547us total) trans 0 rc 0/0 00000100:00100000:2.0:1789477263.275513:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1789477263.275525:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1789477263.275530:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d4e643100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:07d5e05c-913f-419f-adbc-d3cf15e9cd51+5:5839:x1876402802538112:12345-0@lo:104: 00010000:00010000:2.0:1789477263.275537:0:5828:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.123@tcp lock: ffff9d0d49ecb800/0xafddb3c8f92814cf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xafddb3c8f92814d6 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477263.275566:0:5828:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:2.0:1789477263.275571:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d4e643100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:07d5e05c-913f-419f-adbc-d3cf15e9cd51+5:5839:x1876402802538112:12345-0@lo:104: Request processed in 42us (3550us total) trans 0 rc 0/0 00000100:00100000:2.0:1789477263.275601:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1789477263.275612:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1789477263.275619:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d4e641180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:07d5e05c-913f-419f-adbc-d3cf15e9cd51+4:5839:x1876402802538240:12345-0@lo:104: 00010000:00010000:2.0:1789477263.275626:0:5828:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.123@tcp lock: ffff9d0d40031200/0xafddb3c8f9281490 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xafddb3c8f9281497 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477263.275678:0:5828:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:2.0:1789477263.275683:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d4e641180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:07d5e05c-913f-419f-adbc-d3cf15e9cd51+4:5839:x1876402802538240:12345-0@lo:104: Request processed in 65us (3605us total) trans 0 rc 0/0 00000100:00100000:2.0:1789477263.275690:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1789477263.275702:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1789477263.275709:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d4e642300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:07d5e05c-913f-419f-adbc-d3cf15e9cd51+3:5839:x1876402802538368:12345-0@lo:104: 00010000:00010000:2.0:1789477263.275718:0:5828:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.123@tcp lock: ffff9d0d59d6a200/0xafddb3c8f9281482 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xafddb3c8f9281489 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477263.275745:0:5828:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to priority blp list, 5 blwis in pool 00000100:00100000:2.0:1789477263.275749:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d4e642300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:07d5e05c-913f-419f-adbc-d3cf15e9cd51+3:5839:x1876402802538368:12345-0@lo:104: Request processed in 42us (3622us total) trans 0 rc 0/0 00000100:00100000:2.0:1789477263.275756:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00010000:0.0:1789477263.276562:0:6710:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:0.0:1789477263.276572:0:6710:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.123@tcp lock: ffff9d0d59d6ae00/0xafddb3c8f9281515 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xafddb3c8f928151c expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477263.276607:0:6710:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d0d59d6ae00 already unused, calling callback (ffffffffc1bb3c20) 10000000:00010000:0.0:1789477263.276611:0:6710:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.123@tcp lock: ffff9d0d59d6ae00/0xafddb3c8f9281515 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0xafddb3c8f928151c expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477263.276620:0:6710:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.123@tcp lock: ffff9d0d59d6ae00/0xafddb3c8f9281515 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0xafddb3c8f928151c expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789477263.276628:0:6710:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.123@tcp lock: ffff9d0d59d6ae00/0xafddb3c8f9281515 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0xafddb3c8f928151c expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789477263.276634:0:6710:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1789477263.276697:0:6710:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.123@tcp lock: ffff9d0d59d6ae00/0xafddb3c8f9281515 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xafddb3c8f928151c expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477263.276705:0:6710:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789477263.276728:0:6710:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.123@tcp lock: ffff9d0d59d6ae00/0xafddb3c8f9281515 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xafddb3c8f928151c expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477263.276750:0:6710:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.123@tcp lock: ffff9d0d59d6ae00/0xafddb3c8f9281515 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xafddb3c8f928151c expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477263.276767:0:6710:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:0.0:1789477263.276770:0:6710:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.123@tcp lock: ffff9d0d41647400/0xafddb3c8f92814f9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xafddb3c8f9281500 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477263.276777:0:6710:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d0d41647400 already unused, calling callback (ffffffffc1bb3c20) 10000000:00010000:0.0:1789477263.276780:0:6710:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.123@tcp lock: ffff9d0d41647400/0xafddb3c8f92814f9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xafddb3c8f9281500 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477263.276786:0:6710:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.123@tcp lock: ffff9d0d41647400/0xafddb3c8f92814f9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xafddb3c8f9281500 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789477263.276793:0:6710:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.123@tcp lock: ffff9d0d41647400/0xafddb3c8f92814f9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xafddb3c8f9281500 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789477263.276799:0:6710:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1789477263.276813:0:6710:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.123@tcp lock: ffff9d0d41647400/0xafddb3c8f92814f9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xafddb3c8f9281500 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477263.276819:0:6710:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789477263.276847:0:6710:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.123@tcp lock: ffff9d0d41647400/0xafddb3c8f92814f9 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xafddb3c8f9281500 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477263.276856:0:6710:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.123@tcp lock: ffff9d0d41647400/0xafddb3c8f92814f9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xafddb3c8f9281500 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477263.276866:0:6710:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1789477263.276874:0:6710:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.123@tcp lock: ffff9d0d49ecb800/0xafddb3c8f92814cf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xafddb3c8f92814d6 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477263.276880:0:6710:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d0d49ecb800 already unused, calling callback (ffffffffc1bb3c20) 10000000:00010000:0.0:1789477263.276883:0:6710:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.123@tcp lock: ffff9d0d49ecb800/0xafddb3c8f92814cf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xafddb3c8f92814d6 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477263.276891:0:6710:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.123@tcp lock: ffff9d0d49ecb800/0xafddb3c8f92814cf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xafddb3c8f92814d6 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789477263.276898:0:6710:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.123@tcp lock: ffff9d0d49ecb800/0xafddb3c8f92814cf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xafddb3c8f92814d6 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789477263.276904:0:6710:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1789477263.276918:0:6710:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.123@tcp lock: ffff9d0d49ecb800/0xafddb3c8f92814cf lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xafddb3c8f92814d6 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477263.276924:0:6710:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789477263.276930:0:6710:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.123@tcp lock: ffff9d0d49ecb800/0xafddb3c8f92814cf lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xafddb3c8f92814d6 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477263.276936:0:6710:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.123@tcp lock: ffff9d0d49ecb800/0xafddb3c8f92814cf lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xafddb3c8f92814d6 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477263.276946:0:6710:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789477263.276949:0:6710:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.123@tcp lock: ffff9d0d40031200/0xafddb3c8f9281490 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xafddb3c8f9281497 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477263.276955:0:6710:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d0d40031200 already unused, calling callback (ffffffffc1bb3c20) 10000000:00010000:0.0:1789477263.276957:0:6710:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.123@tcp lock: ffff9d0d40031200/0xafddb3c8f9281490 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xafddb3c8f9281497 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477263.276975:0:6710:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.123@tcp lock: ffff9d0d40031200/0xafddb3c8f9281490 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xafddb3c8f9281497 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789477263.276982:0:6710:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.123@tcp lock: ffff9d0d40031200/0xafddb3c8f9281490 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xafddb3c8f9281497 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789477263.276988:0:6710:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1789477263.277001:0:6710:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.123@tcp lock: ffff9d0d40031200/0xafddb3c8f9281490 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xafddb3c8f9281497 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477263.277007:0:6710:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789477263.277013:0:6710:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.123@tcp lock: ffff9d0d40031200/0xafddb3c8f9281490 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xafddb3c8f9281497 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477263.277020:0:6710:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.123@tcp lock: ffff9d0d40031200/0xafddb3c8f9281490 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xafddb3c8f9281497 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477263.277032:0:6710:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789477263.277035:0:6710:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.123@tcp lock: ffff9d0d59d6a200/0xafddb3c8f9281482 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xafddb3c8f9281489 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477263.277041:0:6710:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d0d59d6a200 already unused, calling callback (ffffffffc1bb3c20) 10000000:00010000:0.0:1789477263.277044:0:6710:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.123@tcp lock: ffff9d0d59d6a200/0xafddb3c8f9281482 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xafddb3c8f9281489 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477263.277051:0:6710:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.123@tcp lock: ffff9d0d59d6a200/0xafddb3c8f9281482 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xafddb3c8f9281489 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789477263.277059:0:6710:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.123@tcp lock: ffff9d0d59d6a200/0xafddb3c8f9281482 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xafddb3c8f9281489 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789477263.277071:0:6710:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1789477263.277086:0:6710:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.123@tcp lock: ffff9d0d59d6a200/0xafddb3c8f9281482 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xafddb3c8f9281489 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477263.277092:0:6710:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789477263.277097:0:6710:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.123@tcp lock: ffff9d0d59d6a200/0xafddb3c8f9281482 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xafddb3c8f9281489 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477263.277105:0:6710:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.123@tcp lock: ffff9d0d59d6a200/0xafddb3c8f9281482 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xafddb3c8f9281489 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477263.277117:0:6710:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789477263.277120:0:6710:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789477263.277122:0:6710:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789477263.277141:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d4e643b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:07d5e05c-913f-419f-adbc-d3cf15e9cd51:3313:1876402802538496:0@lo:103: 00000100:00100000:0.0:1789477263.277549:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789477263.277961:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d4e643800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:07d5e05c-913f-419f-adbc-d3cf15e9cd51:3313:1876402802539008:0@lo:103: 00000100:00100000:0.0:1789477263.277999:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789477263.278079:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789477263.278088:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789477263.279222:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789477263.279238:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d4e640a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:07d5e05c-913f-419f-adbc-d3cf15e9cd51:3313:1876402802538880:0@lo:103: 00000100:00100000:0.0:1789477263.279286:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789477263.279472:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802538496 00000100:00100000:1.0:1789477263.279484:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802538496 00010000:00010000:1.0:1789477263.279533:0:5831:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9d0d49eca400/0xafddb3c8f928151c lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xafddb3c8f9281515 expref: 17 pid: 5838 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789477263.279592:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802539008 00000100:00100000:1.0:1789477263.279596:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802539008 00010000:00010000:1.0:1789477263.279612:0:5831:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9d0d49ecbe00/0xafddb3c8f9281489 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xafddb3c8f9281482 expref: 18 pid: 5837 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789477263.279633:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1789477263.279643:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d4e641880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:07d5e05c-913f-419f-adbc-d3cf15e9cd51+18:3313:x1876402802538496:12345-0@lo:103: 00010000:00010000:1.0:1789477263.279671:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789477263.279677:0:5831:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9d0d49eca400/0xafddb3c8f928151c lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xafddb3c8f9281515 expref: 18 pid: 5838 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477263.279690:0:5831:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9d0d49eca400/0xafddb3c8f928151c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xafddb3c8f9281515 expref: 18 pid: 5838 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477263.279729:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789477263.279767:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d4e641880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:07d5e05c-913f-419f-adbc-d3cf15e9cd51+18:3313:x1876402802538496:12345-0@lo:103: Request processed in 124us (2218us total) trans 0 rc 0/0 00000100:00100000:1.0:1789477263.279774:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1789477263.279792:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1789477263.279797:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d75368e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:07d5e05c-913f-419f-adbc-d3cf15e9cd51+17:3313:x1876402802539008:12345-0@lo:103: 00010000:00010000:1.0:1789477263.279805:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789477263.279809:0:5831:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9d0d49ecbe00/0xafddb3c8f9281489 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xafddb3c8f9281482 expref: 17 pid: 5837 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477263.279817:0:5831:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9d0d49ecbe00/0xafddb3c8f9281489 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xafddb3c8f9281482 expref: 17 pid: 5837 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477263.279836:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789477263.279857:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d75368e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:07d5e05c-913f-419f-adbc-d3cf15e9cd51+17:3313:x1876402802539008:12345-0@lo:103: Request processed in 60us (1859us total) trans 0 rc 0/0 00000100:00100000:1.0:1789477263.279863:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1789477263.280117:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d4e643b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:07d5e05c-913f-419f-adbc-d3cf15e9cd51:3313:1876402802538496:0@lo:103: 00000100:00100000:0.0:1789477263.280128:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d4e643800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:07d5e05c-913f-419f-adbc-d3cf15e9cd51:3313:1876402802539008:0@lo:103: 00000100:00100000:0.0:1789477263.280186:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d4e641500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:07d5e05c-913f-419f-adbc-d3cf15e9cd51:3310:1876402802538624:0@lo:103: 00000100:00100000:0.0:1789477263.280219:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789477263.280240:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789477263.280254:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d4e641f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:07d5e05c-913f-419f-adbc-d3cf15e9cd51:3310:1876402802538752:0@lo:103: 00000100:00100000:0.0:1789477263.280277:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789477263.280305:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802538880 00000100:00100000:0.0:1789477263.280309:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802538880 00010000:00010000:0.0:1789477263.280329:0:5829:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9d0d40030200/0xafddb3c8f9281497 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xafddb3c8f9281490 expref: 17 pid: 5837 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789477263.280344:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802538624 00000100:00100000:0.0:1789477263.280347:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802538624 00010000:00010000:0.0:1789477263.280357:0:5829:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9d0d59d6a000/0xafddb3c8f9281500 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xafddb3c8f92814f9 expref: 18 pid: 5837 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789477263.280367:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802538752 00000100:00100000:0.0:1789477263.280371:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802538752 00010000:00010000:0.0:1789477263.280380:0:5829:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9d0d49eca800/0xafddb3c8f92814d6 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xafddb3c8f92814cf expref: 19 pid: 5837 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789477263.280390:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1789477263.280395:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d75369180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:07d5e05c-913f-419f-adbc-d3cf15e9cd51+19:3313:x1876402802538880:12345-0@lo:103: 00010000:00010000:0.0:1789477263.280403:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789477263.280407:0:5829:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9d0d40030200/0xafddb3c8f9281497 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xafddb3c8f9281490 expref: 19 pid: 5837 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477263.280415:0:5829:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9d0d40030200/0xafddb3c8f9281497 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xafddb3c8f9281490 expref: 19 pid: 5837 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477263.280427:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789477263.280454:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d75369180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:07d5e05c-913f-419f-adbc-d3cf15e9cd51+19:3313:x1876402802538880:12345-0@lo:103: Request processed in 58us (1167us total) trans 0 rc 0/0 00000100:00100000:0.0:1789477263.280460:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1789477263.280473:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1789477263.280485:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d7536a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:07d5e05c-913f-419f-adbc-d3cf15e9cd51+18:3310:x1876402802538624:12345-0@lo:103: 00010000:00010000:0.0:1789477263.280493:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789477263.280497:0:5829:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9d0d59d6a000/0xafddb3c8f9281500 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xafddb3c8f92814f9 expref: 18 pid: 5837 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477263.280507:0:5829:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9d0d59d6a000/0xafddb3c8f9281500 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xafddb3c8f92814f9 expref: 18 pid: 5837 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477263.280516:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789477263.280554:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d7536a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:07d5e05c-913f-419f-adbc-d3cf15e9cd51+18:3310:x1876402802538624:12345-0@lo:103: Request processed in 69us (334us total) trans 0 rc 0/0 00000100:00100000:0.0:1789477263.280561:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1789477263.280600:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1789477263.280609:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d7536b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:07d5e05c-913f-419f-adbc-d3cf15e9cd51+17:3310:x1876402802538752:12345-0@lo:103: 00010000:00010000:0.0:1789477263.280617:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789477263.280622:0:5829:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9d0d49eca800/0xafddb3c8f92814d6 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xafddb3c8f92814cf expref: 17 pid: 5837 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477263.280631:0:5829:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9d0d49eca800/0xafddb3c8f92814d6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xafddb3c8f92814cf expref: 17 pid: 5837 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477263.280643:0:5829:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9d0d40031600/0xafddb3c8f9281562 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477263.280653:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d0d40031600/0xafddb3c8f9281562 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477263.280885:0:5829:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9d0d40031600/0xafddb3c8f9281562 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477263.280904:0:5829:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9d0d40031600/0xafddb3c8f9281562 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477263.280911:0:5829:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9d0d40031600/0xafddb3c8f9281562 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477263.280919:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9d0d40031600/0xafddb3c8f9281562 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477263.280926:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d0d40031600 already unused, calling callback (ffffffffc15972a0) 00010000:00010000:0.0:1789477263.280931:0:5829:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9d0d40031600/0xafddb3c8f9281562 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477263.280940:0:5829:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9d0d40031600/0xafddb3c8f9281562 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477263.280951:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9d0d40031600/0xafddb3c8f9281562 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477263.280963:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789477263.280988:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d7536b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:07d5e05c-913f-419f-adbc-d3cf15e9cd51+17:3310:x1876402802538752:12345-0@lo:103: Request processed in 381us (710us total) trans 0 rc 0/0 00000100:00100000:0.0:1789477263.280995:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1789477263.281026:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d4e641f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:07d5e05c-913f-419f-adbc-d3cf15e9cd51:3310:1876402802538752:0@lo:103: 00000100:00100000:0.0:1789477263.281035:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d4e641500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:07d5e05c-913f-419f-adbc-d3cf15e9cd51:3310:1876402802538624:0@lo:103: 00000100:00100000:0.0:1789477263.281057:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d4e640a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:07d5e05c-913f-419f-adbc-d3cf15e9cd51:3313:1876402802538880:0@lo:103: 00010000:00010000:0.0:1789477263.281081:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d0d49eca400/0xafddb3c8f928151c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xafddb3c8f9281515 expref: 16 pid: 5838 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789477263.281104:0:5839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d4e642a00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5839:1876402802537856:0@lo:104: 00010000:00010000:0.0:1789477263.281117:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d0d59d6a000/0xafddb3c8f9281500 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xafddb3c8f92814f9 expref: 15 pid: 5837 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789477263.281125:0:5839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d4e643480 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5839:1876402802537984:0@lo:104: 00010000:00010000:0.0:1789477263.281134:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d0d49eca800/0xafddb3c8f92814d6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xafddb3c8f92814cf expref: 14 pid: 5837 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789477263.281142:0:5839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d4e640000 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5839:1876402802538112:0@lo:104: 00010000:00010000:0.0:1789477263.281212:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d0d40030200/0xafddb3c8f9281497 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xafddb3c8f9281490 expref: 13 pid: 5837 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789477263.281223:0:5839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d4e640e00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5839:1876402802538240:0@lo:104: 00010000:00010000:0.0:1789477263.281233:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d0d49ecbe00/0xafddb3c8f9281489 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xafddb3c8f9281482 expref: 12 pid: 5837 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789477263.281242:0:5839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d4e642680 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5839:1876402802538368:0@lo:104: 00010000:00010000:0.0:1789477263.281261:0:5839:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9d0d40031600/0xafddb3c8f9281562 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477263.281271:0:5839:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9d0d40031600/0xafddb3c8f9281562 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477263.281278:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9d0d40031600/0xafddb3c8f9281562 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477263.281284:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d0d40031600/0xafddb3c8f9281562 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1789477263.281305:0:5839:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:3.0:1789477263.420519:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d4ec6f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:07d5e05c-913f-419f-adbc-d3cf15e9cd51+11:7660:x1876402802537728:12345-0@lo:253: Request processed in 190684us (190997us total) trans 0 rc 0/0 00000100:00100000:3.0:1789477263.420537:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1789477263.420686:0:7660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d7bdddf80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:07d5e05c-913f-419f-adbc-d3cf15e9cd51:7660:1876402802537728:0@lo:253: 10000000:01000000:2.0:1789477263.420703:0:7660:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:2.0:1789477263.420706:0:7660:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1789477263.420708:0:7660:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1789477263.420709:0:7660:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789477263.420711:0:7660:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0001_UUID 00000020:01000004:2.0:1789477263.420713:0:7660:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789477263.420714:0:7660:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789477263.420716:0:7660:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1789477263.420718:0:7660:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:2.0:1789477263.420720:0:7660:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789477263.420721:0:7660:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1789477263.420743:0:7660:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9d0d514ce000 from lustre-OST0001 10000000:01000000:2.0:1789477263.420769:0:7660:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:2.0:1789477263.420772:0:7660:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:2.0:1789477263.420781:0:7660:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9d0d482499b8 local copy 10000000:01000000:2.0:1789477263.420800:0:7660:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1789477263.420860:0:7660:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.123@tcp lock: ffff9d0d59d6a400/0xafddb3c8f9281569 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477263.420872:0:7660:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.201.123@tcp lock: ffff9d0d59d6a400/0xafddb3c8f9281569 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477263.420882:0:7660:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.123@tcp lock: ffff9d0d59d6a400/0xafddb3c8f9281569 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789477263.420901:0:7660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d7bdddf80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:07d5e05c-913f-419f-adbc-d3cf15e9cd51:7660:1876402802539136:0@lo:101: 00000100:00100000:2.0:1789477263.420940:0:7660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789477263.420996:0:7660:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d0d7f762000 going to sleep for 11 seconds 00000100:00100000:3.0:1789477263.421330:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802539136 00000100:00100000:3.0:1789477263.421340:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802539136 00000100:00100000:3.0:1789477263.421390:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1789477263.421399:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d4ec6ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07d5e05c-913f-419f-adbc-d3cf15e9cd51+11:7660:x1876402802539136:12345-0@lo:101: 00010000:00010000:3.0:1789477263.421414:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789477263.421429:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d0d49ecae00/0xafddb3c8f9281570 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xafddb3c8f9281569 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477263.421467:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d0d49ecae00/0xafddb3c8f9281570 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xafddb3c8f9281569 expref: 12 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477263.421478:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d0d49ecae00/0xafddb3c8f9281570 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xafddb3c8f9281569 expref: 12 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477263.421490:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d0d49ecae00, rc 0) 00000100:00100000:3.0:1789477263.421537:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d4ec6ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07d5e05c-913f-419f-adbc-d3cf15e9cd51+12:7660:x1876402802539136:12345-0@lo:101: Request processed in 138us (596us total) trans 0 rc 0/0 00000100:00100000:3.0:1789477263.421544:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1789477263.421667:0:7660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d7bdddf80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:07d5e05c-913f-419f-adbc-d3cf15e9cd51:7660:1876402802539136:0@lo:101: 00010000:00010000:0.0:1789477263.421681:0:7660:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.123@tcp lock: ffff9d0d59d6a400/0xafddb3c8f9281569 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0xafddb3c8f9281570 expref: -99 pid: 7660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477263.421691:0:7660:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.123@tcp lock: ffff9d0d59d6a400/0xafddb3c8f9281569 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xafddb3c8f9281570 expref: -99 pid: 7660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789477263.421796:0:7660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d75369c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:07d5e05c-913f-419f-adbc-d3cf15e9cd51:7660:1876402802539264:0@lo:501: 00000100:00100000:0.0:1789477263.421840:0:7660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789477263.421870:0:7660:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d0d59416d80 going to sleep for 11 seconds 00000100:00100000:3.0:1789477263.422026:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802539264 00000100:00100000:3.0:1789477263.422030:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802539264 00000100:00100000:3.0:1789477263.422062:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1789477263.422070:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d4ec6d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:07d5e05c-913f-419f-adbc-d3cf15e9cd51+12:7660:x1876402802539264:12345-0@lo:501: 00000100:00100000:3.0:1789477263.422429:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d4ec6d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:07d5e05c-913f-419f-adbc-d3cf15e9cd51+12:7660:x1876402802539264:12345-0@lo:501: Request processed in 358us (587us total) trans 0 rc -2/-2 00000100:00100000:3.0:1789477263.422437:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1789477263.422565:0:7660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d75369c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:07d5e05c-913f-419f-adbc-d3cf15e9cd51:7660:1876402802539264:0@lo:501: 10000000:01000000:0.0:1789477263.422604:0:7660:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.201.123@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:0.0:1789477263.422634:0:7660:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.201.123@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:0.0:1789477263.422640:0:7660:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.123@tcp lock: ffff9d0d59d6a400/0xafddb3c8f9281569 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xafddb3c8f9281570 expref: -99 pid: 7660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477263.422650:0:7660:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.123@tcp lock: ffff9d0d59d6a400/0xafddb3c8f9281569 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xafddb3c8f9281570 expref: -99 pid: 7660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477263.422658:0:7660:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.123@tcp lock: ffff9d0d59d6a400/0xafddb3c8f9281569 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xafddb3c8f9281570 expref: -99 pid: 7660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477263.422687:0:7660:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1789477263.422710:0:7660:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9d0d514ce000 10000000:01000000:0.0:1789477263.422716:0:7660:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1789477263.422722:0:7660:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:0.0:1789477263.422733:0:7660:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1789477263.422739:0:7660:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:0.0:1789477263.422742:0:7660:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:0.0:1789477263.422767:0:7660:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.123@tcp lock: ffff9d0d40031600/0xafddb3c8f9281577 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477263.422776:0:7660:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.123@tcp lock: ffff9d0d40031600/0xafddb3c8f9281577 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477263.422787:0:7660:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.123@tcp lock: ffff9d0d40031600/0xafddb3c8f9281577 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477263.422856:0:6710:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789477263.422865:0:6710:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.123@tcp lock: ffff9d0d59d6a400/0xafddb3c8f9281569 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x400000000 nid: local remote: 0xafddb3c8f9281570 expref: -99 pid: 7660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477263.422872:0:6710:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d0d59d6a400 already unused, calling callback (ffffffffc1bb3c20) 10000000:00010000:2.0:1789477263.422877:0:6710:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.123@tcp lock: ffff9d0d59d6a400/0xafddb3c8f9281569 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x400000000 nid: local remote: 0xafddb3c8f9281570 expref: -99 pid: 7660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477263.422885:0:6710:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.123@tcp lock: ffff9d0d59d6a400/0xafddb3c8f9281569 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x8400000000 nid: local remote: 0xafddb3c8f9281570 expref: -99 pid: 7660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789477263.422891:0:6710:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.123@tcp lock: ffff9d0d59d6a400/0xafddb3c8f9281569 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x9400000000 nid: local remote: 0xafddb3c8f9281570 expref: -99 pid: 7660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789477263.422897:0:6710:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1789477263.422917:0:6710:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.123@tcp lock: ffff9d0d59d6a400/0xafddb3c8f9281569 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x4809400000020 nid: local remote: 0xafddb3c8f9281570 expref: -99 pid: 7660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477263.422934:0:6710:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789477263.422969:0:6710:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.123@tcp lock: ffff9d0d59d6a400/0xafddb3c8f9281569 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x4809400000020 nid: local remote: 0xafddb3c8f9281570 expref: -99 pid: 7660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477263.422975:0:6710:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.123@tcp lock: ffff9d0d59d6a400/0xafddb3c8f9281569 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x4809400000020 nid: local remote: 0xafddb3c8f9281570 expref: -99 pid: 7660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477263.422990:0:6710:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789477263.422991:0:6710:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789477263.422993:0:6710:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789477263.423045:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d7bddd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:07d5e05c-913f-419f-adbc-d3cf15e9cd51:3310:1876402802539520:0@lo:103: 00000100:00100000:1.0:1789477263.423085:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789477263.423235:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802539520 00000100:00100000:2.0:1789477263.423241:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802539520 00000100:00100000:2.0:1789477263.423295:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789477263.423303:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d7f73b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:07d5e05c-913f-419f-adbc-d3cf15e9cd51+12:3310:x1876402802539520:12345-0@lo:103: 00010000:00010000:2.0:1789477263.423315:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789477263.423328:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d0d49ecae00/0xafddb3c8f9281570 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xafddb3c8f9281569 expref: 12 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477263.423342:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789477263.423377:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d7f73b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:07d5e05c-913f-419f-adbc-d3cf15e9cd51+11:3310:x1876402802539520:12345-0@lo:103: Request processed in 75us (291us total) trans 0 rc 0/0 00000100:00100000:2.0:1789477263.423384:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789477263.423411:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d7bddd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:07d5e05c-913f-419f-adbc-d3cf15e9cd51:3310:1876402802539520:0@lo:103: 00000100:00100000:0.0:1789477263.423533:0:7660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d75369c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:07d5e05c-913f-419f-adbc-d3cf15e9cd51:7660:1876402802539392:0@lo:101: 00000100:00100000:0.0:1789477263.423562:0:7660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789477263.423618:0:7660:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d0d59416300 going to sleep for 11 seconds 00000100:00100000:2.0:1789477263.423713:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802539392 00000100:00100000:2.0:1789477263.423718:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802539392 00000100:00100000:2.0:1789477263.423744:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1789477263.423751:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d4ec6e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07d5e05c-913f-419f-adbc-d3cf15e9cd51+11:7660:x1876402802539392:12345-0@lo:101: 00010000:00010000:2.0:1789477263.423772:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789477263.423785:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d0d59d6b600/0xafddb3c8f928157e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xafddb3c8f9281577 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477263.423802:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d0d59d6b600/0xafddb3c8f928157e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xafddb3c8f9281577 expref: 12 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477263.423813:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d0d59d6b600/0xafddb3c8f928157e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xafddb3c8f9281577 expref: 12 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477263.423820:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d0d59d6b600, rc 0) 00000100:00100000:2.0:1789477263.423859:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d4ec6e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07d5e05c-913f-419f-adbc-d3cf15e9cd51+12:7660:x1876402802539392:12345-0@lo:101: Request processed in 109us (296us total) trans 0 rc 0/0 00000100:00100000:2.0:1789477263.423865:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1789477263.424037:0:7660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d75369c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:07d5e05c-913f-419f-adbc-d3cf15e9cd51:7660:1876402802539392:0@lo:101: 00010000:00010000:0.0:1789477263.424050:0:7660:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.123@tcp lock: ffff9d0d40031600/0xafddb3c8f9281577 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xafddb3c8f928157e expref: -99 pid: 7660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477263.424059:0:7660:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.123@tcp lock: ffff9d0d40031600/0xafddb3c8f9281577 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xafddb3c8f928157e expref: -99 pid: 7660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789477263.424221:0:7660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d75369c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:07d5e05c-913f-419f-adbc-d3cf15e9cd51:7660:1876402802539648:0@lo:501: 00000100:00100000:0.0:1789477263.424261:0:7660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789477263.424315:0:7660:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d0d59416300 going to sleep for 11 seconds 00000100:00100000:3.0:1789477263.426682:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802539648 00000100:00100000:3.0:1789477263.426701:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802539648 00000100:00100000:2.0:1789477263.426896:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1789477263.426907:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d4ec6dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:07d5e05c-913f-419f-adbc-d3cf15e9cd51+12:7660:x1876402802539648:12345-0@lo:501: 00000100:00100000:2.0:1789477263.427370:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d4ec6dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:07d5e05c-913f-419f-adbc-d3cf15e9cd51+12:7660:x1876402802539648:12345-0@lo:501: Request processed in 464us (3116us total) trans 0 rc 0/0 00000100:00100000:2.0:1789477263.427379:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1789477263.427531:0:7660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d75369c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:07d5e05c-913f-419f-adbc-d3cf15e9cd51:7660:1876402802539648:0@lo:501: 00000100:00100000:1.0:1789477263.427627:0:7660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d7f738000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:07d5e05c-913f-419f-adbc-d3cf15e9cd51:7660:1876402802539776:0@lo:503: 00000100:00100000:1.0:1789477263.427680:0:7660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789477263.427711:0:7660:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d0d7fad2f00 going to sleep for 11 seconds 00000100:00100000:2.0:1789477263.427798:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802539776 00000100:00100000:2.0:1789477263.427804:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802539776 00000100:00100000:2.0:1789477263.427847:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1789477263.427855:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d4ec6fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07d5e05c-913f-419f-adbc-d3cf15e9cd51+12:7660:x1876402802539776:12345-0@lo:503: 00000100:00100000:2.0:1789477263.428020:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d4ec6fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07d5e05c-913f-419f-adbc-d3cf15e9cd51+12:7660:x1876402802539776:12345-0@lo:503: Request processed in 165us (339us total) trans 0 rc 0/0 00000100:00100000:2.0:1789477263.428027:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1789477263.428126:0:7660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d7f738000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:07d5e05c-913f-419f-adbc-d3cf15e9cd51:7660:1876402802539776:0@lo:503: 00000040:00080000:1.0:1789477263.428548:0:7660:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1789477263.428655:0:7660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d7f738000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:07d5e05c-913f-419f-adbc-d3cf15e9cd51:7660:1876402802539904:0@lo:502: 00000100:00100000:1.0:1789477263.428698:0:7660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789477263.428724:0:7660:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d0d7fad2f00 going to sleep for 11 seconds 00000100:00100000:0.0:1789477263.428933:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802539904 00000100:00100000:0.0:1789477263.428940:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802539904 00000100:00100000:0.0:1789477263.428974:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1789477263.428982:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d4ec6f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07d5e05c-913f-419f-adbc-d3cf15e9cd51+12:7660:x1876402802539904:12345-0@lo:502: 00000100:00100000:0.0:1789477263.429158:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d4ec6f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07d5e05c-913f-419f-adbc-d3cf15e9cd51+12:7660:x1876402802539904:12345-0@lo:502: Request processed in 164us (446us total) trans 0 rc 0/0 00000100:00100000:0.0:1789477263.429164:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1789477263.429356:0:7660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d7f738000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:07d5e05c-913f-419f-adbc-d3cf15e9cd51:7660:1876402802539904:0@lo:502: 00000040:00080000:1.0:1789477263.429651:0:7660:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:1.0:1789477263.429702:0:7660:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:1.0:1789477263.429736:0:7660:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:1.0:1789477263.429783:0:7660:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:1.0:1789477263.429819:0:7660:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:1.0:1789477263.429867:0:7660:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:1.0:1789477263.429894:0:7660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d7f738000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:07d5e05c-913f-419f-adbc-d3cf15e9cd51:7660:1876402802540032:0@lo:502: 00000100:00100000:1.0:1789477263.429933:0:7660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789477263.429957:0:7660:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d0d7fad2f00 going to sleep for 11 seconds 00000100:00100000:2.0:1789477263.430265:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802540032 00000100:00100000:2.0:1789477263.430271:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802540032 00000100:00100000:2.0:1789477263.430382:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1789477263.430389:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d595f4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07d5e05c-913f-419f-adbc-d3cf15e9cd51+12:7660:x1876402802540032:12345-0@lo:502: 00000100:00100000:2.0:1789477263.430549:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d595f4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07d5e05c-913f-419f-adbc-d3cf15e9cd51+12:7660:x1876402802540032:12345-0@lo:502: Request processed in 160us (614us total) trans 0 rc 0/0 00000100:00100000:2.0:1789477263.430556:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1789477263.432475:0:7660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d7f738000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:07d5e05c-913f-419f-adbc-d3cf15e9cd51:7660:1876402802540032:0@lo:502: 00000040:00080000:0.0:1789477263.433785:0:7660:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:0.0:1789477263.433808:0:7660:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 7 count 8 00000020:01000000:3.0:1789477263.435717:0:7669:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1789477263.435731:0:7669:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-ost2/ost2 00000020:00000080:3.0:1789477263.435739:0:7669:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789477263.435742:0:7669:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-OST0001 add ost 00000020:00000080:3.0:1789477263.435749:0:7669:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1789477263.435769:0:7669:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff9d0d584799b8) 00000020:00000080:3.0:1789477263.435802:0:7669:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type obdfilter with refcount 2 00000020:00000080:3.0:1789477263.435808:0:7669:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1789477263.435889:0:7669:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9d0d514ce000 from lustre-OST0001, refs=2 00080000:01000000:3.0:1789477263.435898:0:7669:0:(osd_handler.c:1564:osd_obd_connect()) connect #1 00000020:00000080:3.0:1789477263.435918:0:7669:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xafddb3c8f928158c 00010000:00010000:2.0:1789477263.439376:0:7669:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-3 is initialized 00000001:02000400:2.0:1789477263.439764:0:7669:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0001: new disk, initializing 00000001:00000004:2.0:1789477263.443923:0:7669:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 0 40000000:02000000:2.0:1789477263.447175:0:7669:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0001: No data found on store. Initialize space. 00080000:10000000:0.0:1789477263.453522:0:7669:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000001:0x3:0x0] (8/8/3) registered 00080000:10000000:0.0:1789477263.454369:0:7669:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000020:00000080:0.0:1789477263.455964:0:7669:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:0.0:1789477263.455979:0:7669:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789477263.455986:0:7669:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789477263.455988:0:7669:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-OST0001 add ost 00000020:01000000:0.0:1789477263.455993:0:7669:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789477263.455998:0:7669:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789477263.455999:0:7669:0:(obd_config.c:1563:class_process_config()) marker 22 (0x1) lustre sys.timeout 00000020:00000080:0.0:1789477263.456002:0:7669:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1789477263.456005:0:7669:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1789477263.456062:0:7669:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789477263.456066:0:7669:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789477263.456068:0:7669:0:(obd_config.c:1563:class_process_config()) marker 22 (0x2) lustre sys.timeout 00000040:00080000:0.0:1789477263.456071:0:7669:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:2.0:1789477263.457457:0:7660:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-7 (rc=0) 10000000:01000000:2.0:1789477263.457495:0:7660:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.123@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:2.0:1789477263.457519:0:7660:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.123@tcp lock: ffff9d0d40031600/0xafddb3c8f9281577 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xafddb3c8f928157e expref: -99 pid: 7660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477263.457534:0:7660:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.123@tcp lock: ffff9d0d40031600/0xafddb3c8f9281577 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xafddb3c8f928157e expref: -99 pid: 7660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789477263.457543:0:7660:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9d0d514ce000 from 1 10000000:01000000:2.0:1789477263.457545:0:7660:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1789477263.457625:0:7660:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.123@tcp lock: ffff9d0d59d6a400/0xafddb3c8f9281593 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477263.457634:0:7660:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.123@tcp lock: ffff9d0d59d6a400/0xafddb3c8f9281593 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477263.457645:0:7660:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.123@tcp lock: ffff9d0d59d6a400/0xafddb3c8f9281593 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789477263.457670:0:7660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d7bddd500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:07d5e05c-913f-419f-adbc-d3cf15e9cd51:7660:1876402802540160:0@lo:101: 00000100:00100000:2.0:1789477263.457761:0:7660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789477263.457805:0:7660:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d0d7f762240 going to sleep for 11 seconds 00000100:00100000:3.0:1789477263.457926:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802540160 00000100:00100000:3.0:1789477263.457935:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802540160 00000100:00100000:3.0:1789477263.457988:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1789477263.457998:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d595f7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07d5e05c-913f-419f-adbc-d3cf15e9cd51+12:7660:x1876402802540160:12345-0@lo:101: 00010000:00010000:3.0:1789477263.458012:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789477263.458025:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d0d49eca600/0xafddb3c8f928159a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xafddb3c8f9281593 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477263.458050:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d0d49eca600/0xafddb3c8f928159a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xafddb3c8f9281593 expref: 13 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477263.458061:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d0d49eca600/0xafddb3c8f928159a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xafddb3c8f9281593 expref: 13 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477263.458070:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d0d49eca600, rc 0) 00000100:00100000:3.0:1789477263.458108:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d595f7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07d5e05c-913f-419f-adbc-d3cf15e9cd51+13:7660:x1876402802540160:12345-0@lo:101: Request processed in 111us (348us total) trans 0 rc 0/0 00000100:00100000:3.0:1789477263.458115:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1789477263.458631:0:7660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d7bddd500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:07d5e05c-913f-419f-adbc-d3cf15e9cd51:7660:1876402802540160:0@lo:101: 00010000:00010000:2.0:1789477263.458652:0:7660:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.123@tcp lock: ffff9d0d59d6a400/0xafddb3c8f9281593 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xafddb3c8f928159a expref: -99 pid: 7660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477263.458663:0:7660:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.123@tcp lock: ffff9d0d59d6a400/0xafddb3c8f9281593 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xafddb3c8f928159a expref: -99 pid: 7660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789477263.458778:0:7660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d7bddd500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:07d5e05c-913f-419f-adbc-d3cf15e9cd51:7660:1876402802540288:0@lo:501: 00000100:00100000:2.0:1789477263.458813:0:7660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789477263.458850:0:7660:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d0d7f762240 going to sleep for 11 seconds 00000100:00100000:1.0:1789477263.458913:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802540288 00000100:00100000:1.0:1789477263.458917:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802540288 00000100:00100000:1.0:1789477263.458954:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1789477263.458962:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d595f6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07d5e05c-913f-419f-adbc-d3cf15e9cd51+13:7660:x1876402802540288:12345-0@lo:501: 00000100:00100000:1.0:1789477263.459204:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d595f6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07d5e05c-913f-419f-adbc-d3cf15e9cd51+13:7660:x1876402802540288:12345-0@lo:501: Request processed in 241us (388us total) trans 0 rc 0/0 00000100:00100000:1.0:1789477263.459211:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1789477263.459249:0:7660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d7bddd500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:07d5e05c-913f-419f-adbc-d3cf15e9cd51:7660:1876402802540288:0@lo:501: 00000100:00100000:1.0:1789477263.459277:0:7660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d7f738000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:07d5e05c-913f-419f-adbc-d3cf15e9cd51:7660:1876402802540416:0@lo:503: 00000100:00100000:1.0:1789477263.459314:0:7660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789477263.459327:0:7660:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d0d7fad2a80 going to sleep for 11 seconds 00000100:00100000:2.0:1789477263.459449:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802540416 00000100:00100000:2.0:1789477263.459453:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802540416 00000100:00100000:2.0:1789477263.459484:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1789477263.459491:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d595f4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07d5e05c-913f-419f-adbc-d3cf15e9cd51+13:7660:x1876402802540416:12345-0@lo:503: 00000100:00100000:2.0:1789477263.459818:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d595f4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07d5e05c-913f-419f-adbc-d3cf15e9cd51+13:7660:x1876402802540416:12345-0@lo:503: Request processed in 326us (503us total) trans 0 rc 0/0 00000100:00100000:2.0:1789477263.459837:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1789477263.460015:0:7660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d7f738000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:07d5e05c-913f-419f-adbc-d3cf15e9cd51:7660:1876402802540416:0@lo:503: 00000040:00080000:1.0:1789477263.460396:0:7660:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1789477263.460473:0:7660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d7f738000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:07d5e05c-913f-419f-adbc-d3cf15e9cd51:7660:1876402802540544:0@lo:502: 00000100:00100000:1.0:1789477263.460515:0:7660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789477263.460608:0:7660:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d0d7fad2a80 going to sleep for 11 seconds 00000100:00100000:2.0:1789477263.467714:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802540544 00000100:00100000:2.0:1789477263.467734:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802540544 00000100:00100000:3.0:1789477263.467969:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1789477263.467982:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d595f7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07d5e05c-913f-419f-adbc-d3cf15e9cd51+13:7660:x1876402802540544:12345-0@lo:502: 00000100:00100000:3.0:1789477263.468332:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d595f7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07d5e05c-913f-419f-adbc-d3cf15e9cd51+13:7660:x1876402802540544:12345-0@lo:502: Request processed in 351us (7815us total) trans 0 rc 0/0 00000100:00100000:3.0:1789477263.468340:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1789477263.468411:0:7660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d7f738000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:07d5e05c-913f-419f-adbc-d3cf15e9cd51:7660:1876402802540544:0@lo:502: 00000040:00080000:3.0:1789477263.468756:0:7660:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:3.0:1789477263.468817:0:7660:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:3.0:1789477263.468871:0:7660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d58244380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:07d5e05c-913f-419f-adbc-d3cf15e9cd51:7660:1876402802540672:0@lo:502: 00000100:00100000:3.0:1789477263.468928:0:7660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789477263.468964:0:7660:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d0d58511f00 going to sleep for 11 seconds 00000100:00100000:3.0:1789477263.468988:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802540672 00000100:00100000:3.0:1789477263.468994:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802540672 00000100:00100000:3.0:1789477263.469019:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1789477263.469024:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d595f6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07d5e05c-913f-419f-adbc-d3cf15e9cd51+13:7660:x1876402802540672:12345-0@lo:502: 00000100:00100000:3.0:1789477263.469159:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d595f6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07d5e05c-913f-419f-adbc-d3cf15e9cd51+13:7660:x1876402802540672:12345-0@lo:502: Request processed in 133us (230us total) trans 0 rc 0/0 00000100:00100000:3.0:1789477263.469166:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1789477263.469209:0:7660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d58244380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:07d5e05c-913f-419f-adbc-d3cf15e9cd51:7660:1876402802540672:0@lo:502: 00000040:00080000:3.0:1789477263.469285:0:7660:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:3.0:1789477263.469295:0:7660:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:0.0:1789477263.470969:0:7673:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789477263.470986:0:7673:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789477263.470988:0:7673:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1789477263.470997:0:7673:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9d0d514ce000 00000020:00000080:0.0:1789477263.471000:0:7673:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1789477263.471021:0:7673:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789477263.471024:0:7673:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789477263.471026:0:7673:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:0.0:1789477263.471029:0:7673:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:2.0:1789477263.471239:0:7660:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:2.0:1789477263.471265:0:7660:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.123@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1789477263.471284:0:7660:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.123@tcp lock: ffff9d0d59d6a400/0xafddb3c8f9281593 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xafddb3c8f928159a expref: -99 pid: 7660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477263.471296:0:7660:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.123@tcp lock: ffff9d0d59d6a400/0xafddb3c8f9281593 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xafddb3c8f928159a expref: -99 pid: 7660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789477263.471363:0:7660:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1789477263.471367:0:7660:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9d0d514ce000 10000000:01000000:2.0:1789477263.471370:0:7660:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9d0d514ce000 10000000:01000000:2.0:1789477263.471375:0:7660:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1789477263.471381:0:7660:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9d0d514ce000 from 1 10000000:01000000:2.0:1789477263.471384:0:7660:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1789477263.471429:0:7660:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.123@tcp lock: ffff9d0d59d6a000/0xafddb3c8f92815a1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477263.471439:0:7660:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.123@tcp lock: ffff9d0d59d6a000/0xafddb3c8f92815a1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477263.471451:0:7660:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.123@tcp lock: ffff9d0d59d6a000/0xafddb3c8f92815a1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789477263.471479:0:7660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d7bdde300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:07d5e05c-913f-419f-adbc-d3cf15e9cd51:7660:1876402802540800:0@lo:101: 00000100:00100000:2.0:1789477263.471548:0:7660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789477263.471614:0:7660:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d0d7f762900 going to sleep for 11 seconds 00000100:00100000:3.0:1789477263.471782:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802540800 00000100:00100000:3.0:1789477263.471791:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802540800 00000100:00100000:3.0:1789477263.471853:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1789477263.471863:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d595f5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07d5e05c-913f-419f-adbc-d3cf15e9cd51+13:7660:x1876402802540800:12345-0@lo:101: 00010000:00010000:3.0:1789477263.471875:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789477263.471888:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d0d49ecb400/0xafddb3c8f92815a8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xafddb3c8f92815a1 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477263.471910:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d0d49ecb400/0xafddb3c8f92815a8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xafddb3c8f92815a1 expref: 14 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477263.471921:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d0d49ecb400/0xafddb3c8f92815a8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xafddb3c8f92815a1 expref: 14 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477263.471930:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d0d49ecb400, rc 0) 00000100:00100000:3.0:1789477263.471979:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d595f5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07d5e05c-913f-419f-adbc-d3cf15e9cd51+14:7660:x1876402802540800:12345-0@lo:101: Request processed in 117us (431us total) trans 0 rc 0/0 00000100:00100000:3.0:1789477263.471994:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1789477263.473338:0:7660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d7bdde300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:07d5e05c-913f-419f-adbc-d3cf15e9cd51:7660:1876402802540800:0@lo:101: 00010000:00010000:0.0:1789477263.473363:0:7660:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.123@tcp lock: ffff9d0d59d6a000/0xafddb3c8f92815a1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xafddb3c8f92815a8 expref: -99 pid: 7660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477263.473382:0:7660:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.123@tcp lock: ffff9d0d59d6a000/0xafddb3c8f92815a1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xafddb3c8f92815a8 expref: -99 pid: 7660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789477263.473494:0:7660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d7536aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:07d5e05c-913f-419f-adbc-d3cf15e9cd51:7660:1876402802540928:0@lo:501: 00000100:00100000:0.0:1789477263.473541:0:7660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789477263.473570:0:7660:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d0d594163c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789477263.473656:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802540928 00000100:00100000:2.0:1789477263.473662:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802540928 00000100:00100000:2.0:1789477263.473711:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1789477263.473720:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d595f6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:07d5e05c-913f-419f-adbc-d3cf15e9cd51+14:7660:x1876402802540928:12345-0@lo:501: 00000100:00100000:2.0:1789477263.473987:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d595f6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:07d5e05c-913f-419f-adbc-d3cf15e9cd51+14:7660:x1876402802540928:12345-0@lo:501: Request processed in 267us (444us total) trans 0 rc 0/0 00000100:00100000:2.0:1789477263.473995:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1789477263.474071:0:7660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d7536aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:07d5e05c-913f-419f-adbc-d3cf15e9cd51:7660:1876402802540928:0@lo:501: 00000100:00100000:0.0:1789477263.474101:0:7660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d7536aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:07d5e05c-913f-419f-adbc-d3cf15e9cd51:7660:1876402802541056:0@lo:503: 00000100:00100000:0.0:1789477263.474137:0:7660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789477263.475288:0:7660:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d0d594163c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789477263.475367:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802541056 00000100:00100000:3.0:1789477263.475375:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802541056 00000100:00100000:3.0:1789477263.475427:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1789477263.475437:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d595f5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07d5e05c-913f-419f-adbc-d3cf15e9cd51+14:7660:x1876402802541056:12345-0@lo:503: 00000100:00100000:3.0:1789477263.475658:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d595f5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07d5e05c-913f-419f-adbc-d3cf15e9cd51+14:7660:x1876402802541056:12345-0@lo:503: Request processed in 222us (1520us total) trans 0 rc 0/0 00000100:00100000:3.0:1789477263.475665:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1789477263.475720:0:7660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d7536aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:07d5e05c-913f-419f-adbc-d3cf15e9cd51:7660:1876402802541056:0@lo:503: 00000040:00080000:3.0:1789477263.476047:0:7660:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1789477263.476124:0:7660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d58244380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:07d5e05c-913f-419f-adbc-d3cf15e9cd51:7660:1876402802541184:0@lo:502: 00000100:00100000:3.0:1789477263.478326:0:7660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789477263.478371:0:7660:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d0d58511e40 going to sleep for 11 seconds 00000100:00100000:0.0:1789477263.478886:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802541184 00000100:00100000:0.0:1789477263.478895:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802541184 00000100:00100000:0.0:1789477263.478940:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1789477263.478950:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d595f7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:07d5e05c-913f-419f-adbc-d3cf15e9cd51+14:7660:x1876402802541184:12345-0@lo:502: 00000100:00100000:0.0:1789477263.479232:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d595f7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:07d5e05c-913f-419f-adbc-d3cf15e9cd51+14:7660:x1876402802541184:12345-0@lo:502: Request processed in 282us (910us total) trans 0 rc 0/0 00000100:00100000:0.0:1789477263.479240:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1789477263.480368:0:7660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d58244380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:07d5e05c-913f-419f-adbc-d3cf15e9cd51:7660:1876402802541184:0@lo:502: 00000040:00080000:3.0:1789477263.480738:0:7660:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:3.0:1789477263.480801:0:7660:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:3.0:1789477263.480885:0:7660:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:3.0:1789477263.480935:0:7660:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:3.0:1789477263.480970:0:7660:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:3.0:1789477263.481013:0:7660:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:3.0:1789477263.481048:0:7660:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:3.0:1789477263.481080:0:7660:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:3.0:1789477263.481222:0:7660:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:3.0:1789477263.481263:0:7660:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:3.0:1789477263.481296:0:7660:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:3.0:1789477263.481492:0:7660:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:3.0:1789477263.481533:0:7660:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:3.0:1789477263.481567:0:7660:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:3.0:1789477263.481776:0:7660:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:3.0:1789477263.481815:0:7660:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:3.0:1789477263.481864:0:7660:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:3.0:1789477263.481924:0:7660:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:3.0:1789477263.481963:0:7660:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:3.0:1789477263.481994:0:7660:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:3.0:1789477263.482040:0:7660:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:3.0:1789477263.482074:0:7660:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:3.0:1789477263.482104:0:7660:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:3.0:1789477263.483321:0:7660:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:3.0:1789477263.483389:0:7660:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 128 off12440 00000040:00080000:3.0:1789477263.483422:0:7660:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12664 00000040:00080000:3.0:1789477263.483469:0:7660:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12888 00000040:00080000:3.0:1789477263.483501:0:7660:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off12968 00000040:00080000:3.0:1789477263.483533:0:7660:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13192 00000040:00080000:3.0:1789477263.484299:0:7660:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13416 00000040:00080000:3.0:1789477263.484358:0:7660:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 88 off13504 00000040:00080000:3.0:1789477263.484393:0:7660:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 128 off13632 00000040:00080000:3.0:1789477263.484426:0:7660:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 144 off13776 00000040:00080000:3.0:1789477263.484474:0:7660:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 128 off13904 00000040:00080000:3.0:1789477263.484509:0:7660:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 224 off14128 00000040:00080000:3.0:1789477263.484555:0:7660:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14352 00000040:00080000:3.0:1789477263.485757:0:7660:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 80 off14432 00000100:00100000:3.0:1789477263.485837:0:7660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d58244380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:07d5e05c-913f-419f-adbc-d3cf15e9cd51:7660:1876402802541312:0@lo:502: 00000100:00100000:3.0:1789477263.485934:0:7660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789477263.486026:0:7660:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d0d58511e40 going to sleep for 11 seconds 00000100:00100000:0.0:1789477263.490485:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802541312 00000100:00100000:0.0:1789477263.490501:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802541312 00000100:00100000:0.0:1789477263.490557:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1789477263.490566:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d595f7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:07d5e05c-913f-419f-adbc-d3cf15e9cd51+14:7660:x1876402802541312:12345-0@lo:502: 00000100:00100000:0.0:1789477263.491229:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d595f7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:07d5e05c-913f-419f-adbc-d3cf15e9cd51+14:7660:x1876402802541312:12345-0@lo:502: Request processed in 663us (5294us total) trans 0 rc 0/0 00000100:00100000:0.0:1789477263.491238:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1789477263.492401:0:7660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d58244380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:07d5e05c-913f-419f-adbc-d3cf15e9cd51:7660:1876402802541312:0@lo:502: 00000040:00080000:3.0:1789477263.492537:0:7660:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 224 off14656 00000040:00080000:3.0:1789477263.492556:0:7660:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 38 count 39 00000020:01000004:3.0:1789477263.494272:0:7674:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:3.0:1789477263.494401:0:7674:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff9d0d7c0719b8) 00000020:00000080:3.0:1789477263.494432:0:7674:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type lwp with refcount 2 00000020:01000004:3.0:1789477263.494516:0:7674:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9d0d514ce000 from lustre-OST0001, refs=3 00000020:01000004:3.0:1789477263.494521:0:7674:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9d0d514ce000 from lustre-OST0001, refs=3 00000020:01000004:3.0:1789477263.494523:0:7674:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9d0d514ce000 3 00010000:00080000:3.0:1789477263.494553:0:7674:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9d0d75358800@lustre-MDT0000-lwp-OST0001: add connection 192.168.201.123@tcp at head 00010000:00010000:3.0:1789477263.501411:0:7674:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-4 is initialized 00000020:00000080:3.0:1789477263.501712:0:7674:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:3.0:1789477263.501754:0:7674:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1789477263.501771:0:7674:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0xafddb3c8f92815b6 00000100:00080000:3.0:1789477263.501784:0:7674:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1789477263.501796:0:7674:0:(import.c:625:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9d0d75358800 using connection 192.168.201.123@tcp/0@lo 00000100:00100000:3.0:1789477263.501849:0:7674:0:(import.c:827:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9d0d58244380 x1876402802541440/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1789477263.501872:0:7674:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00100000:1.0:1789477263.502922:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789477263.502947:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d7f738380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3310:1876402802541568:0@lo:400: 00000100:00100000:1.0:1789477263.503020:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789477263.503070:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802541568 00000100:00100000:1.0:1789477263.503077:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802541568 00000100:00100000:1.0:1789477263.503120:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1789477263.503129:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d7f739180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1876402802541568:12345-0@lo:400: 00000100:00100000:1.0:1789477263.503193:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d7f739180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1876402802541568:12345-0@lo:400: Request processed in 64us (172us total) trans 0 rc 0/0 00000100:00100000:1.0:1789477263.503201:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00080000:1.0:1789477263.503238:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9d0d7f738380 x1876402802541568/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789477279 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789477263.503258:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d7f738380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3310:1876402802541568:0@lo:400: 00000100:00100000:2.0:1789477263.503412:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d58244380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3309:1876402802541440:0@lo:38: 00000100:00100000:2.0:1789477263.503450:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789477263.506329:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802541440 00000100:00100000:3.0:1789477263.506346:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802541440 00000100:00100000:3.0:1789477263.506393:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789477263.506402:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d7bdde300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3309:x1876402802541440:12345-0@lo:38: 00010000:00080000:3.0:1789477263.506431:0:5844:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 208 last 0 00000020:00000080:3.0:1789477263.506474:0:5844:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0xafddb3c8f92815bd 00000004:00100000:3.0:1789477263.506492:0:5844:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1789477263.506532:0:5844:0:(import.c:65:import_set_state_nolock()) ffff9d0d6ec4c800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789477263.506633:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d7bdde300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1876402802541440:12345-0@lo:38: Request processed in 230us (3181us total) trans 0 rc 0/0 00000100:00100000:3.0:1789477263.506640:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:3.0:1789477263.506690:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9d0d58244380 x1876402802541440/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789477273 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789477263.506701:0:3309:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:3.0:1789477263.506724:0:3309:0:(import.c:1133:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 1 00000100:00080000:3.0:1789477263.506733:0:3309:0:(import.c:957:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:3.0:1789477263.506737:0:3309:0:(import.c:1214:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1789477263.506740:0:3309:0:(import.c:65:import_set_state_nolock()) ffff9d0d75358800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1789477263.506746:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d58244380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3309:1876402802541440:0@lo:38: 00000100:00100000:2.0:1789477263.506982:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d7f739c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1876402802541696:0@lo:400: 00000100:00100000:2.0:1789477263.507024:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789477263.507062:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789477263.507069:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d7f73b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3312:1876402802541824:0@lo:400: 00000100:00100000:2.0:1789477263.507091:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789477263.507236:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802541824 00000100:00100000:1.0:1789477263.507241:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802541824 00000100:00100000:1.0:1789477263.507289:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1789477263.507297:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d7bdddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1876402802541824:12345-0@lo:400: 00000100:00100000:1.0:1789477263.507338:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d7bdddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1876402802541824:12345-0@lo:400: Request processed in 42us (245us total) trans 0 rc 0/0 00000100:00100000:1.0:1789477263.507344:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00080000:1.0:1789477263.507368:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9d0d7f73b100 x1876402802541824/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789477279 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789477263.507391:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d7f73b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3312:1876402802541824:0@lo:400: 00000100:00080000:2.0:1789477263.507449:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789477263.508277:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802541696 00000100:00100000:3.0:1789477263.508286:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802541696 00000100:00100000:3.0:1789477263.508348:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789477263.508357:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d7bddd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3312:x1876402802541696:12345-0@lo:400: 00000100:00100000:3.0:1789477263.508411:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d7bddd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3312:x1876402802541696:12345-0@lo:400: Request processed in 56us (1387us total) trans 0 rc 0/0 00000100:00100000:3.0:1789477263.508419:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1789477263.508464:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9d0d7f739c00 x1876402802541696/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789477279 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789477263.508476:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d7f739c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1876402802541696:0@lo:400: 00000040:00080000:3.0:1789477263.508668:0:7674:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000100:00100000:3.0:1789477263.508835:0:7675:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d58244380 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:7675:1876402802541952:0@lo:901: 00000100:00100000:3.0:1789477263.508870:0:7675:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789477263.508890:0:7675:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d0d58511300 going to sleep for 11 seconds 00000100:00080000:2.0:1789477263.509044:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000020:01000000:1.0:1789477263.509672:0:7660:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-38 (rc=0) 10000000:01000000:1.0:1789477263.509703:0:7660:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.123@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1789477263.509729:0:7660:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.123@tcp lock: ffff9d0d59d6a000/0xafddb3c8f92815a1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xafddb3c8f92815a8 expref: -99 pid: 7660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477263.509741:0:7660:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.123@tcp lock: ffff9d0d59d6a000/0xafddb3c8f92815a1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xafddb3c8f92815a8 expref: -99 pid: 7660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1789477263.509791:0:7660:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1789477263.509794:0:7660:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1789477263.509795:0:7660:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789477263.509796:0:7660:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789477263.509798:0:7660:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789477263.509800:0:7660:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789477263.509801:0:7660:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1789477263.509803:0:7660:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1789477263.509805:0:7660:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1789477263.509806:0:7660:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789477263.509808:0:7660:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1789477263.509812:0:7660:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020062 00000020:01000004:1.0:1789477263.509815:0:7660:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1789477263.509817:0:7660:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1789477263.509818:0:7660:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789477263.509820:0:7660:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789477263.509831:0:7660:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789477263.509833:0:7660:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789477263.509834:0:7660:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1789477263.509835:0:7660:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1789477263.509836:0:7660:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1789477263.509837:0:7660:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789477263.509839:0:7660:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1789477263.509856:0:7660:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:1.0:1789477263.509867:0:7660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d7f73b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:07d5e05c-913f-419f-adbc-d3cf15e9cd51:7660:1876402802542080:0@lo:253: 00000100:00100000:1.0:1789477263.509921:0:7660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789477263.509958:0:7660:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d0d7fad2c00 going to sleep for 11 seconds 00000100:00100000:3.0:1789477263.510207:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802542080 00000100:00100000:3.0:1789477263.510214:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802542080 00000100:00100000:3.0:1789477263.510300:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1789477263.510309:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d595f5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07d5e05c-913f-419f-adbc-d3cf15e9cd51+14:7660:x1876402802542080:12345-0@lo:253: 20000000:01000000:3.0:1789477263.510344:0:5837:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:3.0:1789477263.510359:0:5837:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:0.0:1789477263.511343:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802541952 00000100:00100000:0.0:1789477263.511359:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802541952 00000100:00100000:0.0:1789477263.511422:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789477263.511431:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d58247480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:7675:x1876402802541952:12345-0@lo:901: 00000100:00100000:0.0:1789477263.511783:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d58247480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:7675:x1876402802541952:12345-0@lo:901: Request processed in 353us (2911us total) trans 0 rc 0/0 00000100:00100000:0.0:1789477263.511791:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:3.0:1789477263.515022:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1789477263.515458:0:7675:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9d0d58244380 x1876402802541952/t0(0) o901->lustre-MDT0000-lwp-OST0001@0@lo:29/10 lens 248/4320 e 0 to 0 dl 1789477279 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789477263.515479:0:7675:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d58244380 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:7675:1876402802541952:0@lo:901: 20000000:01000000:3.0:1789477263.582443:0:5837:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1789477263.582498:0:5837:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:1.0:1789477263.587228:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d595f5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07d5e05c-913f-419f-adbc-d3cf15e9cd51+14:7660:x1876402802542080:12345-0@lo:253: Request processed in 76910us (77296us total) trans 0 rc 0/0 00000100:00100000:1.0:1789477263.587243:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 20000000:01000000:0.0:1789477263.587370:0:5861:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1789477263.587376:0:5861:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1789477263.587452:0:5861:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9d0d41647000/0xafddb3c8f92815c4 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477263.587468:0:5861:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9d0d40031400/0xafddb3c8f928154d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xafddb3c8f9281546 expref: 13 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477263.587477:0:5861:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9d0d41647000/0xafddb3c8f92815c4 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477263.587515:0:5861:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9d0d40031400/0xafddb3c8f928154d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xafddb3c8f9281546 expref: 13 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477263.587530:0:5861:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9d0d40031400/0xafddb3c8f928154d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xafddb3c8f9281546 expref: 13 pid: 5838 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789477263.587543:0:5861:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d7f738380 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5861:1876402802542208:0@lo:104: 00000100:00100000:1.0:1789477263.587599:0:5861:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789477263.587665:0:5861:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d0d7fad2a80 going to sleep for 11 seconds 00000100:00100000:0.0:1789477263.587719:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802542208 00000100:00100000:0.0:1789477263.587727:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802542208 00000100:00100000:0.0:1789477263.587775:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1789477263.587784:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d7f738e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:07d5e05c-913f-419f-adbc-d3cf15e9cd51+3:5861:x1876402802542208:12345-0@lo:104: 00010000:00010000:0.0:1789477263.587796:0:5828:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.123@tcp lock: ffff9d0d59d6ba00/0xafddb3c8f9281546 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xafddb3c8f928154d expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477263.587857:0:5828:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1789477263.587863:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d7f738e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:07d5e05c-913f-419f-adbc-d3cf15e9cd51+3:5861:x1876402802542208:12345-0@lo:104: Request processed in 81us (265us total) trans 0 rc 0/0 00000100:00100000:0.0:1789477263.587870:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00010000:3.0:1789477263.587965:0:5833:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789477263.587973:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.123@tcp lock: ffff9d0d59d6ba00/0xafddb3c8f9281546 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xafddb3c8f928154d expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477263.587982:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d0d59d6ba00 already unused, calling callback (ffffffffc1bb3c20) 10000000:00010000:3.0:1789477263.587987:0:5833:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.123@tcp lock: ffff9d0d59d6ba00/0xafddb3c8f9281546 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xafddb3c8f928154d expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477263.587997:0:5833:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.123@tcp lock: ffff9d0d59d6ba00/0xafddb3c8f9281546 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xafddb3c8f928154d expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789477263.588005:0:5833:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.123@tcp lock: ffff9d0d59d6ba00/0xafddb3c8f9281546 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xafddb3c8f928154d expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789477263.588011:0:5833:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1789477263.588047:0:5833:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.123@tcp lock: ffff9d0d59d6ba00/0xafddb3c8f9281546 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xafddb3c8f928154d expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477263.588055:0:5833:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789477263.588080:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.123@tcp lock: ffff9d0d59d6ba00/0xafddb3c8f9281546 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xafddb3c8f928154d expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477263.588088:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.123@tcp lock: ffff9d0d59d6ba00/0xafddb3c8f9281546 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xafddb3c8f928154d expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477263.588121:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789477263.588123:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789477263.588124:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789477263.588133:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789477263.588285:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d58244380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:07d5e05c-913f-419f-adbc-d3cf15e9cd51:3311:1876402802542336:0@lo:103: 00000100:00100000:3.0:1789477263.588321:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789477263.588370:0:5861:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d7f738380 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5861:1876402802542208:0@lo:104: 00010000:00010000:3.0:1789477263.588389:0:5861:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9d0d41647000/0xafddb3c8f92815c4 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789477263.588440:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802542336 00000100:00100000:1.0:1789477263.588444:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802542336 00010000:00010000:1.0:1789477263.588465:0:5831:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9d0d40031400/0xafddb3c8f928154d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xafddb3c8f9281546 expref: 14 pid: 5838 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789477263.588494:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1789477263.588501:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d48463450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:07d5e05c-913f-419f-adbc-d3cf15e9cd51+14:3311:x1876402802542336:12345-0@lo:103: 00010000:00010000:1.0:1789477263.588521:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789477263.588527:0:5831:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9d0d40031400/0xafddb3c8f928154d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xafddb3c8f9281546 expref: 14 pid: 5838 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477263.588537:0:5831:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9d0d40031400/0xafddb3c8f928154d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xafddb3c8f9281546 expref: 14 pid: 5838 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477263.588550:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d0d40031400/0xafddb3c8f928154d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xafddb3c8f9281546 expref: 14 pid: 5838 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477263.588564:0:5831:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9d0d41647000/0xafddb3c8f92815c4 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477263.588571:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d0d41647000/0xafddb3c8f92815c4 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1789477263.588631:0:5831:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.002859838s 00010000:00010000:1.0:1789477263.588636:0:5831:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9d0d41647000/0xafddb3c8f92815c4 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477263.588642:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9d0d41647000/0xafddb3c8f92815c4 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477263.588649:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9d0d41647000/0xafddb3c8f92815c4 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477263.588655:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9d0d41647000/0xafddb3c8f92815c4 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477263.588661:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d0d41647000 already unused, calling callback (ffffffffc15972a0) 00010000:00010000:1.0:1789477263.588665:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9d0d41647000/0xafddb3c8f92815c4 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477263.588679:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9d0d41647000/0xafddb3c8f92815c4 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477263.588693:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9d0d41647000/0xafddb3c8f92815c4 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477263.588703:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789477263.588734:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d48463450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:07d5e05c-913f-419f-adbc-d3cf15e9cd51+13:3311:x1876402802542336:12345-0@lo:103: Request processed in 233us (412us total) trans 0 rc 0/0 00000100:00100000:1.0:1789477263.588742:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1789477263.588792:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d58244380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:07d5e05c-913f-419f-adbc-d3cf15e9cd51:3311:1876402802542336:0@lo:103: 00010000:00010000:1.0:1789477263.588806:0:5861:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9d0d41647000/0xafddb3c8f92815c4 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477263.588814:0:5861:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9d0d41647000/0xafddb3c8f92815c4 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477263.588834:0:5861:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d0d41647000/0xafddb3c8f92815c4 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789477263.590462:0:7660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d7f73b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:07d5e05c-913f-419f-adbc-d3cf15e9cd51:7660:1876402802542080:0@lo:253: 10000000:01000000:2.0:1789477263.590484:0:7660:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:2.0:1789477263.590487:0:7660:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1789477263.590488:0:7660:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1789477263.590490:0:7660:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789477263.590491:0:7660:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789477263.590493:0:7660:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789477263.590494:0:7660:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789477263.590495:0:7660:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1789477263.590497:0:7660:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1789477263.590498:0:7660:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1789477263.590500:0:7660:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789477263.590501:0:7660:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1789477263.590514:0:7660:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:2.0:1789477263.598087:0:7660:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:2.0:1789477263.598296:0:7660:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:2.0:1789477263.598524:0:7660:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:2.0:1789477263.598736:0:7660:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:2.0:1789477263.598954:0:7660:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:2.0:1789477263.599206:0:7660:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:2.0:1789477263.612815:0:7660:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00000100:00100000:1.0:1789477263.801710:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789477263.801734:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d7f73b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1876402802542464:0@lo:13: 00000100:00100000:1.0:1789477263.801804:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789477263.801890:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802542464 00000100:00100000:1.0:1789477263.801898:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802542464 00000100:00100000:1.0:1789477263.801944:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789477263.801954:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d7f73b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1876402802542464:12345-0@lo:13: 00002000:00000024:1.0:1789477263.801987:0:6698:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789477263.802042:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d7f73b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1876402802542464:12345-0@lo:13: Request processed in 89us (238us total) trans 0 rc 0/0 00000100:00100000:1.0:1789477263.802051:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:1.0:1789477263.802090:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9d0d7f73b480 x1876402802542464/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789477279 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789477263.802109:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d7f73b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1876402802542464:0@lo:13: 00002000:00080000:2.0:1789477263.823452:0:7660:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:2.0:1789477263.823461:0:7660:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:2.0:1789477263.823493:0:7660:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1789477263.823554:0:7660:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.201.123@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1789477263.823606:0:7660:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=49 00000080:00000004:2.0:1789477263.823637:0:7660:0:(super25.c:182:lustre_fill_super()) lustre-ost2/ost2: Mount complete 00010000:00010000:3.0:1789477264.048471:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789477265.072212:0:6710:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789477266.099673:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789477267.120557:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789477268.152929:0:6710:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789477268.911835:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d7bddfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:07d5e05c-913f-419f-adbc-d3cf15e9cd51:3312:1876402802542592:0@lo:400: 00000100:00100000:0.0:1789477268.911906:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d7bddd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3311:1876402802542976:0@lo:400: 00000100:00100000:2.0:1789477268.911934:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789477268.911945:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789477268.911993:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d7bddc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3312:1876402802543104:0@lo:400: 00000100:00100000:2.0:1789477268.912019:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789477268.912047:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1789477268.912053:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d7bddf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3312:1876402802542720:0@lo:400: 00000100:00100000:2.0:1789477268.912075:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789477268.912093:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d75368380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1876402802543232:0@lo:13: 00000100:00100000:2.0:1789477268.912118:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789477268.912152:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d7bddf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1876402802542848:0@lo:400: 00000100:00100000:2.0:1789477268.912176:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789477268.912213:0:6999:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802542976 00000100:00100000:2.0:1789477268.912223:0:6999:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802542976 00000100:00100000:2.0:1789477268.912290:0:6999:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802543104 00000100:00100000:2.0:1789477268.912294:0:6999:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802543104 00000100:00100000:2.0:1789477268.912308:0:6999:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802542720 00000100:00100000:2.0:1789477268.912310:0:6999:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802542720 00000100:00100000:2.0:1789477268.912326:0:6999:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1789477268.912358:0:6999:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d7536b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1876402802542976:12345-0@lo:400: 00000100:00100000:2.0:1789477268.912419:0:6999:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d7536b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1876402802542976:12345-0@lo:400: Request processed in 84us (472us total) trans 0 rc 0/0 00000100:00100000:2.0:1789477268.912428:0:6999:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1789477268.912449:0:6999:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1789477268.912455:0:6999:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d7bddc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1876402802543104:12345-0@lo:400: 00000100:00100000:2.0:1789477268.912485:0:6999:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d7bddc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1876402802543104:12345-0@lo:400: Request processed in 31us (465us total) trans 0 rc 0/0 00000100:00100000:2.0:1789477268.912498:0:6999:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1789477268.912510:0:6999:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1789477268.912516:0:6999:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d7bddc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1876402802542720:12345-0@lo:400: 00000100:00100000:2.0:1789477268.912546:0:6999:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d7bddc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1876402802542720:12345-0@lo:400: Request processed in 30us (470us total) trans 0 rc 0/0 00000100:00100000:2.0:1789477268.912551:0:6999:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1789477268.912608:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802543232 00000100:00100000:2.0:1789477268.912613:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802543232 00000100:00100000:2.0:1789477268.912648:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1789477268.912655:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d7bddea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1876402802543232:12345-0@lo:13: 00002000:00000024:2.0:1789477268.912702:0:6698:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789477268.912753:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d7bddea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1876402802543232:12345-0@lo:13: Request processed in 98us (633us total) trans 0 rc 0/0 00000100:00100000:2.0:1789477268.912759:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1789477268.912784:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802542848 00000100:00100000:2.0:1789477268.912788:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802542848 00000100:00100000:2.0:1789477268.912817:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789477268.912824:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d7bdde680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3310:x1876402802542848:12345-0@lo:400: 00000100:00100000:2.0:1789477268.912860:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d7bdde680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3310:x1876402802542848:12345-0@lo:400: Request processed in 36us (682us total) trans 0 rc 0/0 00000100:00100000:2.0:1789477268.912866:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:2.0:1789477268.912885:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789477268.912891:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1789477268.912937:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d0d7bddf100 x1876402802542848/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789477284 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789477268.912957:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d7bddf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1876402802542848:0@lo:400: 00010000:00080000:2.0:1789477268.913006:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d0d7bddf800 x1876402802542720/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789477284 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789477268.913015:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d7bddf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3312:1876402802542720:0@lo:400: 00010000:00080000:2.0:1789477268.913024:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d0d75368380 x1876402802543232/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789477284 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789477268.913040:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d75368380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1876402802543232:0@lo:13: 00010000:00080000:2.0:1789477268.913051:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d0d7bddc000 x1876402802543104/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789477284 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789477268.913059:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d7bddc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3312:1876402802543104:0@lo:400: 00000100:00100000:0.0:1789477268.918133:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802542592 00000100:00100000:0.0:1789477268.918160:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802542592 00000100:00100000:0.0:1789477268.918235:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1789477268.918249:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d595f5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:07d5e05c-913f-419f-adbc-d3cf15e9cd51+13:3312:x1876402802542592:12345-0@lo:400: 00000100:00100000:0.0:1789477268.918395:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d595f5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:07d5e05c-913f-419f-adbc-d3cf15e9cd51+13:3312:x1876402802542592:12345-0@lo:400: Request processed in 148us (6460us total) trans 0 rc 0/0 00000100:00100000:0.0:1789477268.918424:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00010000:00080000:0.0:1789477268.918957:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d0d7bddd880 x1876402802542976/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789477284 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789477268.918976:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d7bddd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3311:1876402802542976:0@lo:400: 00000100:00100000:2.0:1789477268.919474:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d7bddfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:07d5e05c-913f-419f-adbc-d3cf15e9cd51:3312:1876402802542592:0@lo:400: 00010000:00010000:0.0:1789477269.167893:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789477270.191844:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1789477271.116877:0:8017:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg123-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:0.0:1789477271.215702:0:6710:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1789477271.471736:0:5841:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1789477271.471744:0:5841:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9d0d585fc800 from 30 10000000:01000000:1.0:1789477271.471750:0:5841:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1789477271.471796:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.123@tcp lock: ffff9d0d41646a00/0xafddb3c8f92815cb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477271.471808:0:5841:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.123@tcp lock: ffff9d0d41646a00/0xafddb3c8f92815cb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477271.471819:0:5841:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.123@tcp lock: ffff9d0d41646a00/0xafddb3c8f92815cb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789477271.471841:0:5841:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d7f73b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07d5e05c-913f-419f-adbc-d3cf15e9cd51:5841:1876402802543360:0@lo:101: 00000100:00100000:1.0:1789477271.471903:0:5841:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789477271.471998:0:5841:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d0d4844c540 going to sleep for 11 seconds 00000100:00100000:3.0:1789477271.474809:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802543360 00000100:00100000:3.0:1789477271.474821:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802543360 00000100:00100000:3.0:1789477271.474872:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1789477271.474882:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d595f4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07d5e05c-913f-419f-adbc-d3cf15e9cd51+13:5841:x1876402802543360:12345-0@lo:101: 00010000:00010000:3.0:1789477271.474900:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789477271.474918:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d0d49eca000/0xafddb3c8f92815d2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xafddb3c8f92815cb expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477271.474956:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d0d49eca000/0xafddb3c8f92815d2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xafddb3c8f92815cb expref: 14 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477271.474967:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d0d49eca000/0xafddb3c8f92815d2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xafddb3c8f92815cb expref: 14 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477271.474991:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d0d49eca000, rc 0) 00000100:00100000:3.0:1789477271.475072:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d595f4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07d5e05c-913f-419f-adbc-d3cf15e9cd51+14:5841:x1876402802543360:12345-0@lo:101: Request processed in 191us (3168us total) trans 0 rc 0/0 00000100:00100000:3.0:1789477271.475078:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1789477271.475251:0:5841:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d7f73b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07d5e05c-913f-419f-adbc-d3cf15e9cd51:5841:1876402802543360:0@lo:101: 00010000:00010000:2.0:1789477271.475269:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.123@tcp lock: ffff9d0d41646a00/0xafddb3c8f92815cb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xafddb3c8f92815d2 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477271.475280:0:5841:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.123@tcp lock: ffff9d0d41646a00/0xafddb3c8f92815cb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xafddb3c8f92815d2 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789477271.475346:0:5841:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d7bddfb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07d5e05c-913f-419f-adbc-d3cf15e9cd51:5841:1876402802543488:0@lo:501: 00000100:00100000:2.0:1789477271.475380:0:5841:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789477271.475417:0:5841:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d0d74cd0cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1789477271.475462:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802543488 00000100:00100000:1.0:1789477271.475467:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802543488 00000100:00100000:1.0:1789477271.475499:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1789477271.475507:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d595f6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:07d5e05c-913f-419f-adbc-d3cf15e9cd51+14:5841:x1876402802543488:12345-0@lo:501: 00000100:00100000:1.0:1789477271.475868:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d595f6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:07d5e05c-913f-419f-adbc-d3cf15e9cd51+14:5841:x1876402802543488:12345-0@lo:501: Request processed in 361us (486us total) trans 0 rc 0/0 00000100:00100000:1.0:1789477271.475875:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1789477271.475911:0:5841:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d7bddfb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07d5e05c-913f-419f-adbc-d3cf15e9cd51:5841:1876402802543488:0@lo:501: 00000100:00100000:1.0:1789477271.475954:0:5841:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d7f738380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07d5e05c-913f-419f-adbc-d3cf15e9cd51:5841:1876402802543616:0@lo:503: 00000100:00100000:1.0:1789477271.475992:0:5841:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789477271.476006:0:5841:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d0d4844c000 going to sleep for 11 seconds 00000100:00100000:1.0:1789477271.476017:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802543616 00000100:00100000:1.0:1789477271.476020:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802543616 00000100:00100000:1.0:1789477271.476036:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1789477271.476042:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d44523050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:07d5e05c-913f-419f-adbc-d3cf15e9cd51+14:5841:x1876402802543616:12345-0@lo:503: 00000100:00100000:1.0:1789477271.476300:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d44523050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:07d5e05c-913f-419f-adbc-d3cf15e9cd51+14:5841:x1876402802543616:12345-0@lo:503: Request processed in 258us (308us total) trans 0 rc 0/0 00000100:00100000:1.0:1789477271.476308:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1789477271.476358:0:5841:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d7f738380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07d5e05c-913f-419f-adbc-d3cf15e9cd51:5841:1876402802543616:0@lo:503: 00000100:00100000:1.0:1789477271.476521:0:8038:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d7f738380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:07d5e05c-913f-419f-adbc-d3cf15e9cd51:8038:1876402802543744:0@lo:502: 00000100:00100000:1.0:1789477271.476555:0:8038:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789477271.476574:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802543744 00000100:00100000:1.0:1789477271.476598:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802543744 00000100:00100000:1.0:1789477271.476618:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1789477271.476623:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d44522c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:07d5e05c-913f-419f-adbc-d3cf15e9cd51+14:8038:x1876402802543744:12345-0@lo:502: 00000100:00100000:1.0:1789477271.476822:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d44522c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:07d5e05c-913f-419f-adbc-d3cf15e9cd51+14:8038:x1876402802543744:12345-0@lo:502: Request processed in 197us (266us total) trans 0 rc 0/0 00000100:00100000:1.0:1789477271.476829:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1789477271.476863:0:8038:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d0d4844c180 going to sleep for 11 seconds 00000100:00100000:1.0:1789477271.476874:0:8038:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d7f738380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:07d5e05c-913f-419f-adbc-d3cf15e9cd51:8038:1876402802543744:0@lo:502: 00000100:00100000:1.0:1789477271.476909:0:8038:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d7f738380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:07d5e05c-913f-419f-adbc-d3cf15e9cd51:8038:1876402802543872:0@lo:502: 00000100:00100000:1.0:1789477271.476938:0:8038:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789477271.476962:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802543872 00000100:00100000:1.0:1789477271.476966:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802543872 00000100:00100000:1.0:1789477271.476982:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1789477271.476988:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d44521450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:07d5e05c-913f-419f-adbc-d3cf15e9cd51+14:8038:x1876402802543872:12345-0@lo:502: 00000100:00100000:1.0:1789477271.477095:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d44521450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:07d5e05c-913f-419f-adbc-d3cf15e9cd51+14:8038:x1876402802543872:12345-0@lo:502: Request processed in 107us (156us total) trans 0 rc 0/0 00000100:00100000:1.0:1789477271.477101:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1789477271.477125:0:8038:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d0d4844c180 going to sleep for 11 seconds 00000100:00100000:1.0:1789477271.477136:0:8038:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d7f738380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:07d5e05c-913f-419f-adbc-d3cf15e9cd51:8038:1876402802543872:0@lo:502: 00000040:00080000:1.0:1789477271.477153:0:8038:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:1.0:1789477271.477198:0:5841:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:1.0:1789477271.477213:0:5841:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.123@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1789477271.477220:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.123@tcp lock: ffff9d0d41646a00/0xafddb3c8f92815cb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xafddb3c8f92815d2 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477271.477229:0:5841:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.123@tcp lock: ffff9d0d41646a00/0xafddb3c8f92815cb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xafddb3c8f92815d2 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789477271.477239:0:5841:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:1.0:1789477271.477241:0:5841:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 8 10000000:01000000:1.0:1789477271.477244:0:5841:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:1.0:1789477271.477267:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.123@tcp lock: ffff9d0d41647000/0xafddb3c8f92815d9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477271.477274:0:5841:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.123@tcp lock: ffff9d0d41647000/0xafddb3c8f92815d9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477271.477284:0:5841:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.123@tcp lock: ffff9d0d41647000/0xafddb3c8f92815d9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789477271.477306:0:5841:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d7f738380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07d5e05c-913f-419f-adbc-d3cf15e9cd51:5841:1876402802544000:0@lo:101: 00000100:00100000:1.0:1789477271.477331:0:5841:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789477271.477344:0:5841:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d0d4844c180 going to sleep for 11 seconds 00000100:00100000:1.0:1789477271.477371:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802544000 00000100:00100000:1.0:1789477271.477376:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802544000 00000100:00100000:1.0:1789477271.477392:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1789477271.477398:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d44522050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:07d5e05c-913f-419f-adbc-d3cf15e9cd51+14:5841:x1876402802544000:12345-0@lo:101: 00010000:00010000:1.0:1789477271.477406:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789477271.477416:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d0d41647400/0xafddb3c8f92815e0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xafddb3c8f92815d9 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477271.477434:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d0d41647400/0xafddb3c8f92815e0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xafddb3c8f92815d9 expref: 15 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477271.477444:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d0d41647400/0xafddb3c8f92815e0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xafddb3c8f92815d9 expref: 15 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477271.477452:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d0d41647400, rc 0) 00000100:00100000:1.0:1789477271.477481:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d44522050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:07d5e05c-913f-419f-adbc-d3cf15e9cd51+15:5841:x1876402802544000:12345-0@lo:101: Request processed in 82us (148us total) trans 0 rc 0/0 00000100:00100000:1.0:1789477271.477486:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1789477271.477514:0:5841:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d7f738380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07d5e05c-913f-419f-adbc-d3cf15e9cd51:5841:1876402802544000:0@lo:101: 00010000:00010000:1.0:1789477271.477525:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.123@tcp lock: ffff9d0d41647000/0xafddb3c8f92815d9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xafddb3c8f92815e0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477271.477533:0:5841:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.123@tcp lock: ffff9d0d41647000/0xafddb3c8f92815d9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xafddb3c8f92815e0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789477271.477598:0:5841:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d7f738380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07d5e05c-913f-419f-adbc-d3cf15e9cd51:5841:1876402802544128:0@lo:501: 00000100:00100000:1.0:1789477271.477625:0:5841:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789477271.477638:0:5841:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d0d4844c180 going to sleep for 11 seconds 00000100:00100000:1.0:1789477271.477649:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802544128 00000100:00100000:1.0:1789477271.477652:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802544128 00000100:00100000:1.0:1789477271.477666:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1789477271.477671:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d44521c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:07d5e05c-913f-419f-adbc-d3cf15e9cd51+15:5841:x1876402802544128:12345-0@lo:501: 00000100:00100000:1.0:1789477271.477856:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d44521c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:07d5e05c-913f-419f-adbc-d3cf15e9cd51+15:5841:x1876402802544128:12345-0@lo:501: Request processed in 184us (229us total) trans 0 rc 0/0 00000100:00100000:1.0:1789477271.477863:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1789477271.477890:0:5841:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d7f738380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07d5e05c-913f-419f-adbc-d3cf15e9cd51:5841:1876402802544128:0@lo:501: 00000100:00100000:1.0:1789477271.477913:0:5841:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d7f738380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07d5e05c-913f-419f-adbc-d3cf15e9cd51:5841:1876402802544256:0@lo:503: 00000100:00100000:1.0:1789477271.477944:0:5841:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789477271.477957:0:5841:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d0d4844c180 going to sleep for 11 seconds 00000100:00100000:1.0:1789477271.477968:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802544256 00000100:00100000:1.0:1789477271.477971:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802544256 00000100:00100000:1.0:1789477271.477987:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1789477271.477992:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d44523c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:07d5e05c-913f-419f-adbc-d3cf15e9cd51+15:5841:x1876402802544256:12345-0@lo:503: 00000100:00100000:1.0:1789477271.478239:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d44523c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:07d5e05c-913f-419f-adbc-d3cf15e9cd51+15:5841:x1876402802544256:12345-0@lo:503: Request processed in 245us (293us total) trans 0 rc 0/0 00000100:00100000:1.0:1789477271.478246:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1789477271.478279:0:5841:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d7f738380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07d5e05c-913f-419f-adbc-d3cf15e9cd51:5841:1876402802544256:0@lo:503: 00000100:00100000:0.0:1789477271.484414:0:8039:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d75368700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:07d5e05c-913f-419f-adbc-d3cf15e9cd51:8039:1876402802544384:0@lo:502: 00000100:00100000:0.0:1789477271.484501:0:8039:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789477271.484547:0:8039:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d0d5046c480 going to sleep for 11 seconds 00000100:00100000:1.0:1789477271.484629:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802544384 00000100:00100000:1.0:1789477271.484637:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802544384 00000100:00100000:1.0:1789477271.484708:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1789477271.484717:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d44523450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:07d5e05c-913f-419f-adbc-d3cf15e9cd51+15:8039:x1876402802544384:12345-0@lo:502: 00000100:00100000:1.0:1789477271.485179:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d44523450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:07d5e05c-913f-419f-adbc-d3cf15e9cd51+15:8039:x1876402802544384:12345-0@lo:502: Request processed in 462us (677us total) trans 0 rc 0/0 00000100:00100000:1.0:1789477271.485187:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1789477271.485322:0:8039:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d75368700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:07d5e05c-913f-419f-adbc-d3cf15e9cd51:8039:1876402802544384:0@lo:502: 00000020:01000000:0.0:1789477271.485352:0:8039:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789477271.485362:0:8039:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789477271.485365:0:8039:0:(obd_config.c:1563:class_process_config()) marker 20 (0x1) lustre sys.timeout 00000020:00000080:0.0:1789477271.485369:0:8039:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1789477271.485371:0:8039:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:0.0:1789477271.485387:0:8039:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d75368700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:07d5e05c-913f-419f-adbc-d3cf15e9cd51:8039:1876402802544512:0@lo:502: 00000100:00100000:0.0:1789477271.485420:0:8039:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789477271.485451:0:8039:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d0d5046c480 going to sleep for 11 seconds 00000100:00100000:3.0:1789477271.485508:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802544512 00000100:00100000:3.0:1789477271.485513:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802544512 00000100:00100000:3.0:1789477271.485549:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1789477271.485556:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d44521850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07d5e05c-913f-419f-adbc-d3cf15e9cd51+15:8039:x1876402802544512:12345-0@lo:502: 00000100:00100000:3.0:1789477271.485735:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d44521850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07d5e05c-913f-419f-adbc-d3cf15e9cd51+15:8039:x1876402802544512:12345-0@lo:502: Request processed in 179us (314us total) trans 0 rc 0/0 00000100:00100000:3.0:1789477271.485742:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1789477271.485854:0:8039:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d75368700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:07d5e05c-913f-419f-adbc-d3cf15e9cd51:8039:1876402802544512:0@lo:502: 00000020:01000000:0.0:1789477271.485872:0:8039:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789477271.485877:0:8039:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789477271.485879:0:8039:0:(obd_config.c:1563:class_process_config()) marker 20 (0x2) lustre sys.timeout 00000040:00080000:0.0:1789477271.485882:0:8039:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 11 count 11 00000020:01000000:3.0:1789477271.486093:0:5841:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 8-10 (rc=0) 10000000:01000000:3.0:1789477271.486115:0:5841:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.123@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:3.0:1789477271.486124:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.123@tcp lock: ffff9d0d41647000/0xafddb3c8f92815d9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xafddb3c8f92815e0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477271.486135:0:5841:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.123@tcp lock: ffff9d0d41647000/0xafddb3c8f92815d9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xafddb3c8f92815e0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789477271.486145:0:5841:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1789477271.486148:0:5841:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9d0d4444e800 from 30 10000000:01000000:3.0:1789477271.486151:0:5841:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1789477271.486175:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.123@tcp lock: ffff9d0d49ecba00/0xafddb3c8f92815e7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477271.486183:0:5841:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.123@tcp lock: ffff9d0d49ecba00/0xafddb3c8f92815e7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477271.486204:0:5841:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.123@tcp lock: ffff9d0d49ecba00/0xafddb3c8f92815e7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789477271.486216:0:5841:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d58247100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07d5e05c-913f-419f-adbc-d3cf15e9cd51:5841:1876402802544640:0@lo:101: 00000100:00100000:3.0:1789477271.486255:0:5841:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789477271.486282:0:5841:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d0d50a5dcc0 going to sleep for 11 seconds 00000100:00100000:0.0:1789477271.486442:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802544640 00000100:00100000:0.0:1789477271.486447:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802544640 00000100:00100000:0.0:1789477271.486470:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1789477271.486483:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d44521050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:07d5e05c-913f-419f-adbc-d3cf15e9cd51+15:5841:x1876402802544640:12345-0@lo:101: 00010000:00010000:0.0:1789477271.486491:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789477271.486503:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d0d40030600/0xafddb3c8f92815ee lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xafddb3c8f92815e7 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477271.486525:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d0d40030600/0xafddb3c8f92815ee lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xafddb3c8f92815e7 expref: 16 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477271.486535:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d0d40030600/0xafddb3c8f92815ee lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xafddb3c8f92815e7 expref: 16 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477271.486543:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d0d40030600, rc 0) 00000100:00100000:0.0:1789477271.486602:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d44521050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:07d5e05c-913f-419f-adbc-d3cf15e9cd51+16:5841:x1876402802544640:12345-0@lo:101: Request processed in 119us (345us total) trans 0 rc 0/0 00000100:00100000:0.0:1789477271.486608:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1789477271.487827:0:5841:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d58247100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07d5e05c-913f-419f-adbc-d3cf15e9cd51:5841:1876402802544640:0@lo:101: 00010000:00010000:1.0:1789477271.487851:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.123@tcp lock: ffff9d0d49ecba00/0xafddb3c8f92815e7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xafddb3c8f92815ee expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477271.487861:0:5841:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.123@tcp lock: ffff9d0d49ecba00/0xafddb3c8f92815e7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xafddb3c8f92815ee expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789477271.488300:0:5841:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d7f738380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07d5e05c-913f-419f-adbc-d3cf15e9cd51:5841:1876402802544768:0@lo:501: 00000100:00100000:1.0:1789477271.488351:0:5841:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789477271.488387:0:5841:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d0d597d6300 going to sleep for 11 seconds 00000100:00100000:0.0:1789477271.488704:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802544768 00000100:00100000:0.0:1789477271.488712:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802544768 00000100:00100000:0.0:1789477271.488756:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1789477271.488765:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d595f4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07d5e05c-913f-419f-adbc-d3cf15e9cd51+16:5841:x1876402802544768:12345-0@lo:501: 00000100:00100000:0.0:1789477271.489152:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d595f4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07d5e05c-913f-419f-adbc-d3cf15e9cd51+16:5841:x1876402802544768:12345-0@lo:501: Request processed in 386us (800us total) trans 0 rc 0/0 00000100:00100000:0.0:1789477271.489160:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1789477271.489254:0:5841:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d7f738380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07d5e05c-913f-419f-adbc-d3cf15e9cd51:5841:1876402802544768:0@lo:501: 00000100:00100000:3.0:1789477271.489290:0:5841:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d58245c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07d5e05c-913f-419f-adbc-d3cf15e9cd51:5841:1876402802544896:0@lo:503: 00000100:00100000:3.0:1789477271.489331:0:5841:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789477271.489362:0:5841:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d0d50a5dd80 going to sleep for 11 seconds 00000100:00100000:0.0:1789477271.489470:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802544896 00000100:00100000:0.0:1789477271.489475:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802544896 00000100:00100000:0.0:1789477271.489507:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:0.0:1789477271.489514:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d44520850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07d5e05c-913f-419f-adbc-d3cf15e9cd51+16:5841:x1876402802544896:12345-0@lo:503: 00000100:00100000:0.0:1789477271.489688:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d44520850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07d5e05c-913f-419f-adbc-d3cf15e9cd51+16:5841:x1876402802544896:12345-0@lo:503: Request processed in 163us (345us total) trans 0 rc 0/0 00000100:00100000:0.0:1789477271.490009:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:0.0:1789477271.490050:0:5841:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d58245c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07d5e05c-913f-419f-adbc-d3cf15e9cd51:5841:1876402802544896:0@lo:503: 00000100:00100000:1.0:1789477271.490438:0:8041:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d7f739c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:07d5e05c-913f-419f-adbc-d3cf15e9cd51:8041:1876402802545024:0@lo:502: 00000100:00100000:1.0:1789477271.490476:0:8041:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789477271.490506:0:8041:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d0d46219c00 going to sleep for 11 seconds 00000100:00100000:0.0:1789477271.490543:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802545024 00000100:00100000:0.0:1789477271.490548:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802545024 00000100:00100000:0.0:1789477271.490599:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1789477271.490606:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d44522850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:07d5e05c-913f-419f-adbc-d3cf15e9cd51+16:8041:x1876402802545024:12345-0@lo:502: 00000100:00100000:0.0:1789477271.491266:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d44522850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:07d5e05c-913f-419f-adbc-d3cf15e9cd51+16:8041:x1876402802545024:12345-0@lo:502: Request processed in 657us (786us total) trans 0 rc 0/0 00000100:00100000:0.0:1789477271.491275:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1789477271.491431:0:8041:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d7f739c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:07d5e05c-913f-419f-adbc-d3cf15e9cd51:8041:1876402802545024:0@lo:502: 00000100:00100000:1.0:1789477271.491476:0:8041:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d7f739c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:07d5e05c-913f-419f-adbc-d3cf15e9cd51:8041:1876402802545152:0@lo:502: 00000100:00100000:1.0:1789477271.491509:0:8041:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789477271.491538:0:8041:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d0d46219c00 going to sleep for 11 seconds 00000100:00100000:0.0:1789477271.494353:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802545152 00000100:00100000:0.0:1789477271.494367:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802545152 00000100:00100000:0.0:1789477271.494436:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1789477271.494447:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d44520c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07d5e05c-913f-419f-adbc-d3cf15e9cd51+16:8041:x1876402802545152:12345-0@lo:502: 00000100:00100000:0.0:1789477271.494766:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d44520c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07d5e05c-913f-419f-adbc-d3cf15e9cd51+16:8041:x1876402802545152:12345-0@lo:502: Request processed in 320us (3255us total) trans 0 rc 0/0 00000100:00100000:0.0:1789477271.494774:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1789477271.494901:0:8041:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d7f739c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:07d5e05c-913f-419f-adbc-d3cf15e9cd51:8041:1876402802545152:0@lo:502: 00000040:00080000:2.0:1789477271.494944:0:8041:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:0.0:1789477271.495495:0:5841:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:0.0:1789477271.495529:0:5841:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.123@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1789477271.495539:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.123@tcp lock: ffff9d0d49ecba00/0xafddb3c8f92815e7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xafddb3c8f92815ee expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477271.495550:0:5841:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.123@tcp lock: ffff9d0d49ecba00/0xafddb3c8f92815e7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xafddb3c8f92815ee expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789477271.495560:0:5841:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1789477271.495563:0:5841:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9d0d4444e800 from 5 10000000:01000000:0.0:1789477271.495565:0:5841:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1789477271.495637:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.123@tcp lock: ffff9d0d40031e00/0xafddb3c8f92815f5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477271.495645:0:5841:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.123@tcp lock: ffff9d0d40031e00/0xafddb3c8f92815f5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477271.495654:0:5841:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.123@tcp lock: ffff9d0d40031e00/0xafddb3c8f92815f5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789477271.495670:0:5841:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d75368700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07d5e05c-913f-419f-adbc-d3cf15e9cd51:5841:1876402802545280:0@lo:101: 00000100:00100000:0.0:1789477271.495727:0:5841:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789477271.495761:0:5841:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d0d50abd9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789477271.495815:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802545280 00000100:00100000:1.0:1789477271.495821:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802545280 00000100:00100000:1.0:1789477271.495858:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1789477271.495866:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d44520450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:07d5e05c-913f-419f-adbc-d3cf15e9cd51+16:5841:x1876402802545280:12345-0@lo:101: 00010000:00010000:1.0:1789477271.495885:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789477271.495898:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d0d41646c00/0xafddb3c8f92815fc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xafddb3c8f92815f5 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477271.495931:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d0d41646c00/0xafddb3c8f92815fc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xafddb3c8f92815f5 expref: 17 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477271.495943:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d0d41646c00/0xafddb3c8f92815fc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xafddb3c8f92815f5 expref: 17 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477271.495951:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d0d41646c00, rc 0) 00000100:00100000:1.0:1789477271.495991:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d44520450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:07d5e05c-913f-419f-adbc-d3cf15e9cd51+17:5841:x1876402802545280:12345-0@lo:101: Request processed in 125us (263us total) trans 0 rc 0/0 00000100:00100000:1.0:1789477271.495996:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1789477271.496397:0:5841:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d75368700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07d5e05c-913f-419f-adbc-d3cf15e9cd51:5841:1876402802545280:0@lo:101: 00010000:00010000:2.0:1789477271.496421:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.123@tcp lock: ffff9d0d40031e00/0xafddb3c8f92815f5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xafddb3c8f92815fc expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477271.496429:0:5841:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.123@tcp lock: ffff9d0d40031e00/0xafddb3c8f92815f5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xafddb3c8f92815fc expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789477271.496478:0:5841:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d7bddc000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07d5e05c-913f-419f-adbc-d3cf15e9cd51:5841:1876402802545408:0@lo:256: 00000100:00100000:2.0:1789477271.496513:0:5841:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789477271.496542:0:5841:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d0d74cd0b40 going to sleep for 11 seconds 00000100:00100000:1.0:1789477271.496628:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802545408 00000100:00100000:1.0:1789477271.496633:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802545408 00000100:00100000:1.0:1789477271.496660:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1789477271.496667:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d44523850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07d5e05c-913f-419f-adbc-d3cf15e9cd51+17:5841:x1876402802545408:12345-0@lo:256: 20000000:01000000:1.0:1789477271.496700:0:5838:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1789477271.496719:0:5838:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1789477271.496722:0:5838:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 5 00000100:00100000:1.0:1789477271.496800:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d44523850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07d5e05c-913f-419f-adbc-d3cf15e9cd51+17:5841:x1876402802545408:12345-0@lo:256: Request processed in 133us (286us total) trans 0 rc 0/0 00000100:00100000:1.0:1789477271.496807:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1789477271.496916:0:5841:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d7bddc000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07d5e05c-913f-419f-adbc-d3cf15e9cd51:5841:1876402802545408:0@lo:256: 10000000:01000000:2.0:1789477271.497039:0:5841:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.123@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1789477271.497045:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.123@tcp lock: ffff9d0d40031e00/0xafddb3c8f92815f5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xafddb3c8f92815fc expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477271.497053:0:5841:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.123@tcp lock: ffff9d0d40031e00/0xafddb3c8f92815f5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xafddb3c8f92815fc expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789477271.497061:0:5841:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:2.0:1789477271.497063:0:5841:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 25 10000000:01000000:2.0:1789477271.497065:0:5841:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:2.0:1789477271.497084:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.123@tcp lock: ffff9d0d59d6a200/0xafddb3c8f9281603 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477271.497090:0:5841:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.123@tcp lock: ffff9d0d59d6a200/0xafddb3c8f9281603 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477271.497098:0:5841:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.123@tcp lock: ffff9d0d59d6a200/0xafddb3c8f9281603 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789477271.497119:0:5841:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d7bddc000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07d5e05c-913f-419f-adbc-d3cf15e9cd51:5841:1876402802545536:0@lo:101: 00000100:00100000:2.0:1789477271.497145:0:5841:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789477271.497175:0:5841:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d0d74cd0b40 going to sleep for 11 seconds 00000100:00100000:0.0:1789477271.497785:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802545536 00000100:00100000:0.0:1789477271.497792:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802545536 00000100:00100000:0.0:1789477271.497832:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1789477271.497839:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d44522450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:07d5e05c-913f-419f-adbc-d3cf15e9cd51+17:5841:x1876402802545536:12345-0@lo:101: 00010000:00010000:0.0:1789477271.497849:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789477271.497861:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d0d40031400/0xafddb3c8f928160a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xafddb3c8f9281603 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477271.497881:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d0d40031400/0xafddb3c8f928160a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xafddb3c8f9281603 expref: 18 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477271.497890:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d0d40031400/0xafddb3c8f928160a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xafddb3c8f9281603 expref: 18 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477271.497897:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d0d40031400, rc 0) 00000100:00100000:0.0:1789477271.498014:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d44522450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:07d5e05c-913f-419f-adbc-d3cf15e9cd51+18:5841:x1876402802545536:12345-0@lo:101: Request processed in 175us (867us total) trans 0 rc 0/0 00000100:00100000:0.0:1789477271.498020:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1789477271.498066:0:5841:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d7bddc000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07d5e05c-913f-419f-adbc-d3cf15e9cd51:5841:1876402802545536:0@lo:101: 00010000:00010000:0.0:1789477271.498077:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.123@tcp lock: ffff9d0d59d6a200/0xafddb3c8f9281603 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xafddb3c8f928160a expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477271.498086:0:5841:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.123@tcp lock: ffff9d0d59d6a200/0xafddb3c8f9281603 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xafddb3c8f928160a expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789477271.498133:0:5841:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d75368000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07d5e05c-913f-419f-adbc-d3cf15e9cd51:5841:1876402802545664:0@lo:501: 00000100:00100000:0.0:1789477271.498160:0:5841:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789477271.498175:0:5841:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d0d50abd900 going to sleep for 11 seconds 00000100:00100000:0.0:1789477271.498188:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802545664 00000100:00100000:0.0:1789477271.498191:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802545664 00000100:00100000:0.0:1789477271.498206:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1789477271.498211:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d44520050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:07d5e05c-913f-419f-adbc-d3cf15e9cd51+18:5841:x1876402802545664:12345-0@lo:501: 00000100:00100000:1.0:1789477271.506067:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d44520050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:07d5e05c-913f-419f-adbc-d3cf15e9cd51+18:5841:x1876402802545664:12345-0@lo:501: Request processed in 7844us (7895us total) trans 0 rc 0/0 00000100:00100000:1.0:1789477271.506087:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1789477271.506102:0:5841:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d75368000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07d5e05c-913f-419f-adbc-d3cf15e9cd51:5841:1876402802545664:0@lo:501: 00000100:00100000:0.0:1789477271.506157:0:5841:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d75368000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07d5e05c-913f-419f-adbc-d3cf15e9cd51:5841:1876402802545792:0@lo:503: 00000100:00100000:0.0:1789477271.506205:0:5841:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789477271.506254:0:5841:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d0d50abd900 going to sleep for 11 seconds 00000100:00100000:1.0:1789477271.506350:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802545792 00000100:00100000:1.0:1789477271.506358:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802545792 00000100:00100000:1.0:1789477271.506412:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1789477271.506420:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d4e677850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07d5e05c-913f-419f-adbc-d3cf15e9cd51+18:5841:x1876402802545792:12345-0@lo:503: 00000100:00100000:1.0:1789477271.506755:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d4e677850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07d5e05c-913f-419f-adbc-d3cf15e9cd51+18:5841:x1876402802545792:12345-0@lo:503: Request processed in 334us (549us total) trans 0 rc 0/0 00000100:00100000:1.0:1789477271.506762:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1789477271.506812:0:5841:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d75368000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07d5e05c-913f-419f-adbc-d3cf15e9cd51:5841:1876402802545792:0@lo:503: 00000100:00100000:1.0:1789477271.507237:0:8042:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d7f738000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:07d5e05c-913f-419f-adbc-d3cf15e9cd51:8042:1876402802545920:0@lo:502: 00000100:00100000:1.0:1789477271.507275:0:8042:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789477271.507296:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802545920 00000100:00100000:1.0:1789477271.507300:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802545920 00000100:00100000:1.0:1789477271.507324:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1789477271.507331:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d4e676450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:07d5e05c-913f-419f-adbc-d3cf15e9cd51+18:8042:x1876402802545920:12345-0@lo:502: 00000100:00100000:1.0:1789477271.507524:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d4e676450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:07d5e05c-913f-419f-adbc-d3cf15e9cd51+18:8042:x1876402802545920:12345-0@lo:502: Request processed in 193us (249us total) trans 0 rc 0/0 00000100:00100000:1.0:1789477271.507531:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1789477271.507561:0:8042:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d0d50a1e180 going to sleep for 11 seconds 00000100:00100000:1.0:1789477271.507573:0:8042:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d7f738000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:07d5e05c-913f-419f-adbc-d3cf15e9cd51:8042:1876402802545920:0@lo:502: 00000020:01000000:1.0:1789477271.507611:0:8042:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1789477271.507620:0:8042:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-mdt1/mdt1 00000020:00000080:1.0:1789477271.507627:0:8042:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789477271.507629:0:8042:0:(obd_config.c:1563:class_process_config()) marker 18 (0x1) lustre-OST0001 add osc 00000020:00000080:1.0:1789477271.507634:0:8042:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1789477271.507637:0:8042:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.201.123@tcp to nid 0x20000c0a8c97b (192.168.201.123@tcp) 00000020:01000000:1.0:1789477271.507657:0:8042:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:1.0:1789477271.507660:0:8042:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1789477271.507674:0:8042:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff9d0d76163370) 00000020:00000080:1.0:1789477271.507706:0:8042:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type osp with refcount 2 00000020:00000080:1.0:1789477271.507718:0:8042:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1789477271.507779:0:8042:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:1.0:1789477271.507785:0:8042:0:(osd_handler.c:1564:osd_obd_connect()) connect #6 00000020:00000080:1.0:1789477271.507791:0:8042:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xafddb3c8f9281618 00010000:00080000:1.0:1789477271.507817:0:8042:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9d0d7c06f000@lustre-OST0001-osc-MDT0000: add connection 192.168.201.123@tcp at head 00010000:00010000:1.0:1789477271.508432:0:8042:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-5 is initialized 00000040:01000000:1.0:1789477271.508748:0:8042:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:01000000:1.0:1789477271.508760:0:8042:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:1.0:1789477271.509564:0:8042:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789477271.509815:0:8042:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789477271.509868:0:8042:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].1, 64 off8256 00000040:00080000:1.0:1789477271.510116:0:8042:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1, 64 off8256 00000040:00080000:0.0:1789477271.510852:0:8043:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1789477271.510857:0:8043:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x6:0x0] at index 1 of catalog [0x1:0x5:0x0] 00000020:00000080:1.0:1789477271.512409:0:8042:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1789477271.512423:0:8042:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1789477271.512455:0:8042:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:1.0:1789477271.512478:0:8042:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xafddb3c8f928161f 00000100:00080000:1.0:1789477271.512488:0:8042:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1789477271.512499:0:8042:0:(import.c:625:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9d0d7c06f000 using connection 192.168.201.123@tcp/0@lo 00000100:00100000:1.0:1789477271.512535:0:8042:0:(import.c:827:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9d0d7f738000 x1876402802546048/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1789477271.512610:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d7f738000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3309:1876402802546048:0@lo:8: 00000100:00100000:0.0:1789477271.512685:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789477271.512774:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802546048 00000100:00100000:1.0:1789477271.512781:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802546048 00000100:00100000:1.0:1789477271.512810:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1789477271.512817:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d75369880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3309:x1876402802546048:12345-0@lo:8: 00010000:00080000:1.0:1789477271.512842:0:6694:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 216 last 0 00000020:00000080:1.0:1789477271.512867:0:6694:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xafddb3c8f9281626 00002000:00100000:1.0:1789477271.512880:0:6694:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff9d0d481a3000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113954 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:1.0:1789477271.512884:0:6694:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00000001:00000004:1.0:1789477271.512888:0:6694:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:1.0:1789477271.513253:0:6694:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:1.0:1789477271.513398:0:6694:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1789477271.513424:0:6694:0:(import.c:65:import_set_state_nolock()) ffff9d0d481a6000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789477271.513672:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d75369880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3309:x1876402802546048:12345-0@lo:8: Request processed in 852us (994us total) trans 0 rc 0/0 00000100:00100000:1.0:1789477271.513697:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:1.0:1789477271.513721:0:8042:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:1.0:1789477271.513785:0:8042:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789477271.513790:0:8042:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789477271.513792:0:8042:0:(obd_config.c:1563:class_process_config()) marker 18 (0x2) lustre-OST0001 add osc 00000020:01000000:1.0:1789477271.513796:0:8042:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789477271.513800:0:8042:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789477271.513801:0:8042:0:(obd_config.c:1563:class_process_config()) marker 23 (0x1) lustre sys.timeout 00000020:00000080:1.0:1789477271.513804:0:8042:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1789477271.513806:0:8042:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:1.0:1789477271.513831:0:8042:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d7f739c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:07d5e05c-913f-419f-adbc-d3cf15e9cd51:8042:1876402802546176:0@lo:502: 00000100:00100000:1.0:1789477271.513881:0:8042:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789477271.513916:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802546176 00000100:00100000:1.0:1789477271.514077:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802546176 00000100:00100000:1.0:1789477271.514113:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1789477271.514121:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d4e674050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:07d5e05c-913f-419f-adbc-d3cf15e9cd51+18:8042:x1876402802546176:12345-0@lo:502: 00000100:00100000:1.0:1789477271.514350:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d4e674050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:07d5e05c-913f-419f-adbc-d3cf15e9cd51+18:8042:x1876402802546176:12345-0@lo:502: Request processed in 229us (468us total) trans 0 rc 0/0 00000100:00100000:1.0:1789477271.514357:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1789477271.514397:0:8042:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d0d7faa99c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789477271.514417:0:8042:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d7f739c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:07d5e05c-913f-419f-adbc-d3cf15e9cd51:8042:1876402802546176:0@lo:502: 00000020:01000000:1.0:1789477271.514440:0:8042:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789477271.514445:0:8042:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789477271.514447:0:8042:0:(obd_config.c:1563:class_process_config()) marker 23 (0x2) lustre sys.timeout 00000040:00080000:1.0:1789477271.514457:0:8042:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00000020:01000000:1.0:1789477271.514502:0:5841:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 25-33 (rc=0) 10000000:01000000:1.0:1789477271.514520:0:5841:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.123@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:1.0:1789477271.514530:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.123@tcp lock: ffff9d0d59d6a200/0xafddb3c8f9281603 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xafddb3c8f928160a expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477271.514540:0:5841:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.123@tcp lock: ffff9d0d59d6a200/0xafddb3c8f9281603 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xafddb3c8f928160a expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789477271.514551:0:5841:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:1.0:1789477271.514553:0:5841:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff9d0d482499b8 from 1 10000000:01000000:1.0:1789477271.514556:0:5841:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1789477271.514601:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.123@tcp lock: ffff9d0d41647a00/0xafddb3c8f928162d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477271.514610:0:5841:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.123@tcp lock: ffff9d0d41647a00/0xafddb3c8f928162d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477271.514619:0:5841:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.123@tcp lock: ffff9d0d41647a00/0xafddb3c8f928162d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789477271.514632:0:5841:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d7f739c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07d5e05c-913f-419f-adbc-d3cf15e9cd51:5841:1876402802546304:0@lo:101: 00000100:00100000:1.0:1789477271.514659:0:5841:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789477271.514675:0:5841:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d0d510ab240 going to sleep for 11 seconds 00000100:00100000:1.0:1789477271.514701:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802546304 00000100:00100000:1.0:1789477271.514705:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802546304 00000100:00100000:1.0:1789477271.514728:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1789477271.514734:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d4e677050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07d5e05c-913f-419f-adbc-d3cf15e9cd51+18:5841:x1876402802546304:12345-0@lo:101: 00010000:00010000:1.0:1789477271.514743:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789477271.514755:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d0d41647600/0xafddb3c8f9281634 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xafddb3c8f928162d expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477271.514784:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d0d41647600/0xafddb3c8f9281634 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xafddb3c8f928162d expref: 19 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477271.514794:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d0d41647600/0xafddb3c8f9281634 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xafddb3c8f928162d expref: 19 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477271.514803:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d0d41647600, rc 0) 00000100:00100000:1.0:1789477271.514833:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d4e677050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07d5e05c-913f-419f-adbc-d3cf15e9cd51+19:5841:x1876402802546304:12345-0@lo:101: Request processed in 98us (172us total) trans 0 rc 0/0 00000100:00100000:1.0:1789477271.514838:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1789477271.514865:0:5841:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d7f739c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07d5e05c-913f-419f-adbc-d3cf15e9cd51:5841:1876402802546304:0@lo:101: 00010000:00010000:1.0:1789477271.514890:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.123@tcp lock: ffff9d0d41647a00/0xafddb3c8f928162d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xafddb3c8f9281634 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477271.514909:0:5841:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.123@tcp lock: ffff9d0d41647a00/0xafddb3c8f928162d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xafddb3c8f9281634 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789477271.514957:0:5841:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d7f739c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07d5e05c-913f-419f-adbc-d3cf15e9cd51:5841:1876402802546432:0@lo:501: 00000100:00100000:1.0:1789477271.514984:0:5841:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789477271.515170:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d58245c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1876402802546688:0@lo:400: 00000100:00100000:3.0:1789477271.515202:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789477271.515356:0:5841:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d0d510ab240 going to sleep for 11 seconds 00000100:00100000:3.0:1789477271.515365:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789477271.515374:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d58245180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3311:1876402802546560:0@lo:400: 00000100:00100000:3.0:1789477271.515400:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789477271.515438:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802546432 00000100:00100000:1.0:1789477271.515443:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802546432 00000100:00100000:1.0:1789477271.515466:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1789477271.515472:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d4e676c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07d5e05c-913f-419f-adbc-d3cf15e9cd51+19:5841:x1876402802546432:12345-0@lo:501: 00000100:00100000:1.0:1789477271.515705:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d4e676c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07d5e05c-913f-419f-adbc-d3cf15e9cd51+19:5841:x1876402802546432:12345-0@lo:501: Request processed in 231us (720us total) trans 0 rc -2/-2 00000100:00100000:1.0:1789477271.515712:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1789477271.515770:0:5841:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d7f739c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07d5e05c-913f-419f-adbc-d3cf15e9cd51:5841:1876402802546432:0@lo:501: 10000000:01000000:1.0:1789477271.515788:0:5841:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.123@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1789477271.515793:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.123@tcp lock: ffff9d0d41647a00/0xafddb3c8f928162d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xafddb3c8f9281634 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477271.515801:0:5841:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.123@tcp lock: ffff9d0d41647a00/0xafddb3c8f928162d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xafddb3c8f9281634 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00080000:0.0:1789477271.516150:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d0d7f738000 x1876402802546048/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1789477281 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789477271.516161:0:3309:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1789477271.516168:0:3309:0:(import.c:1133:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 1 00000100:00080000:0.0:1789477271.516184:0:3309:0:(import.c:957:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1789477271.516189:0:3309:0:(import.c:1214:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:0.0:1789477271.516192:0:3309:0:(import.c:65:import_set_state_nolock()) ffff9d0d7c06f000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1789477271.516211:0:3309:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1789477271.516217:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d7f738000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3309:1876402802546048:0@lo:8: 00000004:00080000:1.0:1789477271.516314:0:8043:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:1.0:1789477271.516420:0:8043:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 216587842047ns, next at 0ns, rc = 0 00000100:00100000:2.0:1789477271.516667:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d58247100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3312:1876402802546816:0@lo:400: 00000100:00100000:2.0:1789477271.516719:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789477271.516748:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789477271.516756:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d58244380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3312:1876402802546944:0@lo:400: 00000100:00100000:1.0:1789477271.516758:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802546560 00000100:00100000:1.0:1789477271.516765:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802546560 00000100:00100000:2.0:1789477271.516785:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789477271.516839:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802546688 00000100:00100000:2.0:1789477271.516845:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802546688 00000100:00100000:1.0:1789477271.516845:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802546816 00000100:00100000:1.0:1789477271.516851:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802546816 00000100:00100000:1.0:1789477271.516891:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802546944 00000100:00100000:1.0:1789477271.516894:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802546944 00000100:00100000:2.0:1789477271.516905:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789477271.517081:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1789477271.517090:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d58246a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1876402802546560:12345-0@lo:400: 00000100:00100000:1.0:1789477271.517137:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d58246a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1876402802546560:12345-0@lo:400: Request processed in 50us (1736us total) trans 0 rc 0/0 00000100:00100000:1.0:1789477271.517144:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1789477271.517158:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1789477271.517165:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d7bddf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1876402802546816:12345-0@lo:400: 00000100:00100000:1.0:1789477271.517200:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d7bddf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1876402802546816:12345-0@lo:400: Request processed in 37us (482us total) trans 0 rc 0/0 00000100:00100000:1.0:1789477271.517206:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1789477271.517217:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1789477271.517222:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d7bddf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1876402802546944:12345-0@lo:400: 00000100:00100000:1.0:1789477271.517350:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d7bddf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1876402802546944:12345-0@lo:400: Request processed in 129us (567us total) trans 0 rc 0/0 00000100:00100000:1.0:1789477271.517357:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00010000:00080000:3.0:1789477271.517393:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d0d58245180 x1876402802546560/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789477287 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789477271.517407:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d58245180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3311:1876402802546560:0@lo:400: 00000100:00080000:3.0:1789477271.519838:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789477271.519850:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789477271.519954:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d58244000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3311:x1876402802546688:12345-0@lo:400: 00000100:00100000:2.0:1789477271.520044:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d58244000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3311:x1876402802546688:12345-0@lo:400: Request processed in 3130us (4840us total) trans 0 rc 0/0 00000100:00100000:2.0:1789477271.520054:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:2.0:1789477271.520111:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d0d58244380 x1876402802546944/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789477287 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789477271.520125:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d58244380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3312:1876402802546944:0@lo:400: 00010000:00080000:2.0:1789477271.520140:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d0d58247100 x1876402802546816/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789477287 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789477271.520149:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d58247100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3312:1876402802546816:0@lo:400: 00010000:00080000:2.0:1789477271.520188:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d0d58245c00 x1876402802546688/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789477287 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789477271.520198:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d58245c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1876402802546688:0@lo:400: 00000004:00080000:1.0:1789477271.572473:0:5868:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00000100:00100000:3.0:1789477271.572602:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d7536b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1876402802547072:0@lo:13: 00000100:00100000:3.0:1789477271.572671:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789477271.572706:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802547072 00000100:00100000:1.0:1789477271.572714:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802547072 00000100:00100000:1.0:1789477271.572769:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000004:00080000:0.0:1789477271.572772:0:8044:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x100010000:0x1:0x0] 00000100:00100000:1.0:1789477271.572780:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d58245180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3310:x1876402802547072:12345-0@lo:13: 00000100:00100000:0.0:1789477271.572794:0:8044:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d75368a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8044:1876402802547200:0@lo:7: 00002000:00000024:1.0:1789477271.572811:0:6698:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3860856832 avail 3858759680 00000100:00100000:0.0:1789477271.572821:0:8044:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789477271.572840:0:8044:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d0d50abd900 going to sleep for 11 seconds 00000100:00100000:0.0:1789477271.572857:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802547200 00000100:00100000:0.0:1789477271.572860:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802547200 00000100:00100000:1.0:1789477271.573138:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d58245180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3310:x1876402802547072:12345-0@lo:13: Request processed in 359us (466us total) trans 0 rc 0/0 00000100:00100000:1.0:1789477271.573146:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:1.0:1789477271.573167:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789477271.573221:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1789477271.573235:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d75369f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:8044:x1876402802547200:12345-0@lo:7: 00010000:00080000:3.0:1789477271.573771:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d0d7536b800 x1876402802547072/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789477287 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789477271.573803:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d7536b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1876402802547072:0@lo:13: 00002000:00080000:1.0:1789477271.577918:0:6696:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x0 00002000:00080000:1.0:1789477271.577928:0:6696:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x100010000:0x0:0x0] 00000100:00100000:1.0:1789477271.578022:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d75369f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:8044:x1876402802547200:12345-0@lo:7: Request processed in 4791us (5196us total) trans 0 rc 0/0 00000100:00100000:1.0:1789477271.578033:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:0.0:1789477271.578077:0:8044:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d0d75368a80 x1876402802547200/t0(0) o7->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1789477287 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789477271.578093:0:8044:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d75368a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8044:1876402802547200:0@lo:7: 00000004:00080000:0.0:1789477271.578109:0:8044:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0000: Got last_fid [0x100010000:0x0:0x0] 00000100:00100000:0.0:1789477271.578147:0:8044:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d75368a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8044:1876402802547328:0@lo:5: 00000100:00100000:0.0:1789477271.578180:0:8044:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789477271.578231:0:8044:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d0d50abd900 going to sleep for 11 seconds 00000100:00100000:2.0:1789477271.578339:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802547328 00000100:00100000:2.0:1789477271.578345:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802547328 00000100:00100000:2.0:1789477271.578384:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1789477271.578391:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d7536bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:8044:x1876402802547328:12345-0@lo:5: 00002000:00080000:2.0:1789477271.578413:0:6694:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:2.0:1789477271.578415:0:6694:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 1 objects in group 0x0 at 1 00000100:00100000:2.0:1789477271.578743:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d7536bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:8044:x1876402802547328:12345-0@lo:5: Request processed in 352us (563us total) trans 4294967297 rc 0/0 00000100:00100000:2.0:1789477271.578748:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:0.0:1789477271.579841:0:8044:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d0d75368a80 x1876402802547328/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1789477287 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789477271.579859:0:8044:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d75368a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8044:1876402802547328:0@lo:5: 00000004:00080000:0.0:1789477271.579872:0:8044:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x100010000:0x1:0x0] from OST, last_created [0x100010000:0x1:0x0]last_used is [0x100010000:0x1:0x0] 00000100:00100000:0.0:1789477271.579908:0:8044:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d7536a300 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8044:1876402802547456:0@lo:700: 00000100:00100000:0.0:1789477271.580214:0:8044:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789477271.580305:0:8044:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d0d50abd900 going to sleep for 11 seconds 00000100:00100000:3.0:1789477271.580352:0:6703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802547456 00000100:00100000:3.0:1789477271.580359:0:6703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802547456 00000100:00100000:3.0:1789477271.580440:0:6703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789477271.580449:0:6703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d75369500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:8044:x1876402802547456:12345-0@lo:700: 00000100:00100000:3.0:1789477271.580484:0:6703:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d58244a80 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:6703:1876402802547584:0@lo:700: 00000100:00100000:3.0:1789477271.580513:0:6703:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789477271.580544:0:6703:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d0d50a5d900 going to sleep for 11 seconds 00000100:00100000:2.0:1789477271.580615:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802547584 00000100:00100000:2.0:1789477271.580618:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802547584 00000100:00100000:2.0:1789477271.580644:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789477271.580650:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d58247b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:6703:x1876402802547584:12345-0@lo:700: 40000000:02000000:2.0:1789477271.618498:0:5851:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:1:ost 00000100:00100000:2.0:1789477271.630121:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d58247b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:6703:x1876402802547584:12345-0@lo:700: Request processed in 49463us (49598us total) trans 0 rc 0/0 00000100:00100000:2.0:1789477271.630135:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1789477271.630164:0:6703:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d0d58244a80 x1876402802547584/t0(0) o700->lustre-MDT0000-lwp-OST0001@0@lo:32/10 lens 264/248 e 0 to 0 dl 1789477287 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789477271.630181:0:6703:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d58244a80 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:6703:1876402802547584:0@lo:700: 40000000:02000000:3.0:1789477271.630209:0:6703:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0001-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:1:ost] 00000001:00100000:3.0:1789477271.701931:0:7678:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:3.0:1789477271.701954:0:7678:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967297 is committed 00000100:00100000:0.0:1789477271.702252:0:6703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d75369500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:8044:x1876402802547456:12345-0@lo:700: Request processed in 121801us (122034us total) trans 0 rc 0/0 00000100:00100000:0.0:1789477271.702269:0:6703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1789477271.702325:0:8044:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d0d7536a300 x1876402802547456/t0(0) o700->lustre-OST0001-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1789477287 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789477271.702337:0:8044:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:0.0:1789477271.702357:0:8044:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d7536a300 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8044:1876402802547456:0@lo:700: 00000004:02000040:0.0:1789477271.751337:0:8044:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x280000400 00000100:00100000:0.0:1789477271.756142:0:8044:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d7536a300 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8044:1876402802547712:0@lo:5: 00000100:00100000:0.0:1789477271.756399:0:8044:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789477271.756460:0:8044:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d0d5046c900 going to sleep for 11 seconds 00000100:00100000:2.0:1789477271.756769:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802547712 00000100:00100000:2.0:1789477271.756777:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802547712 00000100:00100000:2.0:1789477271.756828:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1789477271.756838:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d75368a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:8044:x1876402802547712:12345-0@lo:5: 00002000:00080000:1.0:1789477271.762479:0:6696:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x280000400 00002000:00080000:1.0:1789477271.762501:0:6696:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x280000400 at 2 00000100:00100000:0.0:1789477271.771222:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d75368a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:8044:x1876402802547712:12345-0@lo:5: Request processed in 14327us (14766us total) trans 4294967298 rc 0/0 00000100:00100000:0.0:1789477271.771236:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00080000:1.0:1789477271.772434:0:8044:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d0d7536a300 x1876402802547712/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1789477287 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789477271.772456:0:8044:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d7536a300 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8044:1876402802547712:0@lo:5: 00000004:00080000:1.0:1789477271.772473:0:8044:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x280000400:0x1:0x0]-[0x280000400:0x21:0x0] 00010000:00010000:1.0:1789477272.240747:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789477273.263920:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789477274.040445:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789477274.042105:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d7536ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1876402802547840:0@lo:13: 00000100:00100000:0.0:1789477274.042301:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789477274.042403:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802547840 00000100:00100000:0.0:1789477274.042414:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802547840 00000100:00100000:0.0:1789477274.042729:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1789477274.042744:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d7536b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1876402802547840:12345-0@lo:13: 00002000:00000024:0.0:1789477274.042793:0:6698:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789477274.042855:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d7536b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1876402802547840:12345-0@lo:13: Request processed in 114us (556us total) trans 0 rc 0/0 00000100:00100000:0.0:1789477274.042877:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00080000:0.0:1789477274.042903:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1789477274.042941:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d0d7536ad80 x1876402802547840/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789477290 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789477274.042965:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d7536ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1876402802547840:0@lo:13: 00010000:00010000:0.0:1789477274.290490:0:6710:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789477275.311869:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1789477275.833899:0:7678:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967298 is committed 00000100:00100000:1.0:1789477276.195164:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:3.0:1789477276.195313:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783649920 00000100:00100000:3.0:1789477276.195324:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783649920 00000100:00100000:3.0:1789477276.195370:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 112 00000100:00100000:3.0:1789477276.195379:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d4e675450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:2351:x1876402783649920:12345-192.168.201.23@tcp:250: 00010000:00080000:3.0:1789477276.195410:0:5837:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from 5c82dded-6a10-4ce8-abd1-52bd956b9523@192.168.201.23@tcp t0 exp 0000000000000000 cur 221 last 0 00000020:00000080:3.0:1789477276.195437:0:5837:0:(genops.c:1385:class_connect()) connect: client 5c82dded-6a10-4ce8-abd1-52bd956b9523, cookie 0xafddb3c8f928163b 00000100:00080000:3.0:1789477276.195573:0:5837:0:(import.c:65:import_set_state_nolock()) ffff9d0d7535e800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789477276.195911:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d4e675450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5c82dded-6a10-4ce8-abd1-52bd956b9523+5:2351:x1876402783649920:12345-192.168.201.23@tcp:250: Request processed in 530us (755us total) trans 0 rc 0/0 00000100:00100000:3.0:1789477276.196250:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 112 00000100:00100000:2.0:1789477276.204884:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:3.0:1789477276.204985:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783650048 00000100:00100000:3.0:1789477276.204996:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783650048 00000100:00100000:3.0:1789477276.205050:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 113 00000100:00100000:3.0:1789477276.205061:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d4e676050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5c82dded-6a10-4ce8-abd1-52bd956b9523+5:5592:x1876402783650048:12345-192.168.201.23@tcp:101: 00010000:00010000:3.0:1789477276.205080:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789477276.205098:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d0d49ecbe00/0xafddb3c8f9281642 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0xa90d500d7b8f2977 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477276.205126:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d0d49ecbe00/0xafddb3c8f9281642 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2977 expref: 6 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477276.205138:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d0d49ecbe00/0xafddb3c8f9281642 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2977 expref: 6 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477276.205148:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d0d49ecbe00, rc 0) 00000100:00100000:3.0:1789477276.205201:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d4e676050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5c82dded-6a10-4ce8-abd1-52bd956b9523+6:5592:x1876402783650048:12345-192.168.201.23@tcp:101: Request processed in 142us (327us total) trans 0 rc 0/0 00000100:00100000:3.0:1789477276.205209:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 113 00000100:00100000:2.0:1789477276.206475:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:2.0:1789477276.206504:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783650176 00000100:00100000:2.0:1789477276.206511:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783650176 00000100:00100000:2.0:1789477276.206547:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 114 00000100:00100000:2.0:1789477276.206556:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d4e675c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5c82dded-6a10-4ce8-abd1-52bd956b9523+6:5592:x1876402783650176:12345-192.168.201.23@tcp:501: 00000100:00100000:2.0:1789477276.206824:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d4e675c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5c82dded-6a10-4ce8-abd1-52bd956b9523+6:5592:x1876402783650176:12345-192.168.201.23@tcp:501: Request processed in 267us (353us total) trans 0 rc -2/-2 00000100:00100000:2.0:1789477276.206832:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 114 00000100:00100000:0.0:1789477276.208071:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:0.0:1789477276.210178:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783650304 00000100:00100000:0.0:1789477276.210192:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783650304 00000100:00100000:0.0:1789477276.210247:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 115 00000100:00100000:0.0:1789477276.210258:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d4e677c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5c82dded-6a10-4ce8-abd1-52bd956b9523+6:5592:x1876402783650304:12345-192.168.201.23@tcp:101: 00010000:00010000:0.0:1789477276.210274:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789477276.210291:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d0d40031200/0xafddb3c8f9281649 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xa90d500d7b8f297e expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477276.210320:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d0d40031200/0xafddb3c8f9281649 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f297e expref: 7 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477276.210331:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d0d40031200/0xafddb3c8f9281649 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f297e expref: 7 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477276.210341:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d0d40031200, rc 0) 00000100:00100000:0.0:1789477276.210397:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d4e677c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5c82dded-6a10-4ce8-abd1-52bd956b9523+7:5592:x1876402783650304:12345-192.168.201.23@tcp:101: Request processed in 141us (2329us total) trans 0 rc 0/0 00000100:00100000:0.0:1789477276.210404:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 115 00000100:00100000:2.0:1789477276.213332:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:3.0:1789477276.213405:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783650432 00000100:00100000:3.0:1789477276.213415:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783650432 00000100:00100000:3.0:1789477276.213468:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 116 00000100:00100000:3.0:1789477276.213479:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d4e677450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5c82dded-6a10-4ce8-abd1-52bd956b9523+7:5592:x1876402783650432:12345-192.168.201.23@tcp:501: 00000100:00100000:3.0:1789477276.213823:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d4e677450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5c82dded-6a10-4ce8-abd1-52bd956b9523+8:5592:x1876402783650432:12345-192.168.201.23@tcp:501: Request processed in 345us (500us total) trans 0 rc 0/0 00000100:00100000:3.0:1789477276.213832:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 116 00000100:00100000:2.0:1789477276.215735:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:1.0:1789477276.215814:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783650560 00000100:00100000:1.0:1789477276.215838:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783650560 00000100:00100000:1.0:1789477276.215891:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 117 00000100:00100000:1.0:1789477276.215901:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d4e675850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5c82dded-6a10-4ce8-abd1-52bd956b9523+8:5592:x1876402783650560:12345-192.168.201.23@tcp:503: 00000100:00100000:1.0:1789477276.216157:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d4e675850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5c82dded-6a10-4ce8-abd1-52bd956b9523+8:5592:x1876402783650560:12345-192.168.201.23@tcp:503: Request processed in 257us (432us total) trans 0 rc 0/0 00000100:00100000:1.0:1789477276.216166:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 117 00000100:00100000:3.0:1789477276.221102:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:1.0:1789477276.221277:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783650688 00000100:00100000:1.0:1789477276.221286:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783650688 00000100:00100000:1.0:1789477276.221397:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 118 00000100:00100000:1.0:1789477276.221405:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d4e675050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5c82dded-6a10-4ce8-abd1-52bd956b9523+8:5611:x1876402783650688:12345-192.168.201.23@tcp:502: 00000100:00100000:1.0:1789477276.221807:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d4e675050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5c82dded-6a10-4ce8-abd1-52bd956b9523+8:5611:x1876402783650688:12345-192.168.201.23@tcp:502: Request processed in 399us (715us total) trans 0 rc 0/0 00000100:00100000:1.0:1789477276.221815:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 118 00000100:00100000:2.0:1789477276.235848:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:3.0:1789477276.235963:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783650816 00000100:00100000:3.0:1789477276.235977:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783650816 00000100:00100000:3.0:1789477276.236033:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 119 00000100:00100000:3.0:1789477276.236044:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d4e674850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5c82dded-6a10-4ce8-abd1-52bd956b9523+8:5611:x1876402783650816:12345-192.168.201.23@tcp:502: 00000100:00100000:3.0:1789477276.236304:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d4e674850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5c82dded-6a10-4ce8-abd1-52bd956b9523+8:5611:x1876402783650816:12345-192.168.201.23@tcp:502: Request processed in 261us (467us total) trans 0 rc 0/0 00000100:00100000:3.0:1789477276.236313:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 119 00000100:00100000:2.0:1789477276.242010:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:3.0:1789477276.242054:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783650944 00000100:00100000:3.0:1789477276.242064:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783650944 00000100:00100000:3.0:1789477276.242206:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 120 00000100:00100000:3.0:1789477276.242220:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d4e676850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5c82dded-6a10-4ce8-abd1-52bd956b9523+8:5592:x1876402783650944:12345-192.168.201.23@tcp:101: 00010000:00010000:3.0:1789477276.242239:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789477276.242262:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d0d49ecae00/0xafddb3c8f9281650 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xa90d500d7b8f29a8 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477276.242290:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d0d49ecae00/0xafddb3c8f9281650 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f29a8 expref: 9 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477276.242301:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d0d49ecae00/0xafddb3c8f9281650 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f29a8 expref: 9 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477276.242311:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d0d49ecae00, rc 0) 00000100:00100000:3.0:1789477276.242514:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d4e676850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5c82dded-6a10-4ce8-abd1-52bd956b9523+9:5592:x1876402783650944:12345-192.168.201.23@tcp:101: Request processed in 298us (514us total) trans 0 rc 0/0 00000100:00100000:3.0:1789477276.242522:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 120 00000100:00100000:3.0:1789477276.246281:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:0.0:1789477276.246372:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783651072 00000100:00100000:0.0:1789477276.246392:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783651072 00000100:00100000:3.0:1789477276.246659:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 121 00000100:00100000:3.0:1789477276.246680:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d4e674c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5c82dded-6a10-4ce8-abd1-52bd956b9523+9:5592:x1876402783651072:12345-192.168.201.23@tcp:256: 20000000:01000000:3.0:1789477276.246719:0:5837:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:3.0:1789477276.246737:0:5837:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:3.0:1789477276.246741:0:5837:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:3.0:1789477276.246743:0:5837:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:3.0:1789477276.246746:0:5837:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 5 00000100:00100000:3.0:1789477276.248637:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d4e674c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5c82dded-6a10-4ce8-abd1-52bd956b9523+9:5592:x1876402783651072:12345-192.168.201.23@tcp:256: Request processed in 1956us (2354us total) trans 0 rc 0/0 00000100:00100000:3.0:1789477276.248651:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 121 00000100:00100000:0.0:1789477276.251455:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:3.0:1789477276.251890:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783651200 00000100:00100000:3.0:1789477276.251903:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783651200 00000100:00100000:3.0:1789477276.252113:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 122 00000100:00100000:3.0:1789477276.252126:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d4e674450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5c82dded-6a10-4ce8-abd1-52bd956b9523+9:5592:x1876402783651200:12345-192.168.201.23@tcp:101: 00010000:00010000:3.0:1789477276.252146:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789477276.252168:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d0d49eca800/0xafddb3c8f9281657 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xa90d500d7b8f29af expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477276.252202:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d0d49eca800/0xafddb3c8f9281657 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f29af expref: 10 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477276.252214:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d0d49eca800/0xafddb3c8f9281657 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f29af expref: 10 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477276.252224:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d0d49eca800, rc 0) 00000100:00100000:3.0:1789477276.252286:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d4e674450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5c82dded-6a10-4ce8-abd1-52bd956b9523+10:5592:x1876402783651200:12345-192.168.201.23@tcp:101: Request processed in 163us (840us total) trans 0 rc 0/0 00000100:00100000:3.0:1789477276.252293:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 122 00000100:00100000:0.0:1789477276.256747:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:1.0:1789477276.256840:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783651328 00000100:00100000:1.0:1789477276.256850:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783651328 00000100:00100000:1.0:1789477276.256934:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 123 00000100:00100000:1.0:1789477276.256944:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d48461050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5c82dded-6a10-4ce8-abd1-52bd956b9523+10:5592:x1876402783651328:12345-192.168.201.23@tcp:501: 00000100:00100000:1.0:1789477276.257194:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d48461050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5c82dded-6a10-4ce8-abd1-52bd956b9523+10:5592:x1876402783651328:12345-192.168.201.23@tcp:501: Request processed in 249us (455us total) trans 0 rc 0/0 00000100:00100000:1.0:1789477276.257203:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 123 00000100:00100000:0.0:1789477276.260992:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:3.0:1789477276.261033:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783651456 00000100:00100000:3.0:1789477276.261043:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783651456 00000100:00100000:3.0:1789477276.261220:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 124 00000100:00100000:3.0:1789477276.261231:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d48460850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5c82dded-6a10-4ce8-abd1-52bd956b9523+10:5592:x1876402783651456:12345-192.168.201.23@tcp:503: 00000100:00100000:3.0:1789477276.261618:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d48460850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5c82dded-6a10-4ce8-abd1-52bd956b9523+10:5592:x1876402783651456:12345-192.168.201.23@tcp:503: Request processed in 388us (631us total) trans 0 rc 0/0 00000100:00100000:3.0:1789477276.261627:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 124 00000100:00100000:0.0:1789477276.268003:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:1.0:1789477276.268122:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783651584 00000100:00100000:1.0:1789477276.268132:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783651584 00000100:00100000:1.0:1789477276.268190:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 125 00000100:00100000:1.0:1789477276.268201:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d48462850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5c82dded-6a10-4ce8-abd1-52bd956b9523+10:5615:x1876402783651584:12345-192.168.201.23@tcp:502: 00000100:00100000:1.0:1789477276.268645:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d48462850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5c82dded-6a10-4ce8-abd1-52bd956b9523+10:5615:x1876402783651584:12345-192.168.201.23@tcp:502: Request processed in 444us (652us total) trans 0 rc 0/0 00000100:00100000:1.0:1789477276.268663:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 125 00000100:00100000:3.0:1789477276.281088:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:0.0:1789477276.281198:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783651712 00000100:00100000:0.0:1789477276.281209:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783651712 00000100:00100000:0.0:1789477276.281267:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 126 00000100:00100000:0.0:1789477276.281277:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d48460c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5c82dded-6a10-4ce8-abd1-52bd956b9523+10:5615:x1876402783651712:12345-192.168.201.23@tcp:502: 00000100:00100000:0.0:1789477276.281517:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d48460c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5c82dded-6a10-4ce8-abd1-52bd956b9523+10:5615:x1876402783651712:12345-192.168.201.23@tcp:502: Request processed in 240us (438us total) trans 0 rc 0/0 00000100:00100000:0.0:1789477276.281536:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 126 00000100:00100000:2.0:1789477276.288497:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:2.0:1789477276.288547:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783651840 00000100:00100000:2.0:1789477276.288560:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783651840 00000100:00100000:2.0:1789477276.288634:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 4 00000100:00100000:2.0:1789477276.288643:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d7bddd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2351:x1876402783651840:12345-192.168.201.23@tcp:38: 00010000:00080000:2.0:1789477276.288674:0:5844:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from 9bc33f26-0aab-4a14-832f-c58d566de1b0@192.168.201.23@tcp t0 exp 0000000000000000 cur 221 last 0 00000020:00000080:2.0:1789477276.288723:0:5844:0:(genops.c:1385:class_connect()) connect: client 9bc33f26-0aab-4a14-832f-c58d566de1b0, cookie 0xafddb3c8f928165e 00000004:00100000:2.0:1789477276.288753:0:5844:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000001:00000004:2.0:1789477276.288759:0:5844:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00010000:00010000:2.0:1789477276.335789:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1789477276.355870:0:5844:0:(import.c:65:import_set_state_nolock()) ffff9d0d514ca000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789477276.357714:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d7bddd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9bc33f26-0aab-4a14-832f-c58d566de1b0+6:2351:x1876402783651840:12345-192.168.201.23@tcp:38: Request processed in 69057us (69214us total) trans 0 rc 0/0 00000100:00100000:2.0:1789477276.357730:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 4 00000100:00100000:0.0:1789477276.591998:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789477276.592038:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d7536ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1876402802547968:0@lo:13: 00000100:00100000:0.0:1789477276.592126:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789477276.592224:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802547968 00000100:00100000:0.0:1789477276.592234:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802547968 00000100:00100000:0.0:1789477276.592301:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1789477276.592316:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d75368000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1876402802547968:12345-0@lo:13: 00002000:00000024:0.0:1789477276.592363:0:6698:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789477276.592420:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d75368000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1876402802547968:12345-0@lo:13: Request processed in 109us (293us total) trans 0 rc 0/0 00000100:00100000:0.0:1789477276.592429:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00080000:0.0:1789477276.592454:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1789477276.592491:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d0d7536ad80 x1876402802547968/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789477292 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789477276.592503:0:3313:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:0.0:1789477276.592532:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d7536ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1876402802547968:0@lo:13: 00000100:00100000:2.0:1789477276.593078:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d58247800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3312:1876402802548480:0@lo:400: 00000100:00100000:2.0:1789477276.593130:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789477276.593170:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1789477276.593177:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d58244a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:07d5e05c-913f-419f-adbc-d3cf15e9cd51:3312:1876402802548096:0@lo:400: 00000100:00100000:3.0:1789477276.593200:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802548480 00000100:00100000:3.0:1789477276.593210:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802548480 00000100:00100000:2.0:1789477276.593211:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789477276.593253:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d58244e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3312:1876402802548608:0@lo:400: 00000100:00100000:3.0:1789477276.593267:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1789477276.593279:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d7bddc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1876402802548480:12345-0@lo:400: 00000100:00100000:2.0:1789477276.593287:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789477276.593336:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d7bddc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1876402802548480:12345-0@lo:400: Request processed in 61us (206us total) trans 0 rc 0/0 00010000:00080000:2.0:1789477276.593343:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d0d58247800 x1876402802548480/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789477292 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789477276.593348:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1789477276.593361:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d58247800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3312:1876402802548480:0@lo:400: 00000100:00100000:3.0:1789477276.593367:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802548608 00000100:00100000:3.0:1789477276.593371:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802548608 00000100:00100000:3.0:1789477276.593398:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1789477276.593404:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d7bddfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1876402802548608:12345-0@lo:400: 00000100:00100000:3.0:1789477276.593434:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d7bddfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1876402802548608:12345-0@lo:400: Request processed in 30us (149us total) trans 0 rc 0/0 00000100:00100000:3.0:1789477276.593439:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00080000:0.0:1789477276.593540:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1789477276.594048:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d0d58244e00 x1876402802548608/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789477292 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789477276.594061:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d58244e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3312:1876402802548608:0@lo:400: 00000100:00100000:1.0:1789477276.594813:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d58245500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3310:1876402802548224:0@lo:400: 00000100:00100000:1.0:1789477276.594876:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789477276.594923:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789477276.594932:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d58246d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1876402802548352:0@lo:400: 00000100:00100000:1.0:1789477276.594964:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789477276.594993:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802548352 00000100:00100000:3.0:1789477276.595002:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802548352 00000100:00100000:1.0:1789477276.595006:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802548096 00000100:00100000:1.0:1789477276.595013:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802548096 00000100:00100000:3.0:1789477276.595091:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1789477276.595101:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d7f738380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3310:x1876402802548352:12345-0@lo:400: 00000100:00100000:3.0:1789477276.595151:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d7f738380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3310:x1876402802548352:12345-0@lo:400: Request processed in 52us (188us total) trans 0 rc 0/0 00000100:00100000:3.0:1789477276.595158:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:0.0:1789477276.595270:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789477276.595344:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:1.0:1789477276.595355:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d48460450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07d5e05c-913f-419f-adbc-d3cf15e9cd51+19:3312:x1876402802548096:12345-0@lo:400: 00000100:00100000:1.0:1789477276.595405:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d48460450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07d5e05c-913f-419f-adbc-d3cf15e9cd51+19:3312:x1876402802548096:12345-0@lo:400: Request processed in 53us (2193us total) trans 0 rc 0/0 00000100:00100000:1.0:1789477276.595412:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00010000:00080000:1.0:1789477276.595462:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d0d58246d80 x1876402802548352/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789477292 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789477276.595475:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d58246d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1876402802548352:0@lo:400: 00000100:00100000:3.0:1789477276.595643:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d58244a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:07d5e05c-913f-419f-adbc-d3cf15e9cd51:3312:1876402802548096:0@lo:400: 00000100:00100000:2.0:1789477276.595899:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802548224 00000100:00100000:2.0:1789477276.595911:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802548224 00000100:00100000:2.0:1789477276.595959:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1789477276.595967:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d7f739c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1876402802548224:12345-0@lo:400: 00000100:00100000:2.0:1789477276.596028:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d7f739c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1876402802548224:12345-0@lo:400: Request processed in 62us (1152us total) trans 0 rc 0/0 00000100:00100000:2.0:1789477276.596036:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00010000:00080000:1.0:1789477276.596285:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d0d58245500 x1876402802548224/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789477292 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789477276.596309:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d58245500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3310:1876402802548224:0@lo:400: 00010000:00010000:0.0:1789477277.363539:0:6710:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789477277.397166:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:2.0:1789477277.397482:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783652096 00000100:00100000:2.0:1789477277.397496:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783652096 00000100:00100000:3.0:1789477277.397615:0:6999:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 5 00000100:00100000:3.0:1789477277.397630:0:6999:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d58244a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9bc33f26-0aab-4a14-832f-c58d566de1b0+6:5592:x1876402783652096:12345-192.168.201.23@tcp:41: 00000100:00080000:0.0:1789477277.397689:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00000024:3.0:1789477277.397702:0:6999:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261778432 avail 2259681280 00000100:00100000:3.0:1789477277.398523:0:6999:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d58244a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9bc33f26-0aab-4a14-832f-c58d566de1b0+6:5592:x1876402783652096:12345-192.168.201.23@tcp:41: Request processed in 892us (1366us total) trans 0 rc 0/0 00000100:00100000:3.0:1789477277.398534:0:6999:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 5 00000100:00100000:0.0:1789477277.399022:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:3.0:1789477277.399509:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783651968 00000100:00100000:3.0:1789477277.399520:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783651968 00000100:00100000:3.0:1789477277.399994:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 6 00000100:00100000:3.0:1789477277.400007:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d7536ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9bc33f26-0aab-4a14-832f-c58d566de1b0+6:0:x1876402783651968:12345-192.168.201.23@tcp:41: 00000004:00000024:3.0:1789477277.400041:0:5845:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261778432 avail 2259681280 00000100:00100000:3.0:1789477277.400111:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d7536ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9bc33f26-0aab-4a14-832f-c58d566de1b0+6:0:x1876402783651968:12345-192.168.201.23@tcp:41: Request processed in 107us (1091us total) trans 0 rc 0/0 00000100:00100000:3.0:1789477277.400119:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 6 00000100:00100000:0.0:1789477277.410538:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:2.0:1789477277.410664:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783652224 00000100:00100000:2.0:1789477277.410678:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783652224 00000100:00100000:2.0:1789477277.410761:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 7 00000100:00100000:2.0:1789477277.410775:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d7536a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9bc33f26-0aab-4a14-832f-c58d566de1b0+6:5592:x1876402783652224:12345-192.168.201.23@tcp:40: 00000100:00100000:2.0:1789477277.410894:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d7536a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9bc33f26-0aab-4a14-832f-c58d566de1b0+6:5592:x1876402783652224:12345-192.168.201.23@tcp:40: Request processed in 122us (375us total) trans 0 rc 0/0 00000100:00100000:2.0:1789477277.410903:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 7 00000100:00100000:2.0:1789477277.414519:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:0.0:1789477277.414618:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783652352 00000100:00100000:0.0:1789477277.414633:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783652352 00000100:00100000:2.0:1789477277.414650:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:2.0:1789477277.414696:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:0.0:1789477277.414700:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 9 00000100:00100000:0.0:1789477277.414710:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d7bddd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2351:x1876402783652352:12345-192.168.201.23@tcp:8: 00000100:00100000:1.0:1789477277.414752:0:6694:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00010000:00080000:0.0:1789477277.414752:0:6696:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 9bc33f26-0aab-4a14-832f-c58d566de1b0@192.168.201.23@tcp t0 exp 0000000000000000 cur 222 last 0 00000100:00100000:1.0:1789477277.414768:0:6694:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000020:00000080:0.0:1789477277.414801:0:6696:0:(genops.c:1385:class_connect()) connect: client 9bc33f26-0aab-4a14-832f-c58d566de1b0, cookie 0xafddb3c8f9281665 00002000:00100000:0.0:1789477277.414820:0:6696:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 9bc33f26-0aab-4a14-832f-c58d566de1b0/ffff9d0d7f528800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113954 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1789477277.414852:0:6696:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00000100:00100000:1.0:1789477277.414917:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783652480 00000100:00100000:1.0:1789477277.414923:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783652480 00000100:00100000:1.0:1789477277.415021:0:8241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 10 00000100:00100000:1.0:1789477277.415028:0:8241:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d6d3d4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2351:x1876402783652480:12345-192.168.201.23@tcp:8: 00010000:00080000:1.0:1789477277.415056:0:8241:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 9bc33f26-0aab-4a14-832f-c58d566de1b0@192.168.201.23@tcp t0 exp 0000000000000000 cur 222 last 0 00000020:00000080:1.0:1789477277.415083:0:8241:0:(genops.c:1385:class_connect()) connect: client 9bc33f26-0aab-4a14-832f-c58d566de1b0, cookie 0xafddb3c8f928166c 00002000:00100000:1.0:1789477277.415091:0:8241:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 9bc33f26-0aab-4a14-832f-c58d566de1b0/ffff9d0d481a0000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113954 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1789477277.415099:0:8241:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:0.0:1789477277.415355:0:6696:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1789477277.415407:0:6696:0:(import.c:65:import_set_state_nolock()) ffff9d0d7f529800 : changing import state from RECOVER to FULL 00002000:00080000:1.0:1789477277.415457:0:8241:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1789477277.415475:0:8241:0:(import.c:65:import_set_state_nolock()) ffff9d0d481a7800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789477277.415492:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d7bddd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9bc33f26-0aab-4a14-832f-c58d566de1b0+6:2351:x1876402783652352:12345-192.168.201.23@tcp:8: Request processed in 780us (986us total) trans 0 rc 0/0 00000100:00100000:0.0:1789477277.415503:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 9 00000100:00100000:1.0:1789477277.415515:0:8241:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d6d3d4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9bc33f26-0aab-4a14-832f-c58d566de1b0+6:2351:x1876402783652480:12345-192.168.201.23@tcp:8: Request processed in 473us (806us total) trans 0 rc 0/0 00000100:00100000:1.0:1789477277.415525:0:8241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 10 00000100:00100000:3.0:1789477277.415937:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783652608 00000100:00100000:3.0:1789477277.415943:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783652608 00000100:00100000:3.0:1789477277.415989:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 0 00000100:00100000:3.0:1789477277.415998:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d6d3d4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9bc33f26-0aab-4a14-832f-c58d566de1b0+6:5592:x1876402783652608:12345-192.168.201.23@tcp:33: 00000100:00100000:1.0:1789477277.416034:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:0.0:1789477277.416613:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783652736 00000100:00100000:0.0:1789477277.416619:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783652736 00000100:00100000:0.0:1789477277.416662:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 128 00000100:00100000:0.0:1789477277.416670:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d4ec6c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5c82dded-6a10-4ce8-abd1-52bd956b9523+10:2354:x1876402783652736:12345-192.168.201.23@tcp:400: 00000100:00100000:0.0:1789477277.416721:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d4ec6c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5c82dded-6a10-4ce8-abd1-52bd956b9523+10:2354:x1876402783652736:12345-192.168.201.23@tcp:400: Request processed in 51us (687us total) trans 0 rc 0/0 00000100:00100000:0.0:1789477277.416728:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 128 00000004:00080000:2.0:1789477277.443081:0:5847:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 27010us 00000004:00200000:0.0:1789477277.470047:0:5847:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000100:00100000:0.0:1789477277.470936:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d6d3d4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9bc33f26-0aab-4a14-832f-c58d566de1b0+6:5592:x1876402783652608:12345-192.168.201.23@tcp:33: Request processed in 54928us (56274us total) trans 0 rc 0/0 00000100:00100000:0.0:1789477277.470957:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 0 00000100:00100000:1.0:1789477277.694340:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:0.0:1789477277.694468:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783652864 00000100:00100000:0.0:1789477277.694482:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783652864 00000100:00100000:0.0:1789477277.694560:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 8 00000100:00100000:0.0:1789477277.694653:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d7f73b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9bc33f26-0aab-4a14-832f-c58d566de1b0+6:5632:x1876402783652864:12345-192.168.201.23@tcp:101: 00010000:00010000:0.0:1789477277.694682:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789477277.694717:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d40030200/0xafddb3c8f9281673 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa90d500d7b8f29d9 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477277.694817:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d40030e00/0xafddb3c8f928167a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477277.694835:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d40030e00/0xafddb3c8f928167a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477277.694854:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d40030e00/0xafddb3c8f928167a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789477277.695123:0:5846:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000004:00200000:0.0:1789477277.695128:0:5846:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:0.0:1789477277.695205:0:5846:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d40030e00/0xafddb3c8f928167a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477277.695239:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d40030200/0xafddb3c8f9281673 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f29d9 expref: 8 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477277.695261:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d40030e00/0xafddb3c8f928167a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f29d9 expref: 7 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477277.695278:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9d0d596ae500) 00010000:00010000:0.0:1789477277.695282:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789477277.695287:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d0d40030e00, rc 0) 00000100:00100000:0.0:1789477277.695381:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d7f73b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9bc33f26-0aab-4a14-832f-c58d566de1b0+7:5632:x1876402783652864:12345-192.168.201.23@tcp:101: Request processed in 733us (1054us total) trans 0 rc 0/0 00000100:00100000:0.0:1789477277.695390:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 8 00010000:00010000:1.0:1789477278.384134:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789477279.151922:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789477279.151963:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d75368700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1876402802548736:0@lo:13: 00000100:00100000:2.0:1789477279.152182:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789477279.152340:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802548736 00000100:00100000:0.0:1789477279.152351:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802548736 00000100:00100000:0.0:1789477279.152447:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1789477279.152460:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d6d3d5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1876402802548736:12345-0@lo:13: 00002000:00000024:0.0:1789477279.152507:0:6698:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789477279.152624:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d6d3d5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1876402802548736:12345-0@lo:13: Request processed in 168us (560us total) trans 0 rc 0/0 00000100:00100000:0.0:1789477279.152633:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00080000:2.0:1789477279.152802:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1789477279.152997:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d0d75368700 x1876402802548736/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789477295 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789477279.153025:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d75368700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1876402802548736:0@lo:13: 00010000:00010000:2.0:1789477279.408396:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789477279.769721:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:2.0:1789477279.769783:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783652992 00000100:00100000:2.0:1789477279.769797:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783652992 00000100:00100000:2.0:1789477279.769953:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 9 00000100:00100000:2.0:1789477279.769967:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d7f738000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9bc33f26-0aab-4a14-832f-c58d566de1b0+7:5684:x1876402783652992:12345-192.168.201.23@tcp:41: 00000004:00000024:2.0:1789477279.770044:0:5844:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261778432 avail 2259681280 00000100:00100000:2.0:1789477279.770191:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d7f738000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9bc33f26-0aab-4a14-832f-c58d566de1b0+7:5684:x1876402783652992:12345-192.168.201.23@tcp:41: Request processed in 225us (484us total) trans 0 rc 0/0 00000100:00100000:2.0:1789477279.770199:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 9 00000100:00080000:0.0:1789477279.770357:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789477279.773739:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:1.0:1789477279.774105:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783653120 00000100:00100000:1.0:1789477279.774120:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783653120 00000100:00100000:1.0:1789477279.774239:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 9 00000100:00100000:1.0:1789477279.774253:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d58245500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:9bc33f26-0aab-4a14-832f-c58d566de1b0+6:5684:x1876402783653120:12345-192.168.201.23@tcp:13: 00002000:00000024:1.0:1789477279.774293:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789477279.774390:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d58245500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:9bc33f26-0aab-4a14-832f-c58d566de1b0+6:5684:x1876402783653120:12345-192.168.201.23@tcp:13: Request processed in 140us (668us total) trans 0 rc 0/0 00000100:00100000:1.0:1789477279.774399:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 9 00000100:00080000:0.0:1789477279.774484:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789477279.776398:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:2.0:1789477279.776622:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783653248 00000100:00100000:2.0:1789477279.776634:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783653248 00000100:00080000:0.0:1789477279.776711:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789477279.776726:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 10 00000100:00100000:2.0:1789477279.776739:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d74a89f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:9bc33f26-0aab-4a14-832f-c58d566de1b0+6:5684:x1876402783653248:12345-192.168.201.23@tcp:13: 00002000:00000024:2.0:1789477279.776788:0:6698:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789477279.776873:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d74a89f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:9bc33f26-0aab-4a14-832f-c58d566de1b0+6:5684:x1876402783653248:12345-192.168.201.23@tcp:13: Request processed in 136us (485us total) trans 0 rc 0/0 00000100:00100000:2.0:1789477279.776881:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 10 00010000:00010000:0.0:1789477280.437568:0:6710:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789477281.455738:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789477281.711776:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d58244e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3312:1876402802548992:0@lo:400: 00000100:00100000:3.0:1789477281.711879:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789477281.711929:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d58244380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1876402802549504:0@lo:400: 00000100:00100000:3.0:1789477281.711958:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789477281.712000:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789477281.712007:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d58247800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1876402802549120:0@lo:400: 00000100:00100000:3.0:1789477281.712030:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789477281.712065:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802548992 00000100:00100000:3.0:1789477281.712072:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802548992 00000100:00100000:3.0:1789477281.712122:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1789477281.712131:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d74cda300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1876402802548992:12345-0@lo:400: 00000100:00100000:3.0:1789477281.712187:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d74cda300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1876402802548992:12345-0@lo:400: Request processed in 57us (309us total) trans 0 rc 0/0 00000100:00100000:3.0:1789477281.712194:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1789477281.712220:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802549504 00000100:00100000:3.0:1789477281.712223:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802549504 00000100:00100000:3.0:1789477281.712254:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802549120 00000100:00100000:3.0:1789477281.712257:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802549120 00000100:00100000:3.0:1789477281.712294:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1789477281.712301:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d74cd9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3312:x1876402802549504:12345-0@lo:400: 00000100:00100000:3.0:1789477281.712330:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d74cd9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3312:x1876402802549504:12345-0@lo:400: Request processed in 30us (372us total) trans 0 rc 0/0 00000100:00100000:3.0:1789477281.712336:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1789477281.712347:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1789477281.712352:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d74cdad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3312:x1876402802549120:12345-0@lo:400: 00000100:00100000:3.0:1789477281.712377:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d74cdad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3312:x1876402802549120:12345-0@lo:400: Request processed in 25us (346us total) trans 0 rc 0/0 00000100:00100000:3.0:1789477281.712382:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00080000:3.0:1789477281.712403:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789477281.712407:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:3.0:1789477281.712435:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d0d58247800 x1876402802549120/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789477297 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789477281.712462:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d58247800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1876402802549120:0@lo:400: 00000100:00100000:3.0:1789477281.712477:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d58244e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3312:1876402802548992:0@lo:400: 00010000:00080000:3.0:1789477281.712486:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d0d58244380 x1876402802549504/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789477297 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789477281.712505:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d58244380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1876402802549504:0@lo:400: 00000100:00100000:0.0:1789477281.712941:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d58245c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3310:1876402802549248:0@lo:400: 00000100:00100000:0.0:1789477281.712975:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789477281.713007:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1789477281.713013:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d58246d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:07d5e05c-913f-419f-adbc-d3cf15e9cd51:3310:1876402802548864:0@lo:400: 00000100:00100000:0.0:1789477281.713041:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789477281.713064:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d58247100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3310:1876402802549376:0@lo:400: 00000100:00100000:0.0:1789477281.713089:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789477281.713217:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802548864 00000100:00100000:1.0:1789477281.713223:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802548864 00000100:00100000:1.0:1789477281.713256:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:1.0:1789477281.713264:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d4ec6f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:07d5e05c-913f-419f-adbc-d3cf15e9cd51+19:3310:x1876402802548864:12345-0@lo:400: 00000100:00100000:1.0:1789477281.713306:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d4ec6f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:07d5e05c-913f-419f-adbc-d3cf15e9cd51+19:3310:x1876402802548864:12345-0@lo:400: Request processed in 43us (263us total) trans 0 rc 0/0 00000100:00100000:1.0:1789477281.713312:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:1.0:1789477281.713352:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d58246d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:07d5e05c-913f-419f-adbc-d3cf15e9cd51:3310:1876402802548864:0@lo:400: 00000100:00100000:3.0:1789477281.713712:0:6999:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802549248 00000100:00100000:3.0:1789477281.713717:0:6999:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802549248 00000100:00100000:3.0:1789477281.713747:0:6999:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802549376 00000100:00100000:3.0:1789477281.713750:0:6999:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802549376 00000100:00100000:3.0:1789477281.713767:0:6999:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1789477281.713773:0:6999:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d75368380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1876402802549248:12345-0@lo:400: 00000100:00100000:3.0:1789477281.713806:0:6999:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d75368380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1876402802549248:12345-0@lo:400: Request processed in 33us (830us total) trans 0 rc 0/0 00000100:00100000:3.0:1789477281.713812:0:6999:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1789477281.713981:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d74cd8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1876402802549632:0@lo:13: 00000100:00100000:0.0:1789477281.714010:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789477281.714084:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d58245c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3310:1876402802549248:0@lo:400: 00000100:00100000:3.0:1789477281.714134:0:6999:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1789477281.714142:0:6999:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d75368e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1876402802549376:12345-0@lo:400: 00000100:00100000:3.0:1789477281.714183:0:6999:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d75368e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1876402802549376:12345-0@lo:400: Request processed in 42us (1093us total) trans 0 rc 0/0 00000100:00100000:3.0:1789477281.714189:0:6999:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00080000:3.0:1789477281.714208:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789477281.714260:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d58247100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3310:1876402802549376:0@lo:400: 00000100:00100000:2.0:1789477281.721776:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802549632 00000100:00100000:2.0:1789477281.721791:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802549632 00000100:00100000:2.0:1789477281.723383:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1789477281.723397:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d75369180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1876402802549632:12345-0@lo:13: 00002000:00000024:2.0:1789477281.723439:0:6698:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789477281.723532:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d75369180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1876402802549632:12345-0@lo:13: Request processed in 138us (9520us total) trans 0 rc 0/0 00000100:00100000:2.0:1789477281.723540:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00080000:2.0:1789477281.726140:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d0d74cd8e00 x1876402802549632/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789477297 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789477281.726168:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d74cd8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1876402802549632:0@lo:13: 00000001:00100000:0.0:1789477281.769089:0:5868:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 9bc33f26-0aab-4a14-832f-c58d566de1b0 00000001:00100000:0.0:1789477281.801256:0:7678:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 9bc33f26-0aab-4a14-832f-c58d566de1b0 00000001:02000400:3.0:1789477282.088940:0:8328:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00000001:00100000:1.0:1789477282.313359:0:6730:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 9bc33f26-0aab-4a14-832f-c58d566de1b0 00010000:00010000:2.0:1789477282.480020:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789477282.786991:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:1.0:1789477282.787089:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:1.0:1789477282.787126:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:1.0:1789477282.787162:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:1.0:1789477282.787199:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783653632 00000100:00100000:1.0:1789477282.787209:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783653632 00000100:00100000:1.0:1789477282.787278:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783653760 00000100:00100000:1.0:1789477282.787282:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783653760 00000100:00100000:1.0:1789477282.787317:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 7 00000100:00100000:1.0:1789477282.787329:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d74a8bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9bc33f26-0aab-4a14-832f-c58d566de1b0+5:2354:x1876402783653632:12345-192.168.201.23@tcp:400: 00000100:00100000:1.0:1789477282.787405:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d74a8bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9bc33f26-0aab-4a14-832f-c58d566de1b0+5:2354:x1876402783653632:12345-192.168.201.23@tcp:400: Request processed in 78us (318us total) trans 0 rc 0/0 00000100:00100000:1.0:1789477282.787414:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 7 00000100:00100000:1.0:1789477282.787440:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 8 00000100:00100000:1.0:1789477282.787461:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d74a89500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9bc33f26-0aab-4a14-832f-c58d566de1b0+5:2354:x1876402783653760:12345-192.168.201.23@tcp:400: 00000100:00100000:1.0:1789477282.787510:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d74a89500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9bc33f26-0aab-4a14-832f-c58d566de1b0+5:2354:x1876402783653760:12345-192.168.201.23@tcp:400: Request processed in 51us (349us total) trans 0 rc 0/0 00000100:00100000:1.0:1789477282.787519:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 8 00000100:00100000:1.0:1789477282.787546:0:6999:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783653504 00000100:00100000:1.0:1789477282.787549:0:6999:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783653504 00000100:00100000:1.0:1789477282.787594:0:6999:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 23 00000100:00100000:1.0:1789477282.787602:0:6999:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d74a8a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9bc33f26-0aab-4a14-832f-c58d566de1b0+6:2354:x1876402783653504:12345-192.168.201.23@tcp:400: 00000100:00100000:1.0:1789477282.788115:0:6999:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d74a8a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9bc33f26-0aab-4a14-832f-c58d566de1b0+6:2354:x1876402783653504:12345-192.168.201.23@tcp:400: Request processed in 512us (988us total) trans 0 rc 0/0 00000100:00100000:1.0:1789477282.788124:0:6999:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 23 00000100:00080000:1.0:1789477282.788152:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789477282.788156:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789477282.788159:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789477282.790446:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783653376 00000100:00100000:3.0:1789477282.790463:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783653376 00000100:00100000:3.0:1789477282.790539:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 130 00000100:00100000:3.0:1789477282.790549:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d4ec6e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5c82dded-6a10-4ce8-abd1-52bd956b9523+10:2354:x1876402783653376:12345-192.168.201.23@tcp:400: 00000100:00100000:3.0:1789477282.790706:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d4ec6e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5c82dded-6a10-4ce8-abd1-52bd956b9523+10:2354:x1876402783653376:12345-192.168.201.23@tcp:400: Request processed in 158us (3734us total) trans 0 rc 0/0 00000100:00100000:3.0:1789477282.790714:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 130 00010000:00010000:0.0:1789477283.504441:0:6710:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789477284.271951:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789477284.271989:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d7536a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1876402802549760:0@lo:13: 00000100:00100000:2.0:1789477284.272063:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789477284.272136:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802549760 00000100:00100000:3.0:1789477284.272145:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802549760 00000100:00080000:0.0:1789477284.272190:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789477284.272257:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1789477284.272268:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d6d3d7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1876402802549760:12345-0@lo:13: 00002000:00000024:3.0:1789477284.272304:0:6698:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789477284.272356:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d6d3d7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1876402802549760:12345-0@lo:13: Request processed in 89us (291us total) trans 0 rc 0/0 00000100:00100000:3.0:1789477284.272364:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00080000:1.0:1789477284.272389:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d0d7536a680 x1876402802549760/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789477300 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789477284.272410:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d7536a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1876402802549760:0@lo:13: 00010000:00010000:1.0:1789477284.527755:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1789477285.495532:0:8479:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffe2d062210 20000000:00000080:1.0:1789477285.495551:0:8479:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9d0d7c664000 uarg=0000000000000000 20000000:01000000:1.0:1789477285.495613:0:8479:0:(mgs_llog.c:2006:mgs_parse_devname()) Device name lustre without fsname 20000000:01000000:1.0:1789477285.495616:0:8479:0:(mgs_llog.c:6069:mgs_set_conf_param()) lustre is seen as a file system name 20000000:01000000:1.0:1789477285.495618:0:8479:0:(mgs_llog.c:6100:mgs_set_conf_param()) set_conf_param fs='lustre' device='lustre' param='sys.jobid_var=procname_uid' 20000000:01000000:1.0:1789477285.495623:0:8479:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.jobid_var=procname_uid' 20000000:01000000:1.0:1789477285.495629:0:8479:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.jobid_var=procname_uid' val=procname_uid 20000000:01000000:1.0:1789477285.495642:0:8479:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:1.0:1789477285.495644:0:8479:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:1.0:1789477285.495918:0:8479:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:1.0:1789477285.495921:0:8479:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.jobid_var fl=4 00000040:00080000:1.0:1789477285.497003:0:8480:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 11 count 11 00000040:00080000:3.0:1789477285.497570:0:8479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 224 off10160 00000040:00080000:3.0:1789477285.497944:0:8479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 120 off10280 00000040:00080000:3.0:1789477285.497985:0:8479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].13, 224 off10504 20000000:01000000:3.0:1789477285.498000:0:8479:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:3.0:1789477285.498003:0:8479:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.jobid_var fl=4 00000040:00080000:1.0:1789477285.498956:0:8481:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000040:00080000:3.0:1789477285.499318:0:8479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].39, 224 off14880 00000040:00080000:3.0:1789477285.499366:0:8479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].40, 120 off15000 00000040:00080000:3.0:1789477285.499401:0:8479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].41, 224 off15224 20000000:01000000:3.0:1789477285.499415:0:8479:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:3.0:1789477285.499417:0:8479:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.jobid_var fl=4 00000040:00080000:1.0:1789477285.500230:0:8482:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 8 count 8 00000040:00080000:3.0:1789477285.500556:0:8479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9632 00000040:00080000:3.0:1789477285.500853:0:8479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 120 off9752 00000040:00080000:3.0:1789477285.500896:0:8479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 224 off9976 20000000:01000000:3.0:1789477285.500911:0:8479:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:3.0:1789477285.500913:0:8479:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.jobid_var fl=4 00000040:00080000:1.0:1789477285.503161:0:8483:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00000040:00080000:0.0:1789477285.503771:0:8479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 224 off14144 00000040:00080000:0.0:1789477285.503829:0:8479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 120 off14264 00000040:00080000:0.0:1789477285.503876:0:8479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14488 10000000:01000000:0.0:1789477285.503894:0:8479:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:0.0:1789477285.503913:0:8479:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9d0d82150800/0xafddb3c8f9281681 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477285.503931:0:8479:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9d0d59d6b600/0xafddb3c8f928157e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xafddb3c8f9281577 expref: 18 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477285.503939:0:8479:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9d0d49ecb400/0xafddb3c8f92815a8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xafddb3c8f92815a1 expref: 18 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477285.503945:0:8479:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9d0d49eca000/0xafddb3c8f92815d2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xafddb3c8f92815cb expref: 18 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477285.503952:0:8479:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9d0d41647400/0xafddb3c8f92815e0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xafddb3c8f92815d9 expref: 18 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477285.503958:0:8479:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9d0d40030600/0xafddb3c8f92815ee lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xafddb3c8f92815e7 expref: 18 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477285.503964:0:8479:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9d0d40031400/0xafddb3c8f928160a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xafddb3c8f9281603 expref: 18 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477285.503982:0:8479:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9d0d41647600/0xafddb3c8f9281634 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xafddb3c8f928162d expref: 18 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477285.503992:0:8479:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9d0d49ecbe00/0xafddb3c8f9281642 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2977 expref: 9 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477285.503999:0:8479:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9d0d40031200/0xafddb3c8f9281649 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f297e expref: 9 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477285.504007:0:8479:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9d0d82150800/0xafddb3c8f9281681 lrc: 12/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477285.504045:0:8479:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9d0d40031200/0xafddb3c8f9281649 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f297e expref: 9 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477285.504062:0:8479:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9d0d40031200/0xafddb3c8f9281649 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f297e expref: 9 pid: 5838 timeout: 330 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789477285.504077:0:8479:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d7536b100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8479:1876402802549888:192.168.201.23@tcp:104: 00010000:00010000:0.0:1789477285.504177:0:8479:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9d0d49ecbe00/0xafddb3c8f9281642 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2977 expref: 9 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477285.504185:0:8479:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9d0d49ecbe00/0xafddb3c8f9281642 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2977 expref: 9 pid: 5839 timeout: 330 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789477285.504193:0:8479:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d7536aa00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8479:1876402802550016:192.168.201.23@tcp:104: 00010000:00010000:0.0:1789477285.504220:0:8479:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9d0d41647600/0xafddb3c8f9281634 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xafddb3c8f928162d expref: 18 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477285.504239:0:8479:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9d0d41647600/0xafddb3c8f9281634 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xafddb3c8f928162d expref: 18 pid: 5838 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789477285.504249:0:8479:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d75369c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8479:1876402802550144:0@lo:104: 00000100:00100000:0.0:1789477285.504291:0:8479:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789477285.504338:0:8479:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9d0d40031400/0xafddb3c8f928160a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xafddb3c8f9281603 expref: 18 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477285.504346:0:8479:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9d0d40031400/0xafddb3c8f928160a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xafddb3c8f9281603 expref: 18 pid: 5839 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789477285.504353:0:8479:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d7536a680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8479:1876402802550272:0@lo:104: 00010000:00010000:0.0:1789477285.504377:0:8479:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9d0d40030600/0xafddb3c8f92815ee lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xafddb3c8f92815e7 expref: 18 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477285.504384:0:8479:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9d0d40030600/0xafddb3c8f92815ee lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xafddb3c8f92815e7 expref: 18 pid: 5839 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789477285.504391:0:8479:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d75368700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8479:1876402802550400:0@lo:104: 00010000:00010000:0.0:1789477285.504412:0:8479:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9d0d41647400/0xafddb3c8f92815e0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xafddb3c8f92815d9 expref: 18 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477285.504420:0:8479:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9d0d41647400/0xafddb3c8f92815e0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xafddb3c8f92815d9 expref: 18 pid: 5839 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789477285.504439:0:8479:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d4e641880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8479:1876402802550528:0@lo:104: 00010000:00010000:0.0:1789477285.504463:0:8479:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9d0d49eca000/0xafddb3c8f92815d2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xafddb3c8f92815cb expref: 18 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477285.504483:0:8479:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9d0d49eca000/0xafddb3c8f92815d2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xafddb3c8f92815cb expref: 18 pid: 5837 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789477285.504492:0:8479:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d4e642680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8479:1876402802550656:0@lo:104: 00010000:00010000:0.0:1789477285.504517:0:8479:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9d0d49ecb400/0xafddb3c8f92815a8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xafddb3c8f92815a1 expref: 18 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477285.504524:0:8479:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9d0d49ecb400/0xafddb3c8f92815a8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xafddb3c8f92815a1 expref: 18 pid: 5837 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789477285.504532:0:8479:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d4e640e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8479:1876402802550784:0@lo:104: 00010000:00010000:0.0:1789477285.504551:0:8479:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9d0d59d6b600/0xafddb3c8f928157e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xafddb3c8f9281577 expref: 18 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477285.504559:0:8479:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9d0d59d6b600/0xafddb3c8f928157e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xafddb3c8f9281577 expref: 18 pid: 5837 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789477285.504566:0:8479:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d4e640000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8479:1876402802550912:0@lo:104: 00000100:00100000:0.0:1789477285.504605:0:8479:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d0d44531d80 going to sleep for 11 seconds 00000100:00100000:2.0:1789477285.506521:0:5827:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1789477285.506568:0:5827:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789477285.506618:0:5827:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789477285.506630:0:5827:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789477285.506640:0:5827:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789477285.506650:0:5827:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789477285.506660:0:5827:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789477285.506685:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802550144 00000100:00100000:2.0:1789477285.506694:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802550144 00000100:00100000:2.0:1789477285.506739:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802550272 00000100:00100000:2.0:1789477285.506743:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802550272 00000100:00100000:2.0:1789477285.506753:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802550400 00000100:00100000:2.0:1789477285.506755:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802550400 00000100:00100000:2.0:1789477285.506763:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802550528 00000100:00100000:2.0:1789477285.506765:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802550528 00000100:00100000:2.0:1789477285.506773:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802550656 00000100:00100000:2.0:1789477285.506774:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802550656 00000100:00100000:2.0:1789477285.506794:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802550784 00000100:00100000:2.0:1789477285.506797:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802550784 00000100:00100000:2.0:1789477285.506826:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802550912 00000100:00100000:2.0:1789477285.506828:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802550912 00000100:00100000:2.0:1789477285.506840:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1789477285.506849:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d7f773c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:07d5e05c-913f-419f-adbc-d3cf15e9cd51+9:8479:x1876402802550144:12345-0@lo:104: 00010000:00010000:2.0:1789477285.506866:0:5827:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.123@tcp lock: ffff9d0d41647a00/0xafddb3c8f928162d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xafddb3c8f9281634 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477285.506936:0:5827:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1789477285.506942:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d7f773c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:07d5e05c-913f-419f-adbc-d3cf15e9cd51+9:8479:x1876402802550144:12345-0@lo:104: Request processed in 94us (2652us total) trans 0 rc 0/0 00000100:00100000:2.0:1789477285.506949:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1789477285.506990:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1789477285.506996:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d6d3d4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:07d5e05c-913f-419f-adbc-d3cf15e9cd51+8:8479:x1876402802550272:12345-0@lo:104: 00010000:00010000:2.0:1789477285.507003:0:5827:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.123@tcp lock: ffff9d0d59d6a200/0xafddb3c8f9281603 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xafddb3c8f928160a expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477285.507033:0:5827:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1789477285.507039:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d6d3d4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:07d5e05c-913f-419f-adbc-d3cf15e9cd51+8:8479:x1876402802550272:12345-0@lo:104: Request processed in 44us (474us total) trans 0 rc 0/0 00000100:00100000:2.0:1789477285.507044:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1789477285.507054:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1789477285.507059:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d6d3d5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:07d5e05c-913f-419f-adbc-d3cf15e9cd51+7:8479:x1876402802550400:12345-0@lo:104: 00010000:00010000:2.0:1789477285.507065:0:5827:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.123@tcp lock: ffff9d0d49ecba00/0xafddb3c8f92815e7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xafddb3c8f92815ee expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477285.507093:0:5827:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:2.0:1789477285.507097:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d6d3d5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:07d5e05c-913f-419f-adbc-d3cf15e9cd51+7:8479:x1876402802550400:12345-0@lo:104: Request processed in 38us (479us total) trans 0 rc 0/0 00000100:00100000:2.0:1789477285.507110:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1789477285.507120:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1789477285.507124:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d6d3d7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:07d5e05c-913f-419f-adbc-d3cf15e9cd51+6:8479:x1876402802550528:12345-0@lo:104: 00010000:00010000:2.0:1789477285.507131:0:5827:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.123@tcp lock: ffff9d0d41647000/0xafddb3c8f92815d9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xafddb3c8f92815e0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477285.507157:0:5827:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:2.0:1789477285.507162:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d6d3d7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:07d5e05c-913f-419f-adbc-d3cf15e9cd51+6:8479:x1876402802550528:12345-0@lo:104: Request processed in 37us (531us total) trans 0 rc 0/0 00000100:00100000:2.0:1789477285.507168:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1789477285.507178:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1789477285.507183:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d6d3d6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:07d5e05c-913f-419f-adbc-d3cf15e9cd51+5:8479:x1876402802550656:12345-0@lo:104: 00010000:00010000:2.0:1789477285.507188:0:5827:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.123@tcp lock: ffff9d0d41646a00/0xafddb3c8f92815cb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xafddb3c8f92815d2 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477285.507208:0:5827:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to priority blp list, 5 blwis in pool 00000100:00100000:2.0:1789477285.507211:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d6d3d6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:07d5e05c-913f-419f-adbc-d3cf15e9cd51+5:8479:x1876402802550656:12345-0@lo:104: Request processed in 29us (571us total) trans 0 rc 0/0 00000100:00100000:2.0:1789477285.507216:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1789477285.507225:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1789477285.507230:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d6d3d5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:07d5e05c-913f-419f-adbc-d3cf15e9cd51+4:8479:x1876402802550784:12345-0@lo:104: 00010000:00010000:2.0:1789477285.507237:0:5827:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.123@tcp lock: ffff9d0d59d6a000/0xafddb3c8f92815a1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xafddb3c8f92815a8 expref: -99 pid: 7660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477285.507260:0:5827:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to priority blp list, 6 blwis in pool 00000100:00100000:2.0:1789477285.507265:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d6d3d5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:07d5e05c-913f-419f-adbc-d3cf15e9cd51+4:8479:x1876402802550784:12345-0@lo:104: Request processed in 35us (614us total) trans 0 rc 0/0 00000100:00100000:2.0:1789477285.507276:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1789477285.507288:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1789477285.507293:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d6d3d6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:07d5e05c-913f-419f-adbc-d3cf15e9cd51+3:8479:x1876402802550912:12345-0@lo:104: 00010000:00010000:2.0:1789477285.507301:0:5827:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.123@tcp lock: ffff9d0d40031600/0xafddb3c8f9281577 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xafddb3c8f928157e expref: -99 pid: 7660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477285.507326:0:5827:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/7 locks to priority blp list, 7 blwis in pool 00000100:00100000:2.0:1789477285.507330:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d6d3d6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:07d5e05c-913f-419f-adbc-d3cf15e9cd51+3:8479:x1876402802550912:12345-0@lo:104: Request processed in 38us (669us total) trans 0 rc 0/0 00000100:00100000:2.0:1789477285.507336:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00010000:00010000:2.0:1789477285.507359:0:5832:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 6 total in blp. (6 blwis in pool) 00010000:00010000:2.0:1789477285.507365:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.123@tcp lock: ffff9d0d41647a00/0xafddb3c8f928162d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xafddb3c8f9281634 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477285.507371:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d0d41647a00 already unused, calling callback (ffffffffc1bb3c20) 10000000:00010000:2.0:1789477285.507376:0:5832:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.123@tcp lock: ffff9d0d41647a00/0xafddb3c8f928162d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0xafddb3c8f9281634 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477285.507385:0:5832:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.123@tcp lock: ffff9d0d41647a00/0xafddb3c8f928162d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0xafddb3c8f9281634 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789477285.507392:0:5832:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.123@tcp lock: ffff9d0d41647a00/0xafddb3c8f928162d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0xafddb3c8f9281634 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789477285.507398:0:5832:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1789477285.507446:0:5832:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.123@tcp lock: ffff9d0d41647a00/0xafddb3c8f928162d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xafddb3c8f9281634 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477285.507453:0:5832:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789477285.507479:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.123@tcp lock: ffff9d0d41647a00/0xafddb3c8f928162d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xafddb3c8f9281634 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477285.507487:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.123@tcp lock: ffff9d0d41647a00/0xafddb3c8f928162d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xafddb3c8f9281634 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477285.507502:0:5832:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:2.0:1789477285.507506:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.123@tcp lock: ffff9d0d59d6a200/0xafddb3c8f9281603 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0xafddb3c8f928160a expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477285.507513:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d0d59d6a200 already unused, calling callback (ffffffffc1bb3c20) 10000000:00010000:2.0:1789477285.507515:0:5832:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.123@tcp lock: ffff9d0d59d6a200/0xafddb3c8f9281603 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0xafddb3c8f928160a expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477285.507522:0:5832:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.123@tcp lock: ffff9d0d59d6a200/0xafddb3c8f9281603 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0xafddb3c8f928160a expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789477285.507528:0:5832:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.123@tcp lock: ffff9d0d59d6a200/0xafddb3c8f9281603 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0xafddb3c8f928160a expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789477285.507533:0:5832:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1789477285.507545:0:5832:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.123@tcp lock: ffff9d0d59d6a200/0xafddb3c8f9281603 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xafddb3c8f928160a expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477285.507551:0:5832:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789477285.507564:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.123@tcp lock: ffff9d0d59d6a200/0xafddb3c8f9281603 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xafddb3c8f928160a expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477285.507570:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.123@tcp lock: ffff9d0d59d6a200/0xafddb3c8f9281603 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xafddb3c8f928160a expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477285.507598:0:5832:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:2.0:1789477285.507607:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.123@tcp lock: ffff9d0d49ecba00/0xafddb3c8f92815e7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xafddb3c8f92815ee expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477285.507614:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d0d49ecba00 already unused, calling callback (ffffffffc1bb3c20) 10000000:00010000:2.0:1789477285.507617:0:5832:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.123@tcp lock: ffff9d0d49ecba00/0xafddb3c8f92815e7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0xafddb3c8f92815ee expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477285.507624:0:5832:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.123@tcp lock: ffff9d0d49ecba00/0xafddb3c8f92815e7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0xafddb3c8f92815ee expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789477285.507629:0:5832:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.123@tcp lock: ffff9d0d49ecba00/0xafddb3c8f92815e7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0xafddb3c8f92815ee expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789477285.507634:0:5832:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1789477285.507647:0:5832:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.123@tcp lock: ffff9d0d49ecba00/0xafddb3c8f92815e7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xafddb3c8f92815ee expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477285.507653:0:5832:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789477285.507658:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.123@tcp lock: ffff9d0d49ecba00/0xafddb3c8f92815e7 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xafddb3c8f92815ee expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477285.507665:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.123@tcp lock: ffff9d0d49ecba00/0xafddb3c8f92815e7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xafddb3c8f92815ee expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477285.507674:0:5832:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:2.0:1789477285.507676:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.123@tcp lock: ffff9d0d41647000/0xafddb3c8f92815d9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xafddb3c8f92815e0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477285.507682:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d0d41647000 already unused, calling callback (ffffffffc1bb3c20) 10000000:00010000:2.0:1789477285.507684:0:5832:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.123@tcp lock: ffff9d0d41647000/0xafddb3c8f92815d9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xafddb3c8f92815e0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477285.507701:0:5832:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.123@tcp lock: ffff9d0d41647000/0xafddb3c8f92815d9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xafddb3c8f92815e0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789477285.507708:0:5832:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.123@tcp lock: ffff9d0d41647000/0xafddb3c8f92815d9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xafddb3c8f92815e0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789477285.507713:0:5832:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1789477285.507727:0:5832:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.123@tcp lock: ffff9d0d41647000/0xafddb3c8f92815d9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xafddb3c8f92815e0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477285.507733:0:5832:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789477285.507738:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.123@tcp lock: ffff9d0d41647000/0xafddb3c8f92815d9 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xafddb3c8f92815e0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477285.507744:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.123@tcp lock: ffff9d0d41647000/0xafddb3c8f92815d9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xafddb3c8f92815e0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477285.507754:0:5832:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1789477285.507757:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.123@tcp lock: ffff9d0d41646a00/0xafddb3c8f92815cb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xafddb3c8f92815d2 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477285.507762:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d0d41646a00 already unused, calling callback (ffffffffc1bb3c20) 10000000:00010000:2.0:1789477285.507765:0:5832:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.123@tcp lock: ffff9d0d41646a00/0xafddb3c8f92815cb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xafddb3c8f92815d2 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477285.507771:0:5832:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.123@tcp lock: ffff9d0d41646a00/0xafddb3c8f92815cb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xafddb3c8f92815d2 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789477285.507776:0:5832:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.123@tcp lock: ffff9d0d41646a00/0xafddb3c8f92815cb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xafddb3c8f92815d2 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789477285.507787:0:5832:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1789477285.507799:0:5832:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.123@tcp lock: ffff9d0d41646a00/0xafddb3c8f92815cb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xafddb3c8f92815d2 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477285.507805:0:5832:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789477285.507809:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.123@tcp lock: ffff9d0d41646a00/0xafddb3c8f92815cb lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xafddb3c8f92815d2 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477285.507815:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.123@tcp lock: ffff9d0d41646a00/0xafddb3c8f92815cb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xafddb3c8f92815d2 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477285.507825:0:5832:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789477285.507828:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.123@tcp lock: ffff9d0d59d6a000/0xafddb3c8f92815a1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xafddb3c8f92815a8 expref: -99 pid: 7660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477285.507834:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d0d59d6a000 already unused, calling callback (ffffffffc1bb3c20) 10000000:00010000:2.0:1789477285.507836:0:5832:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.123@tcp lock: ffff9d0d59d6a000/0xafddb3c8f92815a1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xafddb3c8f92815a8 expref: -99 pid: 7660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477285.507842:0:5832:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.123@tcp lock: ffff9d0d59d6a000/0xafddb3c8f92815a1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xafddb3c8f92815a8 expref: -99 pid: 7660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789477285.507847:0:5832:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.123@tcp lock: ffff9d0d59d6a000/0xafddb3c8f92815a1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xafddb3c8f92815a8 expref: -99 pid: 7660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789477285.507852:0:5832:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1789477285.507862:0:5832:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.123@tcp lock: ffff9d0d59d6a000/0xafddb3c8f92815a1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xafddb3c8f92815a8 expref: -99 pid: 7660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477285.507867:0:5832:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789477285.507877:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.123@tcp lock: ffff9d0d59d6a000/0xafddb3c8f92815a1 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xafddb3c8f92815a8 expref: -99 pid: 7660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477285.507883:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.123@tcp lock: ffff9d0d59d6a000/0xafddb3c8f92815a1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xafddb3c8f92815a8 expref: -99 pid: 7660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477285.507893:0:5832:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789477285.507896:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.123@tcp lock: ffff9d0d40031600/0xafddb3c8f9281577 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xafddb3c8f928157e expref: -99 pid: 7660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477285.507901:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d0d40031600 already unused, calling callback (ffffffffc1bb3c20) 10000000:00010000:2.0:1789477285.507904:0:5832:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.123@tcp lock: ffff9d0d40031600/0xafddb3c8f9281577 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xafddb3c8f928157e expref: -99 pid: 7660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477285.507911:0:5832:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.123@tcp lock: ffff9d0d40031600/0xafddb3c8f9281577 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xafddb3c8f928157e expref: -99 pid: 7660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789477285.507916:0:5832:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.123@tcp lock: ffff9d0d40031600/0xafddb3c8f9281577 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xafddb3c8f928157e expref: -99 pid: 7660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789477285.507921:0:5832:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1789477285.507933:0:5832:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.123@tcp lock: ffff9d0d40031600/0xafddb3c8f9281577 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xafddb3c8f928157e expref: -99 pid: 7660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477285.507939:0:5832:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789477285.507943:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.123@tcp lock: ffff9d0d40031600/0xafddb3c8f9281577 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xafddb3c8f928157e expref: -99 pid: 7660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477285.507949:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.123@tcp lock: ffff9d0d40031600/0xafddb3c8f9281577 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xafddb3c8f928157e expref: -99 pid: 7660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477285.507962:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789477285.507969:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789477285.507971:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789477285.507980:0:6710:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789477285.507986:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789477285.508010:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d6d3d4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:07d5e05c-913f-419f-adbc-d3cf15e9cd51:3311:1876402802551040:0@lo:103: 00000100:00100000:2.0:1789477285.508055:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789477285.508090:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d6d3d5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:07d5e05c-913f-419f-adbc-d3cf15e9cd51:3311:1876402802551552:0@lo:103: 00000100:00100000:2.0:1789477285.508110:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789477285.508131:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789477285.508136:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d6d3d7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:07d5e05c-913f-419f-adbc-d3cf15e9cd51:3311:1876402802551424:0@lo:103: 00000100:00100000:2.0:1789477285.508169:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789477285.508439:0:8479:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d75369c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8479:1876402802550144:0@lo:104: 00000100:00100000:0.0:1789477285.508449:0:8479:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d7536a680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8479:1876402802550272:0@lo:104: 00000100:00100000:0.0:1789477285.508457:0:8479:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d75368700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8479:1876402802550400:0@lo:104: 00000100:00100000:0.0:1789477285.508465:0:8479:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d4e641880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8479:1876402802550528:0@lo:104: 00000100:00100000:0.0:1789477285.508473:0:8479:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d4e642680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8479:1876402802550656:0@lo:104: 00000100:00100000:0.0:1789477285.508481:0:8479:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d4e640e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8479:1876402802550784:0@lo:104: 00000100:00100000:0.0:1789477285.508488:0:8479:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d4e640000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8479:1876402802550912:0@lo:104: 00000100:00100000:0.0:1789477285.508882:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d6d3d6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:07d5e05c-913f-419f-adbc-d3cf15e9cd51:3313:1876402802551296:0@lo:103: 00000100:00100000:0.0:1789477285.508917:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d6d3d5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:07d5e05c-913f-419f-adbc-d3cf15e9cd51:3312:1876402802551168:0@lo:103: 00000100:00100000:3.0:1789477285.509346:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802551040 00000100:00100000:3.0:1789477285.509355:0:6711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802551040 00010000:00010000:3.0:1789477285.509397:0:6711:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9d0d41647600/0xafddb3c8f9281634 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xafddb3c8f928162d expref: 19 pid: 5838 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789477285.509451:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802551552 00000100:00100000:3.0:1789477285.509456:0:6711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802551552 00010000:00010000:3.0:1789477285.509471:0:6711:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9d0d49eca000/0xafddb3c8f92815d2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xafddb3c8f92815cb expref: 20 pid: 5837 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789477285.509482:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802551424 00000100:00100000:3.0:1789477285.509485:0:6711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802551424 00010000:00010000:3.0:1789477285.509494:0:6711:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9d0d41647400/0xafddb3c8f92815e0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xafddb3c8f92815d9 expref: 21 pid: 5839 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789477285.509506:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1789477285.509514:0:6711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d6d3d7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:07d5e05c-913f-419f-adbc-d3cf15e9cd51+21:3311:x1876402802551040:12345-0@lo:103: 00010000:00010000:3.0:1789477285.509526:0:6711:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789477285.509531:0:6711:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9d0d41647600/0xafddb3c8f9281634 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xafddb3c8f928162d expref: 21 pid: 5838 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477285.509540:0:6711:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9d0d41647600/0xafddb3c8f9281634 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xafddb3c8f928162d expref: 21 pid: 5838 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477285.509555:0:6711:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d0d41647600/0xafddb3c8f9281634 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xafddb3c8f928162d expref: 21 pid: 5838 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477285.509569:0:6711:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789477285.509654:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789477285.509691:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d6d3d6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:07d5e05c-913f-419f-adbc-d3cf15e9cd51:3312:1876402802551680:0@lo:103: 00000100:00100000:0.0:1789477285.509718:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789477285.509903:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802551168 00000100:00100000:2.0:1789477285.509908:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802551168 00010000:00010000:2.0:1789477285.509927:0:5830:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9d0d40031400/0xafddb3c8f928160a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xafddb3c8f9281603 expref: 21 pid: 5839 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789477285.509940:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802551680 00000100:00100000:2.0:1789477285.509943:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802551680 00010000:00010000:2.0:1789477285.509952:0:5830:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9d0d49ecb400/0xafddb3c8f92815a8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xafddb3c8f92815a1 expref: 22 pid: 5837 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789477285.509964:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1789477285.509970:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d7f738e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:07d5e05c-913f-419f-adbc-d3cf15e9cd51+22:3311:x1876402802551552:12345-0@lo:103: 00010000:00010000:2.0:1789477285.509978:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789477285.509982:0:5830:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9d0d49eca000/0xafddb3c8f92815d2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xafddb3c8f92815cb expref: 22 pid: 5837 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477285.509990:0:5830:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9d0d49eca000/0xafddb3c8f92815d2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xafddb3c8f92815cb expref: 22 pid: 5837 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477285.510013:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d0d49eca000/0xafddb3c8f92815d2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xafddb3c8f92815cb expref: 22 pid: 5837 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477285.510022:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789477285.510064:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d7f738e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:07d5e05c-913f-419f-adbc-d3cf15e9cd51+21:3311:x1876402802551552:12345-0@lo:103: Request processed in 94us (1953us total) trans 0 rc 0/0 00000100:00100000:2.0:1789477285.510071:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1789477285.510089:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1789477285.510095:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d7c3e4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:07d5e05c-913f-419f-adbc-d3cf15e9cd51+20:3311:x1876402802551424:12345-0@lo:103: 00010000:00010000:2.0:1789477285.510102:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789477285.510107:0:5830:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9d0d41647400/0xafddb3c8f92815e0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xafddb3c8f92815d9 expref: 20 pid: 5839 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477285.510115:0:5830:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9d0d41647400/0xafddb3c8f92815e0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xafddb3c8f92815d9 expref: 20 pid: 5839 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477285.510124:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d0d41647400/0xafddb3c8f92815e0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xafddb3c8f92815d9 expref: 20 pid: 5839 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477285.510133:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789477285.510155:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d7c3e4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:07d5e05c-913f-419f-adbc-d3cf15e9cd51+19:3311:x1876402802551424:12345-0@lo:103: Request processed in 61us (1986us total) trans 0 rc 0/0 00000100:00100000:2.0:1789477285.510161:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1789477285.510173:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1789477285.510179:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d4e643480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:07d5e05c-913f-419f-adbc-d3cf15e9cd51+18:3312:x1876402802551168:12345-0@lo:103: 00010000:00010000:2.0:1789477285.510186:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789477285.510190:0:5830:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9d0d40031400/0xafddb3c8f928160a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xafddb3c8f9281603 expref: 18 pid: 5839 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477285.510204:0:5830:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9d0d40031400/0xafddb3c8f928160a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xafddb3c8f9281603 expref: 18 pid: 5839 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477285.510214:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d0d40031400/0xafddb3c8f928160a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xafddb3c8f9281603 expref: 18 pid: 5839 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477285.510222:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789477285.510250:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d4e643480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:07d5e05c-913f-419f-adbc-d3cf15e9cd51+17:3312:x1876402802551168:12345-0@lo:103: Request processed in 71us (596us total) trans 0 rc 0/0 00000100:00100000:2.0:1789477285.510256:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1789477285.510269:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1789477285.510275:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d4e642a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:07d5e05c-913f-419f-adbc-d3cf15e9cd51+16:3312:x1876402802551680:12345-0@lo:103: 00010000:00010000:2.0:1789477285.510282:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789477285.510286:0:5830:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9d0d49ecb400/0xafddb3c8f92815a8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xafddb3c8f92815a1 expref: 16 pid: 5837 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477285.510294:0:5830:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9d0d49ecb400/0xafddb3c8f92815a8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xafddb3c8f92815a1 expref: 16 pid: 5837 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477285.510303:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d0d49ecb400/0xafddb3c8f92815a8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xafddb3c8f92815a1 expref: 16 pid: 5837 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477285.510312:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789477285.510332:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d4e642a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:07d5e05c-913f-419f-adbc-d3cf15e9cd51+15:3312:x1876402802551680:12345-0@lo:103: Request processed in 58us (613us total) trans 0 rc 0/0 00000100:00100000:2.0:1789477285.510338:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1789477285.510374:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d6d3d5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:07d5e05c-913f-419f-adbc-d3cf15e9cd51:3312:1876402802551168:0@lo:103: 00000100:00100000:2.0:1789477285.510382:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d6d3d6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:07d5e05c-913f-419f-adbc-d3cf15e9cd51:3312:1876402802551680:0@lo:103: 00000100:00100000:1.0:1789477285.510531:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789477285.510569:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d6d3d4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:07d5e05c-913f-419f-adbc-d3cf15e9cd51:3313:1876402802551808:0@lo:103: 00000100:00100000:1.0:1789477285.510622:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789477285.510656:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802551296 00000100:00100000:1.0:1789477285.510660:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802551296 00010000:00010000:1.0:1789477285.510688:0:5831:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9d0d40030600/0xafddb3c8f92815ee lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xafddb3c8f92815e7 expref: 15 pid: 5839 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789477285.510702:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802551808 00000100:00100000:1.0:1789477285.510704:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802551808 00010000:00010000:1.0:1789477285.510716:0:5831:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9d0d59d6b600/0xafddb3c8f928157e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xafddb3c8f9281577 expref: 16 pid: 5837 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789477285.510728:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1789477285.510734:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d74a8ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:07d5e05c-913f-419f-adbc-d3cf15e9cd51+16:3313:x1876402802551296:12345-0@lo:103: 00010000:00010000:1.0:1789477285.510741:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789477285.510744:0:5831:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9d0d40030600/0xafddb3c8f92815ee lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xafddb3c8f92815e7 expref: 16 pid: 5839 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477285.510752:0:5831:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9d0d40030600/0xafddb3c8f92815ee lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xafddb3c8f92815e7 expref: 16 pid: 5839 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477285.510761:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d0d40030600/0xafddb3c8f92815ee lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xafddb3c8f92815e7 expref: 16 pid: 5839 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477285.510791:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789477285.510821:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d74a8ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:07d5e05c-913f-419f-adbc-d3cf15e9cd51+15:3313:x1876402802551296:12345-0@lo:103: Request processed in 87us (290us total) trans 0 rc 0/0 00000100:00100000:1.0:1789477285.510828:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1789477285.510842:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1789477285.510848:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d48461850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:07d5e05c-913f-419f-adbc-d3cf15e9cd51+14:3313:x1876402802551808:12345-0@lo:103: 00010000:00010000:1.0:1789477285.510855:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789477285.510859:0:5831:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9d0d59d6b600/0xafddb3c8f928157e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xafddb3c8f9281577 expref: 14 pid: 5837 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477285.510867:0:5831:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9d0d59d6b600/0xafddb3c8f928157e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xafddb3c8f9281577 expref: 14 pid: 5837 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477285.510876:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d0d59d6b600/0xafddb3c8f928157e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xafddb3c8f9281577 expref: 14 pid: 5837 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477285.510884:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789477285.510905:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d48461850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:07d5e05c-913f-419f-adbc-d3cf15e9cd51+13:3313:x1876402802551808:12345-0@lo:103: Request processed in 58us (283us total) trans 0 rc 0/0 00000100:00100000:1.0:1789477285.510911:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1789477285.510936:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d6d3d6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:07d5e05c-913f-419f-adbc-d3cf15e9cd51:3313:1876402802551296:0@lo:103: 00000100:00100000:1.0:1789477285.510944:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d6d3d4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:07d5e05c-913f-419f-adbc-d3cf15e9cd51:3313:1876402802551808:0@lo:103: 00000100:00100000:0.0:1789477285.511154:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d6d3d7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:07d5e05c-913f-419f-adbc-d3cf15e9cd51:3311:1876402802551424:0@lo:103: 00000100:00100000:0.0:1789477285.511162:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d6d3d5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:07d5e05c-913f-419f-adbc-d3cf15e9cd51:3311:1876402802551552:0@lo:103: 00000100:00100000:3.0:1789477285.511285:0:6711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d6d3d7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:07d5e05c-913f-419f-adbc-d3cf15e9cd51+12:3311:x1876402802551040:12345-0@lo:103: Request processed in 1771us (3228us total) trans 0 rc 0/0 00000100:00100000:3.0:1789477285.511294:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1789477285.511368:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d6d3d4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:07d5e05c-913f-419f-adbc-d3cf15e9cd51:3311:1876402802551040:0@lo:103: 00000100:00100000:3.0:1789477285.513235:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:3.0:1789477285.513312:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:0.0:1789477285.513387:0:8479:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d7536b100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8479:1876402802549888:192.168.201.23@tcp:104: 00000100:00100000:0.0:1789477285.513399:0:8479:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d7536aa00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8479:1876402802550016:192.168.201.23@tcp:104: 00010000:00010000:0.0:1789477285.513467:0:8479:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9d0d82150800/0xafddb3c8f9281681 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789477285.514090:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783654016 00000100:00100000:2.0:1789477285.514097:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783654016 00010000:00010000:2.0:1789477285.514134:0:5831:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9d0d49ecbe00/0xafddb3c8f9281642 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2977 expref: 10 pid: 5839 timeout: 330 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789477285.514166:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783653888 00000100:00100000:2.0:1789477285.514170:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783653888 00010000:00010000:2.0:1789477285.514182:0:5831:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9d0d40031200/0xafddb3c8f9281649 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f297e expref: 11 pid: 5838 timeout: 330 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789477285.514247:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 19 00000100:00100000:2.0:1789477285.514257:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d74cd9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5c82dded-6a10-4ce8-abd1-52bd956b9523+11:2355:x1876402783654016:12345-192.168.201.23@tcp:103: 00010000:00010000:2.0:1789477285.514283:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789477285.514290:0:5831:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9d0d49ecbe00/0xafddb3c8f9281642 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2977 expref: 11 pid: 5839 timeout: 330 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477285.514300:0:5831:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9d0d49ecbe00/0xafddb3c8f9281642 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2977 expref: 11 pid: 5839 timeout: 330 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477285.514320:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d0d49ecbe00/0xafddb3c8f9281642 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2977 expref: 11 pid: 5839 timeout: 330 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477285.514336:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789477285.514389:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d74cd9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5c82dded-6a10-4ce8-abd1-52bd956b9523+10:2355:x1876402783654016:12345-192.168.201.23@tcp:103: Request processed in 133us (1161us total) trans 0 rc 0/0 00000100:00100000:2.0:1789477285.514396:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 19 00000100:00100000:2.0:1789477285.514413:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 20 00000100:00100000:2.0:1789477285.514419:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d74cda680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5c82dded-6a10-4ce8-abd1-52bd956b9523+9:2355:x1876402783653888:12345-192.168.201.23@tcp:103: 00010000:00010000:2.0:1789477285.514450:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789477285.514454:0:5831:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9d0d40031200/0xafddb3c8f9281649 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f297e expref: 9 pid: 5838 timeout: 330 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477285.514463:0:5831:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9d0d40031200/0xafddb3c8f9281649 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f297e expref: 9 pid: 5838 timeout: 330 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477285.514472:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d0d40031200/0xafddb3c8f9281649 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f297e expref: 9 pid: 5838 timeout: 330 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477285.514484:0:5831:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9d0d82150800/0xafddb3c8f9281681 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477285.514492:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d0d82150800/0xafddb3c8f9281681 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477285.514505:0:5831:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9d0d82150800/0xafddb3c8f9281681 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477285.514511:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9d0d82150800/0xafddb3c8f9281681 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477285.514517:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9d0d82150800/0xafddb3c8f9281681 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477285.514524:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9d0d82150800/0xafddb3c8f9281681 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477285.514530:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d0d82150800 already unused, calling callback (ffffffffc15972a0) 00010000:00010000:2.0:1789477285.514535:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9d0d82150800/0xafddb3c8f9281681 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477285.514554:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9d0d82150800/0xafddb3c8f9281681 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 8479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477285.514569:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9d0d82150800/0xafddb3c8f9281681 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477285.514599:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789477285.514619:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d74cda680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5c82dded-6a10-4ce8-abd1-52bd956b9523+8:2355:x1876402783653888:12345-192.168.201.23@tcp:103: Request processed in 200us (1307us total) trans 0 rc 0/0 00000100:00100000:2.0:1789477285.514626:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 20 00010000:00010000:0.0:1789477285.515180:0:8479:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9d0d82150800/0xafddb3c8f9281681 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477285.515191:0:8479:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9d0d82150800/0xafddb3c8f9281681 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477285.515197:0:8479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d0d82150800/0xafddb3c8f9281681 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477285.559680:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789477285.937914:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:2.0:1789477285.938935:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783654144 00000100:00100000:2.0:1789477285.939040:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783654144 00000100:00100000:2.0:1789477285.939195:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 131 00000100:00100000:2.0:1789477285.939206:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d4ec6c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5c82dded-6a10-4ce8-abd1-52bd956b9523+8:5607:x1876402783654144:12345-192.168.201.23@tcp:101: 00010000:00010000:2.0:1789477285.939223:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789477285.939243:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d0d59d6a200/0xafddb3c8f9281688 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xa90d500d7b8f29e0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477285.939271:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d0d59d6a200/0xafddb3c8f9281688 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f29e0 expref: 9 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477285.939283:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d0d59d6a200/0xafddb3c8f9281688 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f29e0 expref: 9 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477285.939293:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d0d59d6a200, rc 0) 00000100:00100000:2.0:1789477285.939376:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d4ec6c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5c82dded-6a10-4ce8-abd1-52bd956b9523+9:5607:x1876402783654144:12345-192.168.201.23@tcp:101: Request processed in 171us (1472us total) trans 0 rc 0/0 00000100:00100000:2.0:1789477285.939383:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 131 00000100:00100000:3.0:1789477285.949392:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:1.0:1789477285.952715:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783654272 00000100:00100000:1.0:1789477285.952734:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783654272 00000100:00100000:1.0:1789477285.952874:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 132 00000100:00100000:1.0:1789477285.952887:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d4ec6f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5c82dded-6a10-4ce8-abd1-52bd956b9523+9:5607:x1876402783654272:12345-192.168.201.23@tcp:501: 00000100:00100000:1.0:1789477285.953224:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d4ec6f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5c82dded-6a10-4ce8-abd1-52bd956b9523+9:5607:x1876402783654272:12345-192.168.201.23@tcp:501: Request processed in 339us (3840us total) trans 0 rc 0/0 00000100:00100000:1.0:1789477285.953232:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 132 00000100:00100000:1.0:1789477285.963554:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:2.0:1789477285.963955:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783654400 00000100:00100000:2.0:1789477285.963966:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783654400 00000100:00100000:2.0:1789477285.964030:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 133 00000100:00100000:2.0:1789477285.964041:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d4ec6ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5c82dded-6a10-4ce8-abd1-52bd956b9523+9:5607:x1876402783654400:12345-192.168.201.23@tcp:503: 00000100:00100000:2.0:1789477285.964486:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d4ec6ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5c82dded-6a10-4ce8-abd1-52bd956b9523+9:5607:x1876402783654400:12345-192.168.201.23@tcp:503: Request processed in 251us (746us total) trans 0 rc 0/0 00000100:00100000:2.0:1789477285.964496:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 133 00000100:00100000:2.0:1789477285.970748:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:1.0:1789477285.971435:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783654528 00000100:00100000:1.0:1789477285.971446:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783654528 00000100:00100000:1.0:1789477285.971505:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 134 00000100:00100000:1.0:1789477285.971515:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d4ec6d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5c82dded-6a10-4ce8-abd1-52bd956b9523+9:6072:x1876402783654528:12345-192.168.201.23@tcp:502: 00000100:00100000:1.0:1789477285.971834:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d4ec6d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5c82dded-6a10-4ce8-abd1-52bd956b9523+9:6072:x1876402783654528:12345-192.168.201.23@tcp:502: Request processed in 318us (1099us total) trans 0 rc 0/0 00000100:00100000:1.0:1789477285.971843:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 134 00000100:00100000:0.0:1789477285.985729:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:2.0:1789477285.985858:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783654656 00000100:00100000:2.0:1789477285.985870:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783654656 00000100:00100000:2.0:1789477285.985934:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 135 00000100:00100000:2.0:1789477285.985954:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d4ec6e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5c82dded-6a10-4ce8-abd1-52bd956b9523+9:6072:x1876402783654656:12345-192.168.201.23@tcp:502:llog_process_th.0 00000100:00100000:2.0:1789477285.986241:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d4ec6e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5c82dded-6a10-4ce8-abd1-52bd956b9523+9:6072:x1876402783654656:12345-192.168.201.23@tcp:502:llog_process_th.0 Request processed in 297us (521us total) trans 0 rc 0/0 00000100:00100000:2.0:1789477285.986251:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 135 00000100:00100000:2.0:1789477285.996279:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:3.0:1789477285.996964:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783654784 00000100:00100000:3.0:1789477285.996975:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783654784 00000100:00100000:3.0:1789477285.997033:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 136 00000100:00100000:3.0:1789477285.997044:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d4ec6dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5c82dded-6a10-4ce8-abd1-52bd956b9523+9:5607:x1876402783654784:12345-192.168.201.23@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789477285.997060:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789477285.997080:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d0d49eca400/0xafddb3c8f928168f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xa90d500d7b8f29e7 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477285.997109:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d0d49eca400/0xafddb3c8f928168f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f29e7 expref: 10 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477285.997120:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d0d49eca400/0xafddb3c8f928168f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f29e7 expref: 10 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477285.997131:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d0d49eca400, rc 0) 00000100:00100000:3.0:1789477285.997194:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d4ec6dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5c82dded-6a10-4ce8-abd1-52bd956b9523+10:5607:x1876402783654784:12345-192.168.201.23@tcp:101:ll_cfg_requeue.0 Request processed in 152us (924us total) trans 0 rc 0/0 00000100:00100000:3.0:1789477285.997201:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 136 00000100:00100000:2.0:1789477286.014937:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:1.0:1789477286.015021:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783654912 00000100:00100000:1.0:1789477286.015032:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783654912 00000100:00100000:1.0:1789477286.015127:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 137 00000100:00100000:1.0:1789477286.015138:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d4ec6fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5c82dded-6a10-4ce8-abd1-52bd956b9523+10:5607:x1876402783654912:12345-192.168.201.23@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789477286.016560:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d4ec6fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5c82dded-6a10-4ce8-abd1-52bd956b9523+10:5607:x1876402783654912:12345-192.168.201.23@tcp:501:ll_cfg_requeue.0 Request processed in 1416us (1626us total) trans 0 rc -2/-2 00000100:00100000:1.0:1789477286.016572:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 137 00010000:00010000:2.0:1789477286.576419:0:6710:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789477286.835105:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d74cdb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1876402802551936:0@lo:13: 00000100:00100000:3.0:1789477286.835398:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d74cdaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3312:1876402802552192:0@lo:400: 00000100:00100000:2.0:1789477286.835533:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d74cd9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:07d5e05c-913f-419f-adbc-d3cf15e9cd51:3311:1876402802552064:0@lo:400: 00000100:00100000:3.0:1789477286.838254:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789477286.838676:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d74cd8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1876402802552320:0@lo:400: 00000100:00100000:1.0:1789477286.838771:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789477286.839211:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d74cd8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1876402802552704:0@lo:400: 00000100:00100000:3.0:1789477286.839277:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789477286.839298:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802552320 00000100:00100000:1.0:1789477286.839312:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802552320 00000100:00100000:3.0:1789477286.839464:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802552192 00000100:00100000:3.0:1789477286.839473:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802552192 00000100:00100000:3.0:1789477286.839537:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1789477286.839547:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d74cd9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1876402802552192:12345-0@lo:400: 00000100:00100000:1.0:1789477286.839943:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802552704 00000100:00100000:1.0:1789477286.839950:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802552704 00000100:00100000:1.0:1789477286.839978:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1789477286.839989:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d74a88e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3313:x1876402802552320:12345-0@lo:400: 00000100:00100000:3.0:1789477286.840135:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d74cd9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1876402802552192:12345-0@lo:400: Request processed in 586us (1891us total) trans 0 rc 0/0 00000100:00100000:3.0:1789477286.840156:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1789477286.840221:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d74cdaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3312:1876402802552192:0@lo:400: 00000100:00080000:3.0:1789477286.840282:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789477286.840288:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789477286.840312:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1789477286.840322:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d74cdb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3312:x1876402802552704:12345-0@lo:400: 00000100:00100000:3.0:1789477286.840370:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d74cdb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3312:x1876402802552704:12345-0@lo:400: Request processed in 51us (1096us total) trans 0 rc 0/0 00000100:00100000:3.0:1789477286.840376:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1789477286.841979:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789477286.842046:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d74cd8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3311:1876402802552576:0@lo:400: 00000100:00100000:2.0:1789477286.842096:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789477286.842135:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789477286.842143:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d74cdb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3311:1876402802552448:0@lo:400: 00000100:00100000:2.0:1789477286.842165:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:2.0:1789477286.842247:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d0d74cd8000 x1876402802552704/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789477302 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789477286.842279:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d74cd8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1876402802552704:0@lo:400: 00000100:00100000:0.0:1789477286.843681:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789477286.843767:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802552576 00000100:00100000:0.0:1789477286.843780:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802552576 00000100:00100000:0.0:1789477286.843861:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802552448 00000100:00100000:0.0:1789477286.843864:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802552448 00000100:00100000:0.0:1789477286.843903:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1789477286.843915:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d7c3e4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1876402802552576:12345-0@lo:400: 00000100:00100000:0.0:1789477286.844009:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d7c3e4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1876402802552576:12345-0@lo:400: Request processed in 97us (1912us total) trans 0 rc 0/0 00000100:00100000:0.0:1789477286.844019:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1789477286.844046:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1789477286.844054:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d7c3e5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1876402802552448:12345-0@lo:400: 00000100:00100000:0.0:1789477286.844086:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d7c3e5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1876402802552448:12345-0@lo:400: Request processed in 34us (1920us total) trans 0 rc 0/0 00000100:00100000:0.0:1789477286.844093:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1789477286.844119:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802551936 00000100:00100000:0.0:1789477286.844124:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802551936 00000100:00100000:0.0:1789477286.844159:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1789477286.844168:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d4e640000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1876402802551936:12345-0@lo:13: 00002000:00000024:0.0:1789477286.844336:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789477286.844382:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d4e640000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1876402802551936:12345-0@lo:13: Request processed in 216us (709us total) trans 0 rc 0/0 00000100:00100000:0.0:1789477286.844391:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1789477286.844480:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d74cdb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3311:1876402802552448:0@lo:400: 00000100:00080000:2.0:1789477286.844619:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789477286.844622:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d74cd8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3311:1876402802552576:0@lo:400: 00000100:00100000:1.0:1789477286.844642:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d74a88e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3313:x1876402802552320:12345-0@lo:400: Request processed in 4646us (5862us total) trans 0 rc 0/0 00000100:00100000:1.0:1789477286.844660:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00080000:0.0:1789477286.844709:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d0d74cdb100 x1876402802551936/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789477302 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00010000:00080000:1.0:1789477286.844749:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d0d74cd8380 x1876402802552320/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789477302 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789477286.844749:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d74cdb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1876402802551936:0@lo:13: 00000100:00100000:2.0:1789477286.844773:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802552064 00000100:00100000:1.0:1789477286.844775:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d74cd8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1876402802552320:0@lo:400: 00000100:00100000:2.0:1789477286.844780:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802552064 00000100:00100000:0.0:1789477286.844854:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:0.0:1789477286.844912:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d4ec6f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07d5e05c-913f-419f-adbc-d3cf15e9cd51+12:3311:x1876402802552064:12345-0@lo:400: 00000100:00100000:0.0:1789477286.844974:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d4ec6f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07d5e05c-913f-419f-adbc-d3cf15e9cd51+12:3311:x1876402802552064:12345-0@lo:400: Request processed in 109us (3005us total) trans 0 rc 0/0 00000100:00100000:0.0:1789477286.844982:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:0.0:1789477286.845043:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d74cd9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:07d5e05c-913f-419f-adbc-d3cf15e9cd51:3311:1876402802552064:0@lo:400: 10000000:01000000:0.0:1789477286.897162:0:5841:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1789477286.897173:0:5841:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9d0d514ce000 from 39 10000000:01000000:0.0:1789477286.897180:0:5841:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1789477286.897247:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.123@tcp lock: ffff9d0d82151000/0xafddb3c8f9281696 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477286.897262:0:5841:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.123@tcp lock: ffff9d0d82151000/0xafddb3c8f9281696 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477286.897277:0:5841:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.123@tcp lock: ffff9d0d82151000/0xafddb3c8f9281696 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789477286.897314:0:5841:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d4e640e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07d5e05c-913f-419f-adbc-d3cf15e9cd51:5841:1876402802552832:0@lo:101: 00000100:00100000:0.0:1789477286.897430:0:5841:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789477286.901482:0:5841:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d0d74cd0480 going to sleep for 11 seconds 00000100:00100000:2.0:1789477286.904252:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802552832 00000100:00100000:2.0:1789477286.904277:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802552832 00000100:00100000:2.0:1789477286.904368:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:2.0:1789477286.904383:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d595f4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:07d5e05c-913f-419f-adbc-d3cf15e9cd51+12:5841:x1876402802552832:12345-0@lo:101: 00010000:00010000:2.0:1789477286.904421:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789477286.904452:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d0d59d6a000/0xafddb3c8f928169d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xafddb3c8f9281696 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477286.904500:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d0d59d6a000/0xafddb3c8f928169d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xafddb3c8f9281696 expref: 13 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477286.904517:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d0d59d6a000/0xafddb3c8f928169d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xafddb3c8f9281696 expref: 13 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477286.904530:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d0d59d6a000, rc 0) 00000100:00100000:2.0:1789477286.904708:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d595f4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:07d5e05c-913f-419f-adbc-d3cf15e9cd51+13:5841:x1876402802552832:12345-0@lo:101: Request processed in 327us (7276us total) trans 0 rc 0/0 00000100:00100000:2.0:1789477286.904717:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:2.0:1789477286.904817:0:5841:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d4e640e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07d5e05c-913f-419f-adbc-d3cf15e9cd51:5841:1876402802552832:0@lo:101: 00010000:00010000:2.0:1789477286.904843:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.123@tcp lock: ffff9d0d82151000/0xafddb3c8f9281696 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xafddb3c8f928169d expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477286.904855:0:5841:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.123@tcp lock: ffff9d0d82151000/0xafddb3c8f9281696 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xafddb3c8f928169d expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789477286.904962:0:5841:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d7c3e7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07d5e05c-913f-419f-adbc-d3cf15e9cd51:5841:1876402802552960:0@lo:501: 00000100:00100000:2.0:1789477286.905210:0:5841:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789477286.905256:0:5841:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d0d50a1e9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789477286.905281:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802552960 00000100:00100000:2.0:1789477286.905286:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802552960 00000100:00100000:2.0:1789477286.905322:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:2.0:1789477286.905328:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d595f7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07d5e05c-913f-419f-adbc-d3cf15e9cd51+13:5841:x1876402802552960:12345-0@lo:501: 00000100:00100000:2.0:1789477286.905659:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d595f7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07d5e05c-913f-419f-adbc-d3cf15e9cd51+13:5841:x1876402802552960:12345-0@lo:501: Request processed in 329us (448us total) trans 0 rc 0/0 00000100:00100000:2.0:1789477286.905668:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:2.0:1789477286.905694:0:5841:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d7c3e7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07d5e05c-913f-419f-adbc-d3cf15e9cd51:5841:1876402802552960:0@lo:501: 00000100:00100000:2.0:1789477286.905726:0:5841:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d7c3e7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07d5e05c-913f-419f-adbc-d3cf15e9cd51:5841:1876402802553088:0@lo:503: 00000100:00100000:2.0:1789477286.905768:0:5841:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789477286.905786:0:5841:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d0d50a1e9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789477286.905799:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802553088 00000100:00100000:2.0:1789477286.905803:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802553088 00000100:00100000:2.0:1789477286.905817:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:2.0:1789477286.905823:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d595f6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07d5e05c-913f-419f-adbc-d3cf15e9cd51+13:5841:x1876402802553088:12345-0@lo:503: 00000100:00100000:2.0:1789477286.910439:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d595f6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07d5e05c-913f-419f-adbc-d3cf15e9cd51+13:5841:x1876402802553088:12345-0@lo:503: Request processed in 4599us (4653us total) trans 0 rc 0/0 00000100:00100000:2.0:1789477286.910779:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:1.0:1789477286.911091:0:5841:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d7c3e7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07d5e05c-913f-419f-adbc-d3cf15e9cd51:5841:1876402802553088:0@lo:503: 00000100:00100000:2.0:1789477286.913675:0:8496:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d7c3e4a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:07d5e05c-913f-419f-adbc-d3cf15e9cd51:8496:1876402802553216:0@lo:502: 00000100:00100000:2.0:1789477286.914875:0:8496:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789477286.915690:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802553216 00000100:00100000:2.0:1789477286.915711:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802553216 00000100:00100000:2.0:1789477286.915788:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:2.0:1789477286.915800:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d595f4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:07d5e05c-913f-419f-adbc-d3cf15e9cd51+13:8496:x1876402802553216:12345-0@lo:502: 00000100:00100000:2.0:1789477286.918763:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d595f4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:07d5e05c-913f-419f-adbc-d3cf15e9cd51+13:8496:x1876402802553216:12345-0@lo:502: Request processed in 2096us (3026us total) trans 0 rc 0/0 00000100:00100000:2.0:1789477286.918787:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:2.0:1789477286.918912:0:8496:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d0d7f762540 going to sleep for 11 seconds 00000100:00100000:2.0:1789477286.918949:0:8496:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d7c3e4a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:07d5e05c-913f-419f-adbc-d3cf15e9cd51:8496:1876402802553216:0@lo:502: 00000100:00100000:2.0:1789477286.919213:0:8496:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d7c3e4a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:07d5e05c-913f-419f-adbc-d3cf15e9cd51:8496:1876402802553344:0@lo:502: 00000100:00100000:2.0:1789477286.919287:0:8496:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789477286.919334:0:8496:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d0d7f762540 going to sleep for 11 seconds 00000100:00100000:1.0:1789477286.921079:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802553344 00000100:00100000:1.0:1789477286.921096:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802553344 00000100:00100000:1.0:1789477286.921177:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:1.0:1789477286.921191:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d595f6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07d5e05c-913f-419f-adbc-d3cf15e9cd51+13:8496:x1876402802553344:12345-0@lo:502: 00000100:00100000:1.0:1789477286.921595:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d595f6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07d5e05c-913f-419f-adbc-d3cf15e9cd51+13:8496:x1876402802553344:12345-0@lo:502: Request processed in 386us (2287us total) trans 0 rc 0/0 00000100:00100000:1.0:1789477286.921604:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:2.0:1789477286.922890:0:8496:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d7c3e4a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:07d5e05c-913f-419f-adbc-d3cf15e9cd51:8496:1876402802553344:0@lo:502: 00000040:00080000:2.0:1789477286.922957:0:8496:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:1.0:1789477286.923707:0:5841:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:1.0:1789477286.923813:0:5841:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.123@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1789477286.923828:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.123@tcp lock: ffff9d0d82151000/0xafddb3c8f9281696 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xafddb3c8f928169d expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477286.923843:0:5841:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.123@tcp lock: ffff9d0d82151000/0xafddb3c8f9281696 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xafddb3c8f928169d expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789477286.923856:0:5841:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:1.0:1789477286.923859:0:5841:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 8 10000000:01000000:1.0:1789477286.923863:0:5841:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:1.0:1789477286.924101:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.123@tcp lock: ffff9d0d41646200/0xafddb3c8f92816a4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477286.924131:0:5841:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.123@tcp lock: ffff9d0d41646200/0xafddb3c8f92816a4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477286.924145:0:5841:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.123@tcp lock: ffff9d0d41646200/0xafddb3c8f92816a4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789477286.924174:0:5841:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d74a89180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07d5e05c-913f-419f-adbc-d3cf15e9cd51:5841:1876402802553472:0@lo:101: 00000100:00100000:1.0:1789477286.924260:0:5841:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789477286.924354:0:5841:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d0d515b4600 going to sleep for 11 seconds 00000100:00100000:2.0:1789477286.928991:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802553472 00000100:00100000:2.0:1789477286.929015:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802553472 00000100:00100000:2.0:1789477286.929312:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:2.0:1789477286.929325:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d595f7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07d5e05c-913f-419f-adbc-d3cf15e9cd51+13:5841:x1876402802553472:12345-0@lo:101: 00010000:00010000:2.0:1789477286.929347:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789477286.929372:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d0d59d6ae00/0xafddb3c8f92816ab lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xafddb3c8f92816a4 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477286.929420:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d0d59d6ae00/0xafddb3c8f92816ab lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xafddb3c8f92816a4 expref: 14 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477286.929433:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d0d59d6ae00/0xafddb3c8f92816ab lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xafddb3c8f92816a4 expref: 14 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477286.929444:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d0d59d6ae00, rc 0) 00000100:00100000:2.0:1789477286.929714:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d595f7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07d5e05c-913f-419f-adbc-d3cf15e9cd51+14:5841:x1876402802553472:12345-0@lo:101: Request processed in 391us (5453us total) trans 0 rc 0/0 00000100:00100000:2.0:1789477286.929836:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:0.0:1789477286.935881:0:5841:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d74a89180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07d5e05c-913f-419f-adbc-d3cf15e9cd51:5841:1876402802553472:0@lo:101: 00010000:00010000:0.0:1789477286.936113:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.123@tcp lock: ffff9d0d41646200/0xafddb3c8f92816a4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xafddb3c8f92816ab expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477286.936155:0:5841:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.123@tcp lock: ffff9d0d41646200/0xafddb3c8f92816a4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xafddb3c8f92816ab expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789477286.937027:0:5841:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d7c3e4a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07d5e05c-913f-419f-adbc-d3cf15e9cd51:5841:1876402802553600:0@lo:501: 00000100:00100000:2.0:1789477286.937502:0:5841:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789477286.937557:0:5841:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d0d7f762b40 going to sleep for 11 seconds 00000100:00100000:0.0:1789477286.938022:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802553600 00000100:00100000:0.0:1789477286.938153:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802553600 00000100:00100000:0.0:1789477286.938230:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:0.0:1789477286.938242:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d595f5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:07d5e05c-913f-419f-adbc-d3cf15e9cd51+14:5841:x1876402802553600:12345-0@lo:501: 00000100:00100000:0.0:1789477286.938673:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d595f5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:07d5e05c-913f-419f-adbc-d3cf15e9cd51+14:5841:x1876402802553600:12345-0@lo:501: Request processed in 432us (1170us total) trans 0 rc 0/0 00000100:00100000:0.0:1789477286.938682:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:2.0:1789477286.941141:0:5841:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d7c3e4a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07d5e05c-913f-419f-adbc-d3cf15e9cd51:5841:1876402802553600:0@lo:501: 00000100:00100000:2.0:1789477286.941230:0:5841:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d7c3e4a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07d5e05c-913f-419f-adbc-d3cf15e9cd51:5841:1876402802553728:0@lo:503: 00000100:00100000:2.0:1789477286.941340:0:5841:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789477286.941389:0:5841:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d0d7f762b40 going to sleep for 11 seconds 00000100:00100000:2.0:1789477286.941435:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802553728 00000100:00100000:2.0:1789477286.941443:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802553728 00000100:00100000:2.0:1789477286.941509:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:2.0:1789477286.941519:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d595f6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07d5e05c-913f-419f-adbc-d3cf15e9cd51+14:5841:x1876402802553728:12345-0@lo:503: 00000100:00100000:2.0:1789477286.943328:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d595f6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07d5e05c-913f-419f-adbc-d3cf15e9cd51+14:5841:x1876402802553728:12345-0@lo:503: Request processed in 1797us (1975us total) trans 0 rc 0/0 00000100:00100000:2.0:1789477286.943346:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:0.0:1789477286.944257:0:5841:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d7c3e4a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07d5e05c-913f-419f-adbc-d3cf15e9cd51:5841:1876402802553728:0@lo:503: 00000100:00100000:2.0:1789477286.946525:0:8498:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d7c3e5f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:07d5e05c-913f-419f-adbc-d3cf15e9cd51:8498:1876402802553856:0@lo:502: 00000100:00100000:2.0:1789477286.946661:0:8498:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789477286.946715:0:8498:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d0d7f762cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1789477286.947959:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802553856 00000100:00100000:0.0:1789477286.947990:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802553856 00000100:00100000:0.0:1789477286.948262:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:0.0:1789477286.948278:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d595f5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:07d5e05c-913f-419f-adbc-d3cf15e9cd51+14:8498:x1876402802553856:12345-0@lo:502: 00000100:00100000:2.0:1789477286.948873:0:8498:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d7c3e5f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:07d5e05c-913f-419f-adbc-d3cf15e9cd51:8498:1876402802553856:0@lo:502: 00000020:01000000:2.0:1789477286.949123:0:8498:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789477286.949135:0:8498:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789477286.949137:0:8498:0:(obd_config.c:1563:class_process_config()) marker 26 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1789477286.949145:0:8498:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:2.0:1789477286.949193:0:8498:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d7c3e5f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:07d5e05c-913f-419f-adbc-d3cf15e9cd51:8498:1876402802553984:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789477286.949488:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d595f5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:07d5e05c-913f-419f-adbc-d3cf15e9cd51+14:8498:x1876402802553856:12345-0@lo:502: Request processed in 1213us (2825us total) trans 0 rc 0/0 00000100:00100000:0.0:1789477286.949499:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:2.0:1789477286.953118:0:8498:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789477286.953261:0:8498:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d0d7f762cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1789477286.960174:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802553984 00000100:00100000:1.0:1789477286.960195:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802553984 00000100:00100000:1.0:1789477286.960274:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:1.0:1789477286.960287:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d595f7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07d5e05c-913f-419f-adbc-d3cf15e9cd51+14:8498:x1876402802553984:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789477286.960684:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d595f7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07d5e05c-913f-419f-adbc-d3cf15e9cd51+14:8498:x1876402802553984:12345-0@lo:502:llog_process_th.0 Request processed in 399us (7578us total) trans 0 rc 0/0 00000100:00100000:1.0:1789477286.960694:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:1.0:1789477286.960802:0:8498:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d7c3e5f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:07d5e05c-913f-419f-adbc-d3cf15e9cd51:8498:1876402802553984:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1789477286.960849:0:8498:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789477286.960858:0:8498:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789477286.960861:0:8498:0:(obd_config.c:1563:class_process_config()) marker 26 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1789477286.960867:0:8498:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 11 count 11 00000020:01000000:1.0:1789477286.963364:0:5841:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 8-10 (rc=0) 10000000:01000000:1.0:1789477286.963426:0:5841:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.123@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:1.0:1789477286.963442:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.123@tcp lock: ffff9d0d41646200/0xafddb3c8f92816a4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xafddb3c8f92816ab expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477286.963459:0:5841:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.123@tcp lock: ffff9d0d41646200/0xafddb3c8f92816a4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xafddb3c8f92816ab expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789477286.963482:0:5841:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1789477286.963486:0:5841:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9d0d585fc800 from 39 10000000:01000000:1.0:1789477286.963489:0:5841:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1789477286.963539:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.123@tcp lock: ffff9d0d41646400/0xafddb3c8f92816b2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477286.963548:0:5841:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.123@tcp lock: ffff9d0d41646400/0xafddb3c8f92816b2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477286.963562:0:5841:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.123@tcp lock: ffff9d0d41646400/0xafddb3c8f92816b2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789477286.963613:0:5841:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d74a8a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07d5e05c-913f-419f-adbc-d3cf15e9cd51:5841:1876402802554112:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789477286.963703:0:5841:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789477286.963763:0:5841:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d0d515b4600 going to sleep for 11 seconds 00000100:00100000:1.0:1789477286.963791:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802554112 00000100:00100000:1.0:1789477286.963799:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802554112 00000100:00100000:1.0:1789477286.963858:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:1.0:1789477286.963869:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d595f7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:07d5e05c-913f-419f-adbc-d3cf15e9cd51+14:5841:x1876402802554112:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789477286.963885:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789477286.965220:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d0d41646800/0xafddb3c8f92816b9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xafddb3c8f92816b2 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477286.965269:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d0d41646800/0xafddb3c8f92816b9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xafddb3c8f92816b2 expref: 15 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477286.965284:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d0d41646800/0xafddb3c8f92816b9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xafddb3c8f92816b2 expref: 15 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477286.965310:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d0d41646800, rc 0) 00000100:00100000:1.0:1789477286.965409:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d595f7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:07d5e05c-913f-419f-adbc-d3cf15e9cd51+15:5841:x1876402802554112:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 1532us (1697us total) trans 0 rc 0/0 00000100:00100000:1.0:1789477286.965417:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:3.0:1789477286.965628:0:5841:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d74a8a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07d5e05c-913f-419f-adbc-d3cf15e9cd51:5841:1876402802554112:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789477286.965651:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.123@tcp lock: ffff9d0d41646400/0xafddb3c8f92816b2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xafddb3c8f92816b9 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477286.965661:0:5841:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.123@tcp lock: ffff9d0d41646400/0xafddb3c8f92816b2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xafddb3c8f92816b9 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789477286.965762:0:5841:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d74cdaa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07d5e05c-913f-419f-adbc-d3cf15e9cd51:5841:1876402802554240:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789477286.965803:0:5841:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789477286.965837:0:5841:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d0d59416600 going to sleep for 11 seconds 00000100:00100000:1.0:1789477286.966121:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802554240 00000100:00100000:1.0:1789477286.966129:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802554240 00000100:00100000:1.0:1789477286.966206:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:1.0:1789477286.966216:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d595f5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07d5e05c-913f-419f-adbc-d3cf15e9cd51+15:5841:x1876402802554240:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789477286.966560:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d595f5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07d5e05c-913f-419f-adbc-d3cf15e9cd51+15:5841:x1876402802554240:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 344us (756us total) trans 0 rc 0/0 00000100:00100000:1.0:1789477286.966569:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:2.0:1789477286.971694:0:5841:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d74cdaa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07d5e05c-913f-419f-adbc-d3cf15e9cd51:5841:1876402802554240:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789477286.972687:0:5841:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d7c3e7b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07d5e05c-913f-419f-adbc-d3cf15e9cd51:5841:1876402802554368:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789477286.973315:0:5841:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789477286.973376:0:5841:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d0d7f762180 going to sleep for 11 seconds 00000100:00100000:0.0:1789477286.973481:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802554368 00000100:00100000:0.0:1789477286.973493:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802554368 00000100:00100000:0.0:1789477286.973566:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:0.0:1789477286.973610:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d595f5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07d5e05c-913f-419f-adbc-d3cf15e9cd51+15:5841:x1876402802554368:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789477286.974307:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d595f5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07d5e05c-913f-419f-adbc-d3cf15e9cd51+15:5841:x1876402802554368:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 728us (992us total) trans 0 rc 0/0 00000100:00100000:2.0:1789477286.974318:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:3.0:1789477286.974461:0:5841:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d7c3e7b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07d5e05c-913f-419f-adbc-d3cf15e9cd51:5841:1876402802554368:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789477286.975279:0:8499:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d7c3e6300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:07d5e05c-913f-419f-adbc-d3cf15e9cd51:8499:1876402802554496:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789477286.975342:0:8499:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789477286.975422:0:8499:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d0d7f762f00 going to sleep for 11 seconds 00000100:00100000:3.0:1789477286.975456:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802554496 00000100:00100000:3.0:1789477286.975465:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802554496 00000100:00100000:3.0:1789477286.975540:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:3.0:1789477286.975549:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d595f4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:07d5e05c-913f-419f-adbc-d3cf15e9cd51+15:8499:x1876402802554496:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789477286.976917:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d595f4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:07d5e05c-913f-419f-adbc-d3cf15e9cd51+15:8499:x1876402802554496:12345-0@lo:502:llog_process_th.0 Request processed in 1351us (1556us total) trans 0 rc 0/0 00000100:00100000:3.0:1789477286.976944:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:1.0:1789477286.977106:0:8499:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d7c3e6300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:07d5e05c-913f-419f-adbc-d3cf15e9cd51:8499:1876402802554496:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789477286.977190:0:8499:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d74a8b100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:07d5e05c-913f-419f-adbc-d3cf15e9cd51:8499:1876402802554624:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789477286.977246:0:8499:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789477286.980204:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802554624 00000100:00100000:2.0:1789477286.980225:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802554624 00000100:00100000:2.0:1789477286.980293:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:2.0:1789477286.980305:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d595f6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07d5e05c-913f-419f-adbc-d3cf15e9cd51+15:8499:x1876402802554624:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789477286.980691:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d595f6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07d5e05c-913f-419f-adbc-d3cf15e9cd51+15:8499:x1876402802554624:12345-0@lo:502:llog_process_th.0 Request processed in 388us (3443us total) trans 0 rc 0/0 00000100:00100000:2.0:1789477286.980700:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:0.0:1789477286.981842:0:8499:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d0d4840c240 going to sleep for 11 seconds 00000100:00100000:0.0:1789477286.981889:0:8499:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d74a8b100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:07d5e05c-913f-419f-adbc-d3cf15e9cd51:8499:1876402802554624:0@lo:502:llog_process_th.0 00000040:00080000:0.0:1789477286.982135:0:8499:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:2.0:1789477286.986384:0:5841:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:2.0:1789477286.986439:0:5841:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.123@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1789477286.986455:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.123@tcp lock: ffff9d0d41646400/0xafddb3c8f92816b2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xafddb3c8f92816b9 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477286.986469:0:5841:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.123@tcp lock: ffff9d0d41646400/0xafddb3c8f92816b2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xafddb3c8f92816b9 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789477286.986499:0:5841:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:2.0:1789477286.986502:0:5841:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 11 10000000:01000000:2.0:1789477286.986506:0:5841:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:2.0:1789477286.986557:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.123@tcp lock: ffff9d0d59d6ba00/0xafddb3c8f92816c0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477286.986567:0:5841:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.123@tcp lock: ffff9d0d59d6ba00/0xafddb3c8f92816c0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477286.987122:0:5841:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.123@tcp lock: ffff9d0d59d6ba00/0xafddb3c8f92816c0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789477286.987168:0:5841:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d7c3e5500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07d5e05c-913f-419f-adbc-d3cf15e9cd51:5841:1876402802554752:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789477286.987266:0:5841:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789477286.987382:0:5841:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d0d7f762b40 going to sleep for 11 seconds 00000100:00100000:1.0:1789477286.988455:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802554752 00000100:00100000:1.0:1789477286.988471:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802554752 00000100:00100000:0.0:1789477286.990794:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:0.0:1789477286.990816:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d44523050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07d5e05c-913f-419f-adbc-d3cf15e9cd51+15:5841:x1876402802554752:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789477286.990843:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789477286.990870:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d0d82151600/0xafddb3c8f92816c7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xafddb3c8f92816c0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477286.991178:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d0d82151600/0xafddb3c8f92816c7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xafddb3c8f92816c0 expref: 16 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477286.991197:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d0d82151600/0xafddb3c8f92816c7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xafddb3c8f92816c0 expref: 16 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477286.991208:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d0d82151600, rc 0) 00000100:00100000:0.0:1789477286.991325:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d44523050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07d5e05c-913f-419f-adbc-d3cf15e9cd51+16:5841:x1876402802554752:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 515us (4058us total) trans 0 rc 0/0 00000100:00100000:0.0:1789477286.991333:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:2.0:1789477286.993140:0:5841:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d7c3e5500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07d5e05c-913f-419f-adbc-d3cf15e9cd51:5841:1876402802554752:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789477286.993177:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.123@tcp lock: ffff9d0d59d6ba00/0xafddb3c8f92816c0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xafddb3c8f92816c7 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477286.993191:0:5841:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.123@tcp lock: ffff9d0d59d6ba00/0xafddb3c8f92816c0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xafddb3c8f92816c7 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789477286.993287:0:5841:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d7c3e5500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07d5e05c-913f-419f-adbc-d3cf15e9cd51:5841:1876402802554880:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789477286.993358:0:5841:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789477286.993424:0:5841:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d0d7f762b40 going to sleep for 11 seconds 00000100:00100000:0.0:1789477286.993842:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802554880 00000100:00100000:0.0:1789477286.993851:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802554880 00000100:00100000:0.0:1789477286.993923:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:0.0:1789477286.993934:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d44522c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:07d5e05c-913f-419f-adbc-d3cf15e9cd51+16:5841:x1876402802554880:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789477286.994453:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d44522c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:07d5e05c-913f-419f-adbc-d3cf15e9cd51+16:5841:x1876402802554880:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 520us (1094us total) trans 0 rc 0/0 00000100:00100000:0.0:1789477286.994463:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:2.0:1789477286.994616:0:5841:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d7c3e5500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07d5e05c-913f-419f-adbc-d3cf15e9cd51:5841:1876402802554880:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789477286.994663:0:5841:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d7c3e5500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07d5e05c-913f-419f-adbc-d3cf15e9cd51:5841:1876402802555008:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789477286.994733:0:5841:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789477286.994755:0:5841:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d0d7f762b40 going to sleep for 11 seconds 00000100:00100000:0.0:1789477286.994855:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802555008 00000100:00100000:0.0:1789477286.994860:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802555008 00000100:00100000:0.0:1789477286.994894:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:0.0:1789477286.994960:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d44521450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:07d5e05c-913f-419f-adbc-d3cf15e9cd51+16:5841:x1876402802555008:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789477286.996391:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d44521450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:07d5e05c-913f-419f-adbc-d3cf15e9cd51+16:5841:x1876402802555008:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 1481us (1660us total) trans 0 rc 0/0 00000100:00100000:0.0:1789477286.996427:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:2.0:1789477286.996736:0:5841:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d7c3e5500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07d5e05c-913f-419f-adbc-d3cf15e9cd51:5841:1876402802555008:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789477286.997431:0:8502:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d4e642680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:07d5e05c-913f-419f-adbc-d3cf15e9cd51:8502:1876402802555136:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789477286.997500:0:8502:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789477286.999213:0:8502:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d0d74cd0f00 going to sleep for 11 seconds 00000100:00100000:1.0:1789477287.001857:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802555136 00000100:00100000:1.0:1789477287.001880:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802555136 00000100:00100000:1.0:1789477287.002139:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:1.0:1789477287.002152:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d44522050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07d5e05c-913f-419f-adbc-d3cf15e9cd51+16:8502:x1876402802555136:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789477287.002521:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d44522050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07d5e05c-913f-419f-adbc-d3cf15e9cd51+16:8502:x1876402802555136:12345-0@lo:502:llog_process_th.0 Request processed in 371us (5020us total) trans 0 rc 0/0 00000100:00100000:1.0:1789477287.002529:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:3.0:1789477287.002667:0:8502:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d4e642680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:07d5e05c-913f-419f-adbc-d3cf15e9cd51:8502:1876402802555136:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1789477287.002715:0:8502:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789477287.002738:0:8502:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789477287.002741:0:8502:0:(obd_config.c:1563:class_process_config()) marker 24 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1789477287.002749:0:8502:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:3.0:1789477287.002796:0:8502:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d74cd8a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:07d5e05c-913f-419f-adbc-d3cf15e9cd51:8502:1876402802555264:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789477287.002847:0:8502:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789477287.008756:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802555264 00000100:00100000:0.0:1789477287.008779:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802555264 00000100:00100000:0.0:1789477287.008861:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:0.0:1789477287.008874:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d44521c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07d5e05c-913f-419f-adbc-d3cf15e9cd51+16:8502:x1876402802555264:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789477287.009379:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d44521c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07d5e05c-913f-419f-adbc-d3cf15e9cd51+16:8502:x1876402802555264:12345-0@lo:502:llog_process_th.0 Request processed in 506us (6530us total) trans 0 rc 0/0 00000100:00100000:0.0:1789477287.009390:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:0.0:1789477287.010970:0:8502:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d0d59416e40 going to sleep for 11 seconds 00000100:00100000:0.0:1789477287.011025:0:8502:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d74cd8a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:07d5e05c-913f-419f-adbc-d3cf15e9cd51:8502:1876402802555264:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1789477287.011148:0:8502:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789477287.011159:0:8502:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789477287.011162:0:8502:0:(obd_config.c:1563:class_process_config()) marker 24 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1789477287.011168:0:8502:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 14 count 14 00000020:01000000:0.0:1789477287.011616:0:5841:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 11-13 (rc=0) 10000000:01000000:0.0:1789477287.011647:0:5841:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.123@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:0.0:1789477287.011660:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.123@tcp lock: ffff9d0d59d6ba00/0xafddb3c8f92816c0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xafddb3c8f92816c7 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477287.011674:0:5841:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.123@tcp lock: ffff9d0d59d6ba00/0xafddb3c8f92816c0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xafddb3c8f92816c7 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789477287.011686:0:5841:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1789477287.011690:0:5841:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9d0d4444e800 from 39 10000000:01000000:0.0:1789477287.011702:0:5841:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1789477287.011764:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.123@tcp lock: ffff9d0d82151800/0xafddb3c8f92816ce lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477287.011774:0:5841:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.123@tcp lock: ffff9d0d82151800/0xafddb3c8f92816ce lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477287.011785:0:5841:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.123@tcp lock: ffff9d0d82151800/0xafddb3c8f92816ce lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789477287.011815:0:5841:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d4e641880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07d5e05c-913f-419f-adbc-d3cf15e9cd51:5841:1876402802555392:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789477287.011897:0:5841:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789477287.012192:0:5841:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d0d74cd09c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789477287.012238:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802555392 00000100:00100000:1.0:1789477287.012278:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802555392 00000100:00100000:1.0:1789477287.012336:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:1.0:1789477287.012346:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d44523c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07d5e05c-913f-419f-adbc-d3cf15e9cd51+16:5841:x1876402802555392:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789477287.012365:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789477287.012381:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d0d41646e00/0xafddb3c8f92816d5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xafddb3c8f92816ce expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477287.012425:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d0d41646e00/0xafddb3c8f92816d5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xafddb3c8f92816ce expref: 17 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477287.012439:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d0d41646e00/0xafddb3c8f92816d5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xafddb3c8f92816ce expref: 17 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477287.012451:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d0d41646e00, rc 0) 00000100:00100000:1.0:1789477287.012502:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d44523c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07d5e05c-913f-419f-adbc-d3cf15e9cd51+17:5841:x1876402802555392:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 156us (605us total) trans 0 rc 0/0 00000100:00100000:1.0:1789477287.012510:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:1.0:1789477287.012564:0:5841:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d4e641880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07d5e05c-913f-419f-adbc-d3cf15e9cd51:5841:1876402802555392:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789477287.012611:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.123@tcp lock: ffff9d0d82151800/0xafddb3c8f92816ce lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xafddb3c8f92816d5 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477287.012622:0:5841:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.123@tcp lock: ffff9d0d82151800/0xafddb3c8f92816ce lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xafddb3c8f92816d5 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789477287.012694:0:5841:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d74a89c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07d5e05c-913f-419f-adbc-d3cf15e9cd51:5841:1876402802555520:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789477287.013011:0:5841:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789477287.013110:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802555520 00000100:00100000:0.0:1789477287.013117:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802555520 00000100:00100000:0.0:1789477287.013142:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:0.0:1789477287.013148:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d44523450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07d5e05c-913f-419f-adbc-d3cf15e9cd51+17:5841:x1876402802555520:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789477287.013496:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d44523450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07d5e05c-913f-419f-adbc-d3cf15e9cd51+17:5841:x1876402802555520:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 347us (485us total) trans 0 rc 0/0 00000100:00100000:0.0:1789477287.013505:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:1.0:1789477287.013560:0:5841:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d0d7c569240 going to sleep for 11 seconds 00000100:00100000:1.0:1789477287.013611:0:5841:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d74a89c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07d5e05c-913f-419f-adbc-d3cf15e9cd51:5841:1876402802555520:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789477287.013670:0:5841:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d74a89c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07d5e05c-913f-419f-adbc-d3cf15e9cd51:5841:1876402802555648:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789477287.013829:0:5841:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789477287.013879:0:5841:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d0d7c569240 going to sleep for 11 seconds 00000100:00100000:3.0:1789477287.016613:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802555648 00000100:00100000:3.0:1789477287.016633:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802555648 00000100:00100000:0.0:1789477287.017299:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:0.0:1789477287.017316:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d44521850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07d5e05c-913f-419f-adbc-d3cf15e9cd51+17:5841:x1876402802555648:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789477287.017679:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d44521850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07d5e05c-913f-419f-adbc-d3cf15e9cd51+17:5841:x1876402802555648:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 369us (3849us total) trans 0 rc 0/0 00000100:00100000:0.0:1789477287.017687:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:2.0:1789477287.018025:0:5841:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d74a89c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07d5e05c-913f-419f-adbc-d3cf15e9cd51:5841:1876402802555648:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789477287.018539:0:8505:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d4e640a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:07d5e05c-913f-419f-adbc-d3cf15e9cd51:8505:1876402802555776:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789477287.019864:0:8505:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789477287.020001:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802555776 00000100:00100000:1.0:1789477287.020012:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802555776 00000100:00100000:1.0:1789477287.020143:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:1.0:1789477287.020154:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d44521050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07d5e05c-913f-419f-adbc-d3cf15e9cd51+17:8505:x1876402802555776:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789477287.023555:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d44521050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07d5e05c-913f-419f-adbc-d3cf15e9cd51+17:8505:x1876402802555776:12345-0@lo:502:llog_process_th.0 Request processed in 3386us (3679us total) trans 0 rc 0/0 00000100:00100000:1.0:1789477287.023660:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:0.0:1789477287.023848:0:8505:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d0d74cd0180 going to sleep for 11 seconds 00000100:00100000:0.0:1789477287.023888:0:8505:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d4e640a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:07d5e05c-913f-419f-adbc-d3cf15e9cd51:8505:1876402802555776:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789477287.024185:0:8505:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d4e640a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:07d5e05c-913f-419f-adbc-d3cf15e9cd51:8505:1876402802555904:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789477287.024247:0:8505:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789477287.024316:0:8505:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d0d74cd0180 going to sleep for 11 seconds 00000100:00100000:3.0:1789477287.030993:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802555904 00000100:00100000:3.0:1789477287.031014:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802555904 00000100:00100000:3.0:1789477287.031276:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:3.0:1789477287.031289:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d595f4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:07d5e05c-913f-419f-adbc-d3cf15e9cd51+17:8505:x1876402802555904:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789477287.032293:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d595f4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:07d5e05c-913f-419f-adbc-d3cf15e9cd51+17:8505:x1876402802555904:12345-0@lo:502:llog_process_th.0 Request processed in 1000us (8038us total) trans 0 rc 0/0 00000100:00100000:3.0:1789477287.032306:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:1.0:1789477287.032440:0:8505:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d4e640a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:07d5e05c-913f-419f-adbc-d3cf15e9cd51:8505:1876402802555904:0@lo:502:llog_process_th.0 00000040:00080000:1.0:1789477287.032491:0:8505:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:3.0:1789477287.032734:0:5841:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:3.0:1789477287.032764:0:5841:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.123@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1789477287.032778:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.123@tcp lock: ffff9d0d82151800/0xafddb3c8f92816ce lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xafddb3c8f92816d5 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477287.032792:0:5841:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.123@tcp lock: ffff9d0d82151800/0xafddb3c8f92816ce lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xafddb3c8f92816d5 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789477287.032802:0:5841:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:3.0:1789477287.032806:0:5841:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 34 10000000:01000000:3.0:1789477287.032818:0:5841:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:3.0:1789477287.032859:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.123@tcp lock: ffff9d0d49ecb800/0xafddb3c8f92816dc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477287.032868:0:5841:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.123@tcp lock: ffff9d0d49ecb800/0xafddb3c8f92816dc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477287.032878:0:5841:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.123@tcp lock: ffff9d0d49ecb800/0xafddb3c8f92816dc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789477287.032914:0:5841:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d74cd9f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07d5e05c-913f-419f-adbc-d3cf15e9cd51:5841:1876402802556032:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789477287.032962:0:5841:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789477287.033003:0:5841:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d0d59416e40 going to sleep for 11 seconds 00000100:00100000:1.0:1789477287.033212:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802556032 00000100:00100000:1.0:1789477287.033220:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802556032 00000100:00100000:1.0:1789477287.033269:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:1.0:1789477287.033277:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d44520850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07d5e05c-913f-419f-adbc-d3cf15e9cd51+17:5841:x1876402802556032:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789477287.033290:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789477287.033306:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d0d41647600/0xafddb3c8f92816e3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0xafddb3c8f92816dc expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477287.033334:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d0d41647600/0xafddb3c8f92816e3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xafddb3c8f92816dc expref: 18 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477287.033345:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d0d41647600/0xafddb3c8f92816e3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xafddb3c8f92816dc expref: 18 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477287.033356:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d0d41647600, rc 0) 00000100:00100000:1.0:1789477287.033417:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d44520850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07d5e05c-913f-419f-adbc-d3cf15e9cd51+18:5841:x1876402802556032:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 140us (454us total) trans 0 rc 0/0 00000100:00100000:1.0:1789477287.033424:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:3.0:1789477287.033642:0:5841:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d74cd9f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07d5e05c-913f-419f-adbc-d3cf15e9cd51:5841:1876402802556032:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789477287.033659:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.123@tcp lock: ffff9d0d49ecb800/0xafddb3c8f92816dc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xafddb3c8f92816e3 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477287.033669:0:5841:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.123@tcp lock: ffff9d0d49ecb800/0xafddb3c8f92816dc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xafddb3c8f92816e3 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789477287.034117:0:5841:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d74cd9f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07d5e05c-913f-419f-adbc-d3cf15e9cd51:5841:1876402802556160:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789477287.034161:0:5841:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789477287.034198:0:5841:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d0d59416e40 going to sleep for 11 seconds 00000100:00100000:0.0:1789477287.034242:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802556160 00000100:00100000:0.0:1789477287.034248:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802556160 00000100:00100000:0.0:1789477287.034289:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:0.0:1789477287.034298:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d44522850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:07d5e05c-913f-419f-adbc-d3cf15e9cd51+18:5841:x1876402802556160:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789477287.034660:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d44522850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:07d5e05c-913f-419f-adbc-d3cf15e9cd51+18:5841:x1876402802556160:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 363us (497us total) trans 0 rc 0/0 00000100:00100000:0.0:1789477287.034669:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:3.0:1789477287.034865:0:5841:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d74cd9f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07d5e05c-913f-419f-adbc-d3cf15e9cd51:5841:1876402802556160:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789477287.034914:0:5841:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d74cd9f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07d5e05c-913f-419f-adbc-d3cf15e9cd51:5841:1876402802556288:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789477287.034958:0:5841:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789477287.034982:0:5841:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d0d59416e40 going to sleep for 11 seconds 00000100:00100000:1.0:1789477287.035122:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802556288 00000100:00100000:1.0:1789477287.035127:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802556288 00000100:00100000:1.0:1789477287.035159:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:1.0:1789477287.035167:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d44520c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07d5e05c-913f-419f-adbc-d3cf15e9cd51+18:5841:x1876402802556288:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789477287.035351:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d44520c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07d5e05c-913f-419f-adbc-d3cf15e9cd51+18:5841:x1876402802556288:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 184us (392us total) trans 0 rc 0/0 00000100:00100000:1.0:1789477287.035359:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:3.0:1789477287.035457:0:5841:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d74cd9f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07d5e05c-913f-419f-adbc-d3cf15e9cd51:5841:1876402802556288:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789477287.035887:0:8506:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d4e641500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:07d5e05c-913f-419f-adbc-d3cf15e9cd51:8506:1876402802556416:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789477287.035944:0:8506:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789477287.036009:0:8506:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d0d74cd09c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789477287.036315:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802556416 00000100:00100000:1.0:1789477287.036321:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802556416 00000100:00100000:1.0:1789477287.036364:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:1.0:1789477287.036373:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d44520450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07d5e05c-913f-419f-adbc-d3cf15e9cd51+18:8506:x1876402802556416:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789477287.036815:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d44520450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07d5e05c-913f-419f-adbc-d3cf15e9cd51+18:8506:x1876402802556416:12345-0@lo:502:llog_process_th.0 Request processed in 442us (869us total) trans 0 rc 0/0 00000100:00100000:1.0:1789477287.036824:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:0.0:1789477287.037124:0:8506:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d4e641500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:07d5e05c-913f-419f-adbc-d3cf15e9cd51:8506:1876402802556416:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1789477287.037165:0:8506:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789477287.037176:0:8506:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789477287.037179:0:8506:0:(obd_config.c:1563:class_process_config()) marker 27 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1789477287.037187:0:8506:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:0.0:1789477287.037217:0:8506:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d4e641500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:07d5e05c-913f-419f-adbc-d3cf15e9cd51:8506:1876402802556544:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789477287.037259:0:8506:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789477287.037294:0:8506:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d0d74cd09c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789477287.037339:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802556544 00000100:00100000:3.0:1789477287.037345:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802556544 00000100:00100000:3.0:1789477287.037382:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:3.0:1789477287.037391:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d44523850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:07d5e05c-913f-419f-adbc-d3cf15e9cd51+18:8506:x1876402802556544:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789477287.037599:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d44523850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:07d5e05c-913f-419f-adbc-d3cf15e9cd51+18:8506:x1876402802556544:12345-0@lo:502:llog_process_th.0 Request processed in 185us (315us total) trans 0 rc 0/0 00000100:00100000:3.0:1789477287.037606:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:0.0:1789477287.037699:0:8506:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d4e641500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:07d5e05c-913f-419f-adbc-d3cf15e9cd51:8506:1876402802556544:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1789477287.037727:0:8506:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789477287.037738:0:8506:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789477287.037740:0:8506:0:(obd_config.c:1563:class_process_config()) marker 27 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1789477287.037745:0:8506:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 37 count 37 00000020:01000000:3.0:1789477287.038121:0:5841:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 34-36 (rc=0) 10000000:01000000:3.0:1789477287.038147:0:5841:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.123@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:3.0:1789477287.038161:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.123@tcp lock: ffff9d0d49ecb800/0xafddb3c8f92816dc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xafddb3c8f92816e3 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477287.038174:0:5841:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.123@tcp lock: ffff9d0d49ecb800/0xafddb3c8f92816dc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xafddb3c8f92816e3 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789477287.038187:0:5841:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:3.0:1789477287.038190:0:5841:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff9d0d482499b8 from 1 10000000:01000000:3.0:1789477287.038193:0:5841:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1789477287.038227:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.123@tcp lock: ffff9d0d49ecb600/0xafddb3c8f92816ea lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477287.038236:0:5841:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.123@tcp lock: ffff9d0d49ecb600/0xafddb3c8f92816ea lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477287.038248:0:5841:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.123@tcp lock: ffff9d0d49ecb600/0xafddb3c8f92816ea lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789477287.038264:0:5841:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d74cd9f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07d5e05c-913f-419f-adbc-d3cf15e9cd51:5841:1876402802556672:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789477287.038315:0:5841:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789477287.038349:0:5841:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d0d594163c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789477287.038423:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802556672 00000100:00100000:1.0:1789477287.038430:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802556672 00000100:00100000:1.0:1789477287.038474:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:1.0:1789477287.038483:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d44522450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07d5e05c-913f-419f-adbc-d3cf15e9cd51+18:5841:x1876402802556672:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789477287.038494:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789477287.038510:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d0d41647400/0xafddb3c8f92816f1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xafddb3c8f92816ea expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477287.038537:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d0d41647400/0xafddb3c8f92816f1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xafddb3c8f92816ea expref: 19 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477287.038562:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d0d41647400/0xafddb3c8f92816f1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xafddb3c8f92816ea expref: 19 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477287.038572:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d0d41647400, rc 0) 00000100:00100000:1.0:1789477287.038630:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d44522450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07d5e05c-913f-419f-adbc-d3cf15e9cd51+19:5841:x1876402802556672:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 149us (315us total) trans 0 rc 0/0 00000100:00100000:1.0:1789477287.038636:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00100000:3.0:1789477287.038731:0:5841:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d74cd9f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07d5e05c-913f-419f-adbc-d3cf15e9cd51:5841:1876402802556672:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789477287.038747:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.123@tcp lock: ffff9d0d49ecb600/0xafddb3c8f92816ea lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xafddb3c8f92816f1 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477287.038756:0:5841:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.123@tcp lock: ffff9d0d49ecb600/0xafddb3c8f92816ea lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xafddb3c8f92816f1 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789477287.038806:0:5841:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d74cd9f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07d5e05c-913f-419f-adbc-d3cf15e9cd51:5841:1876402802556800:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789477287.038833:0:5841:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789477287.038861:0:5841:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d0d594163c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789477287.039012:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802556800 00000100:00100000:1.0:1789477287.039016:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802556800 00000100:00100000:1.0:1789477287.039054:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:1.0:1789477287.039061:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d44520050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07d5e05c-913f-419f-adbc-d3cf15e9cd51+19:5841:x1876402802556800:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789477287.039325:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d44520050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07d5e05c-913f-419f-adbc-d3cf15e9cd51+19:5841:x1876402802556800:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 264us (490us total) trans 0 rc -2/-2 00000100:00100000:1.0:1789477287.039334:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00100000:3.0:1789477287.039479:0:5841:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d74cd9f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07d5e05c-913f-419f-adbc-d3cf15e9cd51:5841:1876402802556800:0@lo:501:ll_cfg_requeue.0 10000000:01000000:3.0:1789477287.039506:0:5841:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.123@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:3.0:1789477287.039514:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.123@tcp lock: ffff9d0d49ecb600/0xafddb3c8f92816ea lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xafddb3c8f92816f1 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477287.039522:0:5841:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.123@tcp lock: ffff9d0d49ecb600/0xafddb3c8f92816ea lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xafddb3c8f92816f1 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477287.607918:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1789477287.664858:0:8538:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fffa9000e50 20000000:00000080:1.0:1789477287.664881:0:8538:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9d0d7c667c00 uarg=0000000000000000 20000000:01000000:1.0:1789477287.664926:0:8538:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:1.0:1789477287.664933:0:8538:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:1.0:1789477287.664939:0:8538:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:3.0:1789477287.667433:0:8539:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 20000000:02000000:1.0:1789477287.668129:0:8538:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter general.lod.*.mdt_hash=crush in log params 00000040:00080000:1.0:1789477287.677379:0:8538:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8976 00000040:00080000:1.0:1789477287.677451:0:8538:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 112 off9088 00000040:00080000:1.0:1789477287.677506:0:8538:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 224 off9312 10000000:01000000:1.0:1789477287.677523:0:8538:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1789477287.677541:0:8538:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9d0d41646a00/0xafddb3c8f92816f8 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477287.677571:0:8538:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9d0d59d6b400/0xafddb3c8f92814e4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xafddb3c8f92814dd expref: 18 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477287.677614:0:8538:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9d0d59d6a800/0xafddb3c8f928150e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xafddb3c8f9281507 expref: 18 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477287.677620:0:8538:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9d0d49eca600/0xafddb3c8f928159a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xafddb3c8f9281593 expref: 18 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477287.677629:0:8538:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9d0d49eca800/0xafddb3c8f9281657 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f29af expref: 9 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477287.677636:0:8538:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9d0d41646a00/0xafddb3c8f92816f8 lrc: 7/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477287.677675:0:8538:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9d0d49eca800/0xafddb3c8f9281657 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f29af expref: 9 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477287.677691:0:8538:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9d0d49eca800/0xafddb3c8f9281657 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f29af expref: 9 pid: 5838 timeout: 332 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789477287.677718:0:8538:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d74a8aa00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8538:1876402802556928:192.168.201.23@tcp:104: 00010000:00010000:1.0:1789477287.677828:0:8538:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9d0d49eca600/0xafddb3c8f928159a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xafddb3c8f9281593 expref: 18 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477287.677837:0:8538:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9d0d49eca600/0xafddb3c8f928159a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xafddb3c8f9281593 expref: 18 pid: 5838 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789477287.677846:0:8538:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d74a88380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8538:1876402802557056:0@lo:104: 00000100:00100000:1.0:1789477287.677897:0:8538:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789477287.677939:0:8538:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9d0d59d6a800/0xafddb3c8f928150e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xafddb3c8f9281507 expref: 18 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477287.677947:0:8538:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9d0d59d6a800/0xafddb3c8f928150e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xafddb3c8f9281507 expref: 18 pid: 5837 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789477287.677955:0:8538:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d74a8b480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8538:1876402802557184:0@lo:104: 00010000:00010000:1.0:1789477287.677980:0:8538:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9d0d59d6b400/0xafddb3c8f92814e4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xafddb3c8f92814dd expref: 18 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477287.677987:0:8538:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9d0d59d6b400/0xafddb3c8f92814e4 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xafddb3c8f92814dd expref: 18 pid: 5837 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789477287.677994:0:8538:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d74a88700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8538:1876402802557312:0@lo:104: 00000100:00100000:1.0:1789477287.678013:0:8538:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d0d50a5d180 going to sleep for 11 seconds 00000100:00100000:2.0:1789477287.678256:0:5827:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1789477287.678302:0:5827:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789477287.678355:0:5827:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789477287.678369:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802557056 00000100:00100000:2.0:1789477287.678380:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802557056 00000100:00100000:2.0:1789477287.678461:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802557184 00000100:00100000:2.0:1789477287.678465:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802557184 00000100:00100000:2.0:1789477287.678475:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802557312 00000100:00100000:2.0:1789477287.678478:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802557312 00000100:00100000:2.0:1789477287.678491:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1789477287.678503:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d6d49e050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:07d5e05c-913f-419f-adbc-d3cf15e9cd51+5:8538:x1876402802557056:12345-0@lo:104: 00010000:00010000:2.0:1789477287.678523:0:5827:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.123@tcp lock: ffff9d0d59d6a400/0xafddb3c8f9281593 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xafddb3c8f928159a expref: -99 pid: 7660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477287.678648:0:5827:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1789477287.678665:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d6d49e050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:07d5e05c-913f-419f-adbc-d3cf15e9cd51+5:8538:x1876402802557056:12345-0@lo:104: Request processed in 154us (757us total) trans 0 rc 0/0 00000100:00100000:0.0:1789477287.678673:0:8538:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d74a88380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8538:1876402802557056:0@lo:104: 00010000:00010000:0.0:1789477287.678837:0:5832:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789477287.678844:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.123@tcp lock: ffff9d0d59d6a400/0xafddb3c8f9281593 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xafddb3c8f928159a expref: -99 pid: 7660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477287.678853:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d0d59d6a400 already unused, calling callback (ffffffffc1bb3c20) 10000000:00010000:0.0:1789477287.678857:0:5832:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.123@tcp lock: ffff9d0d59d6a400/0xafddb3c8f9281593 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xafddb3c8f928159a expref: -99 pid: 7660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477287.678868:0:5832:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.123@tcp lock: ffff9d0d59d6a400/0xafddb3c8f9281593 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xafddb3c8f928159a expref: -99 pid: 7660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789477287.678876:0:5832:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.123@tcp lock: ffff9d0d59d6a400/0xafddb3c8f9281593 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xafddb3c8f928159a expref: -99 pid: 7660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789477287.678881:0:5832:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1789477287.678927:0:5832:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.123@tcp lock: ffff9d0d59d6a400/0xafddb3c8f9281593 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xafddb3c8f928159a expref: -99 pid: 7660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477287.678934:0:5832:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789477287.678954:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.123@tcp lock: ffff9d0d59d6a400/0xafddb3c8f9281593 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xafddb3c8f928159a expref: -99 pid: 7660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477287.678961:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.123@tcp lock: ffff9d0d59d6a400/0xafddb3c8f9281593 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xafddb3c8f928159a expref: -99 pid: 7660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477287.678974:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789477287.678976:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789477287.678986:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789477287.679031:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1789477287.679045:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d4e641500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:07d5e05c-913f-419f-adbc-d3cf15e9cd51:3313:1876402802557440:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789477287.679088:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1789477287.679096:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789477287.679106:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d7c3e5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:07d5e05c-913f-419f-adbc-d3cf15e9cd51+4:8538:x1876402802557184:12345-0@lo:104: 00010000:00010000:2.0:1789477287.679119:0:5827:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.123@tcp lock: ffff9d0d49ecac00/0xafddb3c8f9281507 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xafddb3c8f928150e expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789477287.679178:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802557440 00000100:00100000:0.0:1789477287.679188:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802557440 00010000:00010000:2.0:1789477287.679202:0:5827:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1789477287.679223:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d7c3e5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:07d5e05c-913f-419f-adbc-d3cf15e9cd51+4:8538:x1876402802557184:12345-0@lo:104: Request processed in 121us (923us total) trans 0 rc 0/0 00010000:00010000:0.0:1789477287.679226:0:5829:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9d0d49eca600/0xafddb3c8f928159a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xafddb3c8f9281593 expref: 19 pid: 5838 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789477287.679237:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1789477287.679266:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1789477287.679278:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d7c3e6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:07d5e05c-913f-419f-adbc-d3cf15e9cd51+3:8538:x1876402802557312:12345-0@lo:104: 00000100:00100000:0.0:1789477287.679286:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00010000:00010000:2.0:1789477287.679289:0:5827:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.123@tcp lock: ffff9d0d59d6be00/0xafddb3c8f92814dd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xafddb3c8f92814e4 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789477287.679301:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d74a88000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:07d5e05c-913f-419f-adbc-d3cf15e9cd51+19:3313:x1876402802557440:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789477287.679317:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789477287.679325:0:5829:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9d0d49eca600/0xafddb3c8f928159a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xafddb3c8f9281593 expref: 19 pid: 5838 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477287.679333:0:5827:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00010000:00010000:0.0:1789477287.679336:0:5829:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9d0d49eca600/0xafddb3c8f928159a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xafddb3c8f9281593 expref: 19 pid: 5838 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789477287.679345:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d7c3e6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:07d5e05c-913f-419f-adbc-d3cf15e9cd51+3:8538:x1876402802557312:12345-0@lo:104: Request processed in 67us (985us total) trans 0 rc 0/0 00000100:00100000:2.0:1789477287.679361:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00010000:00010000:0.0:1789477287.679370:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d0d49eca600/0xafddb3c8f928159a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xafddb3c8f9281593 expref: 19 pid: 5838 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477287.679398:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789477287.679410:0:6710:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789477287.679418:0:6710:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.123@tcp lock: ffff9d0d49ecac00/0xafddb3c8f9281507 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xafddb3c8f928150e expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477287.679428:0:6710:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d0d49ecac00 already unused, calling callback (ffffffffc1bb3c20) 10000000:00010000:2.0:1789477287.679434:0:6710:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.123@tcp lock: ffff9d0d49ecac00/0xafddb3c8f9281507 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xafddb3c8f928150e expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477287.679453:0:6710:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.123@tcp lock: ffff9d0d49ecac00/0xafddb3c8f9281507 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xafddb3c8f928150e expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789477287.679454:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d74a88000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:07d5e05c-913f-419f-adbc-d3cf15e9cd51+18:3313:x1876402802557440:12345-0@lo:103:ldlm_bl.0 Request processed in 156us (361us total) trans 0 rc 0/0 10000000:00010000:2.0:1789477287.679485:0:6710:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.123@tcp lock: ffff9d0d49ecac00/0xafddb3c8f9281507 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xafddb3c8f928150e expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789477287.679493:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 10000000:01000000:2.0:1789477287.679505:0:6710:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1789477287.679541:0:6710:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.123@tcp lock: ffff9d0d49ecac00/0xafddb3c8f9281507 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xafddb3c8f928150e expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477287.679560:0:6710:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789477287.679573:0:5833:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789477287.679611:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.123@tcp lock: ffff9d0d59d6be00/0xafddb3c8f92814dd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xafddb3c8f92814e4 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477287.679618:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d0d59d6be00 already unused, calling callback (ffffffffc1bb3c20) 10000000:00010000:1.0:1789477287.679622:0:5833:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.123@tcp lock: ffff9d0d59d6be00/0xafddb3c8f92814dd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xafddb3c8f92814e4 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477287.679629:0:5833:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.123@tcp lock: ffff9d0d59d6be00/0xafddb3c8f92814dd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xafddb3c8f92814e4 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789477287.679648:0:5833:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.123@tcp lock: ffff9d0d59d6be00/0xafddb3c8f92814dd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xafddb3c8f92814e4 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789477287.679654:0:5833:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1789477287.679675:0:5833:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.123@tcp lock: ffff9d0d59d6be00/0xafddb3c8f92814dd lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xafddb3c8f92814e4 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477287.679681:0:5833:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:0.0:1789477287.679952:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d7c3e4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:07d5e05c-913f-419f-adbc-d3cf15e9cd51:3310:1876402802557568:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789477287.679979:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789477287.680037:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802557568 00000100:00100000:3.0:1789477287.680042:0:6711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802557568 00010000:00010000:3.0:1789477287.680061:0:6711:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9d0d59d6a800/0xafddb3c8f928150e lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xafddb3c8f9281507 expref: 18 pid: 5837 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789477287.680091:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1789477287.680099:0:6711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d4e641f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:07d5e05c-913f-419f-adbc-d3cf15e9cd51+18:3310:x1876402802557568:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789477287.680113:0:6710:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.123@tcp lock: ffff9d0d49ecac00/0xafddb3c8f9281507 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xafddb3c8f928150e expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477287.680116:0:6711:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789477287.680137:0:6711:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9d0d59d6a800/0xafddb3c8f928150e lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xafddb3c8f9281507 expref: 18 pid: 5837 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477287.680147:0:6711:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9d0d59d6a800/0xafddb3c8f928150e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xafddb3c8f9281507 expref: 18 pid: 5837 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477287.680158:0:6711:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789477287.680206:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.123@tcp lock: ffff9d0d59d6be00/0xafddb3c8f92814dd lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xafddb3c8f92814e4 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477287.680214:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.123@tcp lock: ffff9d0d59d6be00/0xafddb3c8f92814dd lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xafddb3c8f92814e4 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477287.680225:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789477287.680227:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789477287.680229:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789477287.680254:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d4e641500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:07d5e05c-913f-419f-adbc-d3cf15e9cd51:3313:1876402802557440:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789477287.680297:0:8538:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d0d59d6a800/0xafddb3c8f928150e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xafddb3c8f9281507 expref: 18 pid: 5837 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789477287.680307:0:8538:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d74a8b480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8538:1876402802557184:0@lo:104: 00000100:00100000:1.0:1789477287.680318:0:8538:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d74a88700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8538:1876402802557312:0@lo:104: 00010000:00010000:2.0:1789477287.680373:0:6710:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.123@tcp lock: ffff9d0d49ecac00/0xafddb3c8f9281507 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xafddb3c8f928150e expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477287.680408:0:6710:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789477287.680410:0:6710:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789477287.680413:0:6710:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789477287.680695:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d74a89880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:07d5e05c-913f-419f-adbc-d3cf15e9cd51:3311:1876402802557696:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789477287.680738:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789477287.680860:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802557696 00000100:00100000:2.0:1789477287.680869:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802557696 00010000:00010000:2.0:1789477287.680899:0:5829:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9d0d59d6b400/0xafddb3c8f92814e4 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xafddb3c8f92814dd expref: 18 pid: 5837 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789477287.680921:0:6711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d4e641f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:07d5e05c-913f-419f-adbc-d3cf15e9cd51+18:3310:x1876402802557568:12345-0@lo:103:ldlm_bl.0 Request processed in 819us (937us total) trans 0 rc 0/0 00000100:00100000:2.0:1789477287.680940:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1789477287.680949:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d74a8b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:07d5e05c-913f-419f-adbc-d3cf15e9cd51+18:3311:x1876402802557696:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789477287.680963:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789477287.680968:0:5829:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9d0d59d6b400/0xafddb3c8f92814e4 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xafddb3c8f92814dd expref: 18 pid: 5837 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477287.680981:0:5829:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9d0d59d6b400/0xafddb3c8f92814e4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xafddb3c8f92814dd expref: 18 pid: 5837 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789477287.680992:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00010000:00010000:2.0:1789477287.681011:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d0d59d6b400/0xafddb3c8f92814e4 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xafddb3c8f92814dd expref: 18 pid: 5837 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477287.681029:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789477287.681094:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d74a8b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:07d5e05c-913f-419f-adbc-d3cf15e9cd51+16:3311:x1876402802557696:12345-0@lo:103:ldlm_bl.0 Request processed in 147us (355us total) trans 0 rc 0/0 00000100:00100000:2.0:1789477287.681113:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1789477287.681130:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d74a89880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:07d5e05c-913f-419f-adbc-d3cf15e9cd51:3311:1876402802557696:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789477287.681233:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d7c3e4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:07d5e05c-913f-419f-adbc-d3cf15e9cd51:3310:1876402802557568:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789477287.682877:0:8538:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d74a8aa00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8538:1876402802556928:192.168.201.23@tcp:104: 00010000:00010000:1.0:1789477287.682930:0:8538:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9d0d41646a00/0xafddb3c8f92816f8 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789477287.683921:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:2.0:1789477287.683978:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783655040 00000100:00100000:2.0:1789477287.683991:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783655040 00010000:00010000:2.0:1789477287.684040:0:5830:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9d0d49eca800/0xafddb3c8f9281657 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f29af expref: 10 pid: 5838 timeout: 332 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789477287.684091:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 24 00000100:00100000:2.0:1789477287.684103:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d74a8aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5c82dded-6a10-4ce8-abd1-52bd956b9523+10:2355:x1876402783655040:12345-192.168.201.23@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789477287.684119:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789477287.684127:0:5830:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9d0d49eca800/0xafddb3c8f9281657 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f29af expref: 10 pid: 5838 timeout: 332 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477287.684150:0:5830:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9d0d49eca800/0xafddb3c8f9281657 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f29af expref: 10 pid: 5838 timeout: 332 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477287.684172:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d0d49eca800/0xafddb3c8f9281657 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f29af expref: 10 pid: 5838 timeout: 332 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477287.684192:0:5830:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9d0d41646a00/0xafddb3c8f92816f8 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477287.684203:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d0d41646a00/0xafddb3c8f92816f8 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477287.684222:0:5830:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9d0d41646a00/0xafddb3c8f92816f8 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477287.684239:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9d0d41646a00/0xafddb3c8f92816f8 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477287.684266:0:5830:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9d0d41646a00/0xafddb3c8f92816f8 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477287.684274:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9d0d41646a00/0xafddb3c8f92816f8 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477287.684281:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d0d41646a00 already unused, calling callback (ffffffffc15972a0) 00010000:00010000:2.0:1789477287.684287:0:5830:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9d0d41646a00/0xafddb3c8f92816f8 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477287.684296:0:5830:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9d0d41646a00/0xafddb3c8f92816f8 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 8538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477287.684314:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9d0d41646a00/0xafddb3c8f92816f8 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477287.684326:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789477287.684353:0:8538:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9d0d41646a00/0xafddb3c8f92816f8 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477287.684366:0:8538:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9d0d41646a00/0xafddb3c8f92816f8 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477287.684373:0:8538:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d0d41646a00/0xafddb3c8f92816f8 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789477287.684405:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d74a8aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5c82dded-6a10-4ce8-abd1-52bd956b9523+9:2355:x1876402783655040:12345-192.168.201.23@tcp:103:ldlm_bl.0 Request processed in 303us (487us total) trans 0 rc 0/0 00000100:00100000:2.0:1789477287.684417:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 24 00000100:00100000:2.0:1789477287.903927:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:2.0:1789477287.904005:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:2.0:1789477287.904053:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:1.0:1789477287.904144:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783655424 00000100:00100000:1.0:1789477287.904156:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783655424 00000100:00100000:1.0:1789477287.904226:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783655296 00000100:00100000:1.0:1789477287.904230:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783655296 00000100:00100000:1.0:1789477287.904255:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 11 00000100:00100000:1.0:1789477287.904267:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d7c3e6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9bc33f26-0aab-4a14-832f-c58d566de1b0+5:2355:x1876402783655424:12345-192.168.201.23@tcp:400:kworker.0 00000100:00100000:1.0:1789477287.904371:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d7c3e6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9bc33f26-0aab-4a14-832f-c58d566de1b0+5:2355:x1876402783655424:12345-192.168.201.23@tcp:400:kworker.0 Request processed in 106us (364us total) trans 0 rc 0/0 00000100:00100000:1.0:1789477287.904380:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 11 00000100:00100000:1.0:1789477287.904410:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 12 00000100:00100000:1.0:1789477287.904417:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d7c3e7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9bc33f26-0aab-4a14-832f-c58d566de1b0+5:2355:x1876402783655296:12345-192.168.201.23@tcp:400:kworker.0 00000100:00100000:1.0:1789477287.904442:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d7c3e7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9bc33f26-0aab-4a14-832f-c58d566de1b0+5:2355:x1876402783655296:12345-192.168.201.23@tcp:400:kworker.0 Request processed in 26us (389us total) trans 0 rc 0/0 00000100:00100000:1.0:1789477287.904449:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 12 00000100:00080000:2.0:1789477287.904478:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789477287.904482:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789477287.905805:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783655168 00000100:00100000:0.0:1789477287.905817:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783655168 00000100:00100000:2.0:1789477287.908627:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 27 00000100:00100000:2.0:1789477287.908642:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d7c3e5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9bc33f26-0aab-4a14-832f-c58d566de1b0+6:2355:x1876402783655168:12345-192.168.201.23@tcp:400:kworker.0 00000100:00100000:2.0:1789477287.908743:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d7c3e5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9bc33f26-0aab-4a14-832f-c58d566de1b0+6:2355:x1876402783655168:12345-192.168.201.23@tcp:400:kworker.0 Request processed in 104us (4827us total) trans 0 rc 0/0 00000100:00100000:2.0:1789477287.908764:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 27 00000100:00080000:3.0:1789477287.911467:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1789477288.623854:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1789477288.819565:0:5841:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1789477288.819572:0:5841:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9d0d514ce000 from 4 10000000:01000000:2.0:1789477288.819675:0:5841:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1789477288.819720:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.123@tcp lock: ffff9d0d59d6b400/0xafddb3c8f92816ff lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477288.819732:0:5841:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.123@tcp lock: ffff9d0d59d6b400/0xafddb3c8f92816ff lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477288.819743:0:5841:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.123@tcp lock: ffff9d0d59d6b400/0xafddb3c8f92816ff lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789477288.819769:0:5841:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d7c3e5c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07d5e05c-913f-419f-adbc-d3cf15e9cd51:5841:1876402802557824:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789477288.819834:0:5841:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789477288.819888:0:5841:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d0d594163c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789477288.819903:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802557824 00000100:00100000:3.0:1789477288.819922:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802557824 00000100:00100000:3.0:1789477288.820011:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:3.0:1789477288.820025:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d4e677850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07d5e05c-913f-419f-adbc-d3cf15e9cd51+16:5841:x1876402802557824:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789477288.820045:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789477288.820070:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d0d49ecbc00/0xafddb3c8f9281706 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xafddb3c8f92816ff expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477288.820105:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d0d49ecbc00/0xafddb3c8f9281706 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xafddb3c8f92816ff expref: 17 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477288.820118:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d0d49ecbc00/0xafddb3c8f9281706 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xafddb3c8f92816ff expref: 17 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477288.820129:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d0d49ecbc00, rc 0) 00000100:00100000:3.0:1789477288.820221:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d4e677850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07d5e05c-913f-419f-adbc-d3cf15e9cd51+17:5841:x1876402802557824:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 198us (385us total) trans 0 rc 0/0 00000100:00100000:3.0:1789477288.820246:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00100000:2.0:1789477288.820384:0:5841:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d7c3e5c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07d5e05c-913f-419f-adbc-d3cf15e9cd51:5841:1876402802557824:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789477288.820406:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.123@tcp lock: ffff9d0d59d6b400/0xafddb3c8f92816ff lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xafddb3c8f9281706 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477288.820416:0:5841:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.123@tcp lock: ffff9d0d59d6b400/0xafddb3c8f92816ff lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xafddb3c8f9281706 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789477288.820476:0:5841:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d7c3e5c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07d5e05c-913f-419f-adbc-d3cf15e9cd51:5841:1876402802557952:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789477288.820509:0:5841:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789477288.820567:0:5841:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d0d594163c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789477288.822342:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802557952 00000100:00100000:0.0:1789477288.822410:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802557952 00000100:00100000:0.0:1789477288.822502:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:0.0:1789477288.822515:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d4e676450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07d5e05c-913f-419f-adbc-d3cf15e9cd51+17:5841:x1876402802557952:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789477288.822904:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d4e676450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07d5e05c-913f-419f-adbc-d3cf15e9cd51+17:5841:x1876402802557952:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 392us (2393us total) trans 0 rc 0/0 00000100:00100000:0.0:1789477288.822913:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00000100:00100000:2.0:1789477288.823036:0:5841:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d7c3e5c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07d5e05c-913f-419f-adbc-d3cf15e9cd51:5841:1876402802557952:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789477288.823094:0:5841:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d7c3e5c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07d5e05c-913f-419f-adbc-d3cf15e9cd51:5841:1876402802558080:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789477288.823144:0:5841:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789477288.823175:0:5841:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d0d594163c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789477288.823189:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802558080 00000100:00100000:2.0:1789477288.823193:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802558080 00000100:00100000:2.0:1789477288.823221:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:2.0:1789477288.823242:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d4e674050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:07d5e05c-913f-419f-adbc-d3cf15e9cd51+17:5841:x1876402802558080:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789477288.823415:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d4e674050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:07d5e05c-913f-419f-adbc-d3cf15e9cd51+17:5841:x1876402802558080:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 186us (270us total) trans 0 rc 0/0 00000100:00100000:2.0:1789477288.823422:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00100000:2.0:1789477288.823459:0:5841:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d7c3e5c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07d5e05c-913f-419f-adbc-d3cf15e9cd51:5841:1876402802558080:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789477288.823771:0:8580:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d7c3e5c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:07d5e05c-913f-419f-adbc-d3cf15e9cd51:8580:1876402802558208:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789477288.823805:0:8580:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789477288.823825:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802558208 00000100:00100000:2.0:1789477288.823829:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802558208 00000100:00100000:2.0:1789477288.823847:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:2.0:1789477288.823852:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d4e677050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:07d5e05c-913f-419f-adbc-d3cf15e9cd51+17:8580:x1876402802558208:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789477288.824013:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d4e677050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:07d5e05c-913f-419f-adbc-d3cf15e9cd51+17:8580:x1876402802558208:12345-0@lo:502:llog_process_th.0 Request processed in 159us (206us total) trans 0 rc 0/0 00000100:00100000:2.0:1789477288.824021:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00100000:2.0:1789477288.824053:0:8580:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d0d50a1e240 going to sleep for 11 seconds 00000100:00100000:2.0:1789477288.824068:0:8580:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d7c3e5c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:07d5e05c-913f-419f-adbc-d3cf15e9cd51:8580:1876402802558208:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1789477288.824097:0:8580:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789477288.824109:0:8580:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789477288.824118:0:8580:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1789477288.824129:0:8580:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9d0d514ce000 00000020:00000080:2.0:1789477288.824132:0:8580:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1789477288.829001:0:8580:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d74cd9f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:07d5e05c-913f-419f-adbc-d3cf15e9cd51:8580:1876402802558336:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789477288.829125:0:8580:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789477288.829406:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802558336 00000100:00100000:1.0:1789477288.829427:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802558336 00000100:00100000:3.0:1789477288.829442:0:8580:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d0d44527c00 going to sleep for 11 seconds 00000100:00100000:1.0:1789477288.829490:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:1.0:1789477288.829503:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d4e676c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07d5e05c-913f-419f-adbc-d3cf15e9cd51+17:8580:x1876402802558336:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789477288.829851:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d4e676c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07d5e05c-913f-419f-adbc-d3cf15e9cd51+17:8580:x1876402802558336:12345-0@lo:502:llog_process_th.0 Request processed in 350us (726us total) trans 0 rc 0/0 00000100:00100000:1.0:1789477288.829859:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00100000:3.0:1789477288.829930:0:8580:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d74cd9f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:07d5e05c-913f-419f-adbc-d3cf15e9cd51:8580:1876402802558336:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1789477288.829973:0:8580:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789477288.829983:0:8580:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789477288.829986:0:8580:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:3.0:1789477288.829993:0:8580:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:3.0:1789477288.830847:0:5841:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:3.0:1789477288.830874:0:5841:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.123@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1789477288.830889:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.123@tcp lock: ffff9d0d59d6b400/0xafddb3c8f92816ff lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xafddb3c8f9281706 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477288.830903:0:5841:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.123@tcp lock: ffff9d0d59d6b400/0xafddb3c8f92816ff lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xafddb3c8f9281706 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789477288.830916:0:5841:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1789477288.830920:0:5841:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9d0d585fc800 from 4 10000000:01000000:3.0:1789477288.830923:0:5841:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1789477288.830965:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.123@tcp lock: ffff9d0d49ecb200/0xafddb3c8f928170d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477288.830975:0:5841:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.123@tcp lock: ffff9d0d49ecb200/0xafddb3c8f928170d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477288.830988:0:5841:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.123@tcp lock: ffff9d0d49ecb200/0xafddb3c8f928170d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789477288.831029:0:5841:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d74cd9f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07d5e05c-913f-419f-adbc-d3cf15e9cd51:5841:1876402802558464:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789477288.831104:0:5841:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789477288.831167:0:5841:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d0d44527c00 going to sleep for 11 seconds 00000100:00100000:0.0:1789477288.831688:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802558464 00000100:00100000:0.0:1789477288.831701:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802558464 00000100:00100000:0.0:1789477288.831750:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:0.0:1789477288.831759:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d4e675450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07d5e05c-913f-419f-adbc-d3cf15e9cd51+17:5841:x1876402802558464:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789477288.831774:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789477288.831793:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d0d82150800/0xafddb3c8f9281714 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xafddb3c8f928170d expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477288.831819:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d0d82150800/0xafddb3c8f9281714 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xafddb3c8f928170d expref: 18 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477288.831829:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d0d82150800/0xafddb3c8f9281714 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xafddb3c8f928170d expref: 18 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477288.831837:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d0d82150800, rc 0) 00000100:00100000:0.0:1789477288.831904:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d4e675450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07d5e05c-913f-419f-adbc-d3cf15e9cd51+18:5841:x1876402802558464:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 146us (803us total) trans 0 rc 0/0 00000100:00100000:0.0:1789477288.831911:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00100000:3.0:1789477288.831956:0:5841:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d74cd9f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07d5e05c-913f-419f-adbc-d3cf15e9cd51:5841:1876402802558464:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789477288.831979:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.123@tcp lock: ffff9d0d49ecb200/0xafddb3c8f928170d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xafddb3c8f9281714 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477288.831990:0:5841:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.123@tcp lock: ffff9d0d49ecb200/0xafddb3c8f928170d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xafddb3c8f9281714 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789477288.832069:0:5841:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d74cd9f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07d5e05c-913f-419f-adbc-d3cf15e9cd51:5841:1876402802558592:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789477288.832119:0:5841:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789477288.832157:0:5841:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d0d44527c00 going to sleep for 11 seconds 00000100:00100000:3.0:1789477288.832180:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802558592 00000100:00100000:3.0:1789477288.832186:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802558592 00000100:00100000:3.0:1789477288.832229:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:3.0:1789477288.832239:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d4e676050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:07d5e05c-913f-419f-adbc-d3cf15e9cd51+18:5841:x1876402802558592:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789477288.832885:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d4e676050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:07d5e05c-913f-419f-adbc-d3cf15e9cd51+18:5841:x1876402802558592:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 646us (767us total) trans 0 rc 0/0 00000100:00100000:3.0:1789477288.832895:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00100000:3.0:1789477288.832962:0:5841:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d74cd9f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07d5e05c-913f-419f-adbc-d3cf15e9cd51:5841:1876402802558592:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789477288.832999:0:5841:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d74cd9f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07d5e05c-913f-419f-adbc-d3cf15e9cd51:5841:1876402802558720:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789477288.833056:0:5841:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789477288.833087:0:5841:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d0d44527c00 going to sleep for 11 seconds 00000100:00100000:3.0:1789477288.833113:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802558720 00000100:00100000:3.0:1789477288.833118:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802558720 00000100:00100000:3.0:1789477288.833153:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:3.0:1789477288.833160:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d4e675c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07d5e05c-913f-419f-adbc-d3cf15e9cd51+18:5841:x1876402802558720:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789477288.833356:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d4e675c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07d5e05c-913f-419f-adbc-d3cf15e9cd51+18:5841:x1876402802558720:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 194us (297us total) trans 0 rc 0/0 00000100:00100000:3.0:1789477288.833381:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00100000:3.0:1789477288.833437:0:5841:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d74cd9f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07d5e05c-913f-419f-adbc-d3cf15e9cd51:5841:1876402802558720:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789477288.834335:0:8584:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d7c3e5c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:07d5e05c-913f-419f-adbc-d3cf15e9cd51:8584:1876402802558848:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789477288.834423:0:8584:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789477288.834464:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802558848 00000100:00100000:2.0:1789477288.834470:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802558848 00000100:00100000:2.0:1789477288.834507:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:2.0:1789477288.834516:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d4e677c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07d5e05c-913f-419f-adbc-d3cf15e9cd51+18:8584:x1876402802558848:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789477288.834860:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d4e677c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07d5e05c-913f-419f-adbc-d3cf15e9cd51+18:8584:x1876402802558848:12345-0@lo:502:llog_process_th.0 Request processed in 344us (437us total) trans 0 rc 0/0 00000100:00100000:2.0:1789477288.834867:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00100000:2.0:1789477288.834915:0:8584:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d0d50a1e240 going to sleep for 11 seconds 00000100:00100000:2.0:1789477288.834936:0:8584:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d7c3e5c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:07d5e05c-913f-419f-adbc-d3cf15e9cd51:8584:1876402802558848:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1789477288.834964:0:8584:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789477288.834973:0:8584:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789477288.834975:0:8584:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1789477288.834981:0:8584:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9d0d585fc800 00000020:00000080:2.0:1789477288.834984:0:8584:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1789477288.836844:0:8584:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d7c3e5c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:07d5e05c-913f-419f-adbc-d3cf15e9cd51:8584:1876402802558976:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789477288.836911:0:8584:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789477288.836948:0:8584:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d0d510abc00 going to sleep for 11 seconds 00000100:00100000:3.0:1789477288.837691:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802558976 00000100:00100000:3.0:1789477288.837701:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802558976 00000100:00100000:3.0:1789477288.837749:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00000100:00100000:3.0:1789477288.837758:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d4e677450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:07d5e05c-913f-419f-adbc-d3cf15e9cd51+18:8584:x1876402802558976:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789477288.838572:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d4e677450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:07d5e05c-913f-419f-adbc-d3cf15e9cd51+18:8584:x1876402802558976:12345-0@lo:502:llog_process_th.0 Request processed in 814us (1659us total) trans 0 rc 0/0 00000100:00100000:3.0:1789477288.838665:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00000100:00100000:2.0:1789477288.839707:0:8584:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d7c3e5c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:07d5e05c-913f-419f-adbc-d3cf15e9cd51:8584:1876402802558976:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1789477288.839747:0:8584:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789477288.839754:0:8584:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789477288.839756:0:8584:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:2.0:1789477288.839762:0:8584:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:3.0:1789477288.839923:0:5841:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:3.0:1789477288.839943:0:5841:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.123@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1789477288.839953:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.123@tcp lock: ffff9d0d49ecb200/0xafddb3c8f928170d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xafddb3c8f9281714 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477288.839963:0:5841:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.123@tcp lock: ffff9d0d49ecb200/0xafddb3c8f928170d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xafddb3c8f9281714 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789477288.839973:0:5841:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1789477288.839976:0:5841:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9d0d4444e800 from 4 10000000:01000000:3.0:1789477288.839979:0:5841:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1789477288.840012:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.123@tcp lock: ffff9d0d49eca800/0xafddb3c8f928171b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477288.840030:0:5841:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.123@tcp lock: ffff9d0d49eca800/0xafddb3c8f928171b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477288.840040:0:5841:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.123@tcp lock: ffff9d0d49eca800/0xafddb3c8f928171b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789477288.840060:0:5841:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d74cd9f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07d5e05c-913f-419f-adbc-d3cf15e9cd51:5841:1876402802559104:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789477288.840102:0:5841:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789477288.840140:0:5841:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d0d47344000 going to sleep for 11 seconds 00000100:00100000:2.0:1789477288.840314:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802559104 00000100:00100000:2.0:1789477288.840326:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802559104 00000100:00100000:2.0:1789477288.840377:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 181 00000100:00100000:2.0:1789477288.840385:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d4e675850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07d5e05c-913f-419f-adbc-d3cf15e9cd51+18:5841:x1876402802559104:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789477288.840396:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789477288.840408:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d0d59d6a800/0xafddb3c8f9281722 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xafddb3c8f928171b expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477288.840429:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d0d59d6a800/0xafddb3c8f9281722 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xafddb3c8f928171b expref: 19 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477288.840439:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d0d59d6a800/0xafddb3c8f9281722 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xafddb3c8f928171b expref: 19 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477288.840449:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d0d59d6a800, rc 0) 00000100:00100000:2.0:1789477288.840484:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d4e675850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07d5e05c-913f-419f-adbc-d3cf15e9cd51+19:5841:x1876402802559104:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 100us (381us total) trans 0 rc 0/0 00000100:00100000:2.0:1789477288.840490:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 181 00000100:00100000:3.0:1789477288.841705:0:5841:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d74cd9f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07d5e05c-913f-419f-adbc-d3cf15e9cd51:5841:1876402802559104:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789477288.841727:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.123@tcp lock: ffff9d0d49eca800/0xafddb3c8f928171b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xafddb3c8f9281722 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477288.841738:0:5841:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.123@tcp lock: ffff9d0d49eca800/0xafddb3c8f928171b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xafddb3c8f9281722 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789477288.841800:0:5841:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d74cd9f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07d5e05c-913f-419f-adbc-d3cf15e9cd51:5841:1876402802559232:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789477288.841843:0:5841:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789477288.841879:0:5841:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d0d47344000 going to sleep for 11 seconds 00000100:00100000:2.0:1789477288.842476:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802559232 00000100:00100000:2.0:1789477288.842484:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802559232 00000100:00100000:2.0:1789477288.842532:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 182 00000100:00100000:2.0:1789477288.842542:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d4e675050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:07d5e05c-913f-419f-adbc-d3cf15e9cd51+19:5841:x1876402802559232:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789477288.842910:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d4e675050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:07d5e05c-913f-419f-adbc-d3cf15e9cd51+19:5841:x1876402802559232:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 369us (1065us total) trans 0 rc 0/0 00000100:00100000:2.0:1789477288.842918:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 182 00000100:00100000:3.0:1789477288.843016:0:5841:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d74cd9f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07d5e05c-913f-419f-adbc-d3cf15e9cd51:5841:1876402802559232:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789477288.843054:0:5841:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d74cd9f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07d5e05c-913f-419f-adbc-d3cf15e9cd51:5841:1876402802559360:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789477288.843094:0:5841:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789477288.843123:0:5841:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d0d47344000 going to sleep for 11 seconds 00000100:00100000:2.0:1789477288.843573:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802559360 00000100:00100000:2.0:1789477288.843663:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802559360 00000100:00100000:2.0:1789477288.843698:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 183 00000100:00100000:2.0:1789477288.843706:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d4e674850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07d5e05c-913f-419f-adbc-d3cf15e9cd51+19:5841:x1876402802559360:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789477288.843877:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d4e674850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07d5e05c-913f-419f-adbc-d3cf15e9cd51+19:5841:x1876402802559360:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 171us (782us total) trans 0 rc 0/0 00000100:00100000:2.0:1789477288.843884:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 183 00000100:00100000:3.0:1789477288.845747:0:5841:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d74cd9f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07d5e05c-913f-419f-adbc-d3cf15e9cd51:5841:1876402802559360:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789477288.846126:0:8585:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d74cd9f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:07d5e05c-913f-419f-adbc-d3cf15e9cd51:8585:1876402802559488:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789477288.846195:0:8585:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789477288.846307:0:8585:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d0d47344840 going to sleep for 11 seconds 00000100:00100000:2.0:1789477288.846350:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802559488 00000100:00100000:2.0:1789477288.846356:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802559488 00000100:00100000:2.0:1789477288.846410:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 184 00000100:00100000:2.0:1789477288.846419:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d4e676850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07d5e05c-913f-419f-adbc-d3cf15e9cd51+19:8585:x1876402802559488:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789477288.847749:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d4e676850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07d5e05c-913f-419f-adbc-d3cf15e9cd51+19:8585:x1876402802559488:12345-0@lo:502:llog_process_th.0 Request processed in 1326us (1548us total) trans 0 rc 0/0 00000100:00100000:2.0:1789477288.847760:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 184 00000100:00100000:1.0:1789477288.848729:0:8585:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d74cd9f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:07d5e05c-913f-419f-adbc-d3cf15e9cd51:8585:1876402802559488:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1789477288.848764:0:8585:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789477288.848772:0:8585:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789477288.848775:0:8585:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1789477288.848780:0:8585:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9d0d4444e800 00000020:00000080:1.0:1789477288.848783:0:8585:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1789477288.848867:0:8585:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d74a88700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:07d5e05c-913f-419f-adbc-d3cf15e9cd51:8585:1876402802559616:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789477288.848918:0:8585:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789477288.848958:0:8585:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d0d7fad2d80 going to sleep for 11 seconds 00000100:00100000:3.0:1789477288.849023:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802559616 00000100:00100000:3.0:1789477288.849030:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802559616 00000100:00100000:3.0:1789477288.849076:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 185 00000100:00100000:3.0:1789477288.849085:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d4e674c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:07d5e05c-913f-419f-adbc-d3cf15e9cd51+19:8585:x1876402802559616:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789477288.849722:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d4e674c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:07d5e05c-913f-419f-adbc-d3cf15e9cd51+19:8585:x1876402802559616:12345-0@lo:502:llog_process_th.0 Request processed in 637us (803us total) trans 0 rc 0/0 00000100:00100000:3.0:1789477288.849730:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 185 00000100:00100000:1.0:1789477288.850354:0:8585:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d74a88700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:07d5e05c-913f-419f-adbc-d3cf15e9cd51:8585:1876402802559616:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1789477288.850394:0:8585:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789477288.850400:0:8585:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789477288.850402:0:8585:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:1.0:1789477288.850406:0:8585:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:2.0:1789477288.850948:0:5841:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:2.0:1789477288.850967:0:5841:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.123@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1789477288.850978:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.123@tcp lock: ffff9d0d49eca800/0xafddb3c8f928171b lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xafddb3c8f9281722 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477288.850989:0:5841:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.123@tcp lock: ffff9d0d49eca800/0xafddb3c8f928171b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xafddb3c8f9281722 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789477289.125286:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:3.0:1789477289.126440:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783655552 00000100:00100000:3.0:1789477289.126452:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783655552 00000100:00100000:3.0:1789477289.127294:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 186 00000100:00100000:3.0:1789477289.127317:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d4e674450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5c82dded-6a10-4ce8-abd1-52bd956b9523+9:5607:x1876402783655552:12345-192.168.201.23@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789477289.127335:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789477289.127352:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d0d49eca600/0xafddb3c8f9281729 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xa90d500d7b8f29ee expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477289.127392:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d0d49eca600/0xafddb3c8f9281729 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f29ee expref: 10 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477289.127404:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d0d49eca600/0xafddb3c8f9281729 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f29ee expref: 10 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477289.127413:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d0d49eca600, rc 0) 00000100:00100000:3.0:1789477289.127473:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d4e674450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5c82dded-6a10-4ce8-abd1-52bd956b9523+10:5607:x1876402783655552:12345-192.168.201.23@tcp:101:ll_cfg_requeue.0 Request processed in 159us (2198us total) trans 0 rc 0/0 00000100:00100000:3.0:1789477289.127480:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 186 00000100:00100000:0.0:1789477289.139772:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:3.0:1789477289.139849:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783655680 00000100:00100000:3.0:1789477289.139861:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783655680 00000100:00100000:3.0:1789477289.139917:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 187 00000100:00100000:3.0:1789477289.139927:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d48461050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5c82dded-6a10-4ce8-abd1-52bd956b9523+10:5607:x1876402783655680:12345-192.168.201.23@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789477289.140245:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d48461050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5c82dded-6a10-4ce8-abd1-52bd956b9523+10:5607:x1876402783655680:12345-192.168.201.23@tcp:501:ll_cfg_requeue.0 Request processed in 318us (484us total) trans 0 rc 0/0 00000100:00100000:3.0:1789477289.140254:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 187 00000100:00100000:3.0:1789477289.142217:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:2.0:1789477289.142283:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783655808 00000100:00100000:2.0:1789477289.142293:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783655808 00000100:00100000:2.0:1789477289.142346:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 188 00000100:00100000:2.0:1789477289.142357:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d48460850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5c82dded-6a10-4ce8-abd1-52bd956b9523+10:5607:x1876402783655808:12345-192.168.201.23@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789477289.142614:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d48460850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5c82dded-6a10-4ce8-abd1-52bd956b9523+10:5607:x1876402783655808:12345-192.168.201.23@tcp:503:ll_cfg_requeue.0 Request processed in 258us (416us total) trans 0 rc 0/0 00000100:00100000:2.0:1789477289.142623:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 188 00000100:00100000:3.0:1789477289.147508:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:1.0:1789477289.148443:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783655936 00000100:00100000:1.0:1789477289.148460:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783655936 00000100:00100000:1.0:1789477289.148538:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 189 00000100:00100000:1.0:1789477289.148551:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d48462850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5c82dded-6a10-4ce8-abd1-52bd956b9523+10:6135:x1876402783655936:12345-192.168.201.23@tcp:502:llog_process_th.0 00000100:00100000:1.0:1789477289.148808:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d48462850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5c82dded-6a10-4ce8-abd1-52bd956b9523+10:6135:x1876402783655936:12345-192.168.201.23@tcp:502:llog_process_th.0 Request processed in 259us (1316us total) trans 0 rc 0/0 00000100:00100000:1.0:1789477289.148816:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 189 00000100:00100000:1.0:1789477289.158631:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:3.0:1789477289.158768:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783656064 00000100:00100000:3.0:1789477289.158779:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783656064 00000100:00100000:3.0:1789477289.158829:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 190 00000100:00100000:3.0:1789477289.158839:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d48460c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5c82dded-6a10-4ce8-abd1-52bd956b9523+10:6135:x1876402783656064:12345-192.168.201.23@tcp:502:llog_process_th.0 00000100:00100000:3.0:1789477289.159103:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d48460c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5c82dded-6a10-4ce8-abd1-52bd956b9523+10:6135:x1876402783656064:12345-192.168.201.23@tcp:502:llog_process_th.0 Request processed in 265us (481us total) trans 0 rc 0/0 00000100:00100000:3.0:1789477289.159111:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 190 00000100:00100000:3.0:1789477289.392411:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789477289.392435:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d4e643800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1876402802559744:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789477289.392524:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789477289.392690:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802559744 00000100:00100000:0.0:1789477289.392700:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802559744 00000100:00100000:0.0:1789477289.392771:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1789477289.392782:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d74cdbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1876402802559744:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789477289.392820:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789477289.392867:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d74cdbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1876402802559744:12345-0@lo:13:osp-pre-0-0.0 Request processed in 88us (343us total) trans 0 rc 0/0 00000100:00100000:0.0:1789477289.392875:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00080000:3.0:1789477289.393060:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1789477289.393097:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d0d4e643800 x1876402802559744/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789477305 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789477289.393116:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d4e643800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1876402802559744:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1789477289.647796:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789477290.672696:0:6710:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789477291.695758:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789477291.951782:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d74cd9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1876402802559872:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789477291.951860:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789477291.952130:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802559872 00000100:00100000:0.0:1789477291.952139:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802559872 00000100:00100000:0.0:1789477291.952196:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1789477291.952207:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d74cd8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1876402802559872:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789477291.952249:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789477291.952304:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d74cd8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1876402802559872:12345-0@lo:13:osp-pre-1-0.0 Request processed in 99us (443us total) trans 0 rc 0/0 00000100:00100000:0.0:1789477291.952324:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1789477291.952359:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d4e643800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3311:1876402802560128:0@lo:400:kworker.0 00000100:00100000:0.0:1789477291.952390:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789477291.952415:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1789477291.952422:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d4e643b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:07d5e05c-913f-419f-adbc-d3cf15e9cd51:3311:1876402802560000:0@lo:400:kworker.0 00000100:00100000:0.0:1789477291.952453:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789477291.952475:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d4e641880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3311:1876402802560512:0@lo:400:kworker.0 00000100:00100000:0.0:1789477291.952498:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1789477291.952525:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789477291.952542:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802560128 00000100:00100000:0.0:1789477291.952546:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802560128 00000100:00100000:0.0:1789477291.952574:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802560512 00000100:00100000:0.0:1789477291.952603:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802560512 00000100:00100000:0.0:1789477291.952643:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1789477291.952650:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d4e642680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1876402802560128:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789477291.952704:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d4e642680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1876402802560128:12345-0@lo:400:kworker.0 Request processed in 54us (313us total) trans 0 rc 0/0 00000100:00100000:0.0:1789477291.952711:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1789477291.952725:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1789477291.952731:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d4e640e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1876402802560512:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789477291.952760:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d4e640e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1876402802560512:12345-0@lo:400:kworker.0 Request processed in 29us (261us total) trans 0 rc 0/0 00000100:00100000:0.0:1789477291.952765:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1789477291.952796:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d4e641500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1876402802560256:0@lo:400:kworker.0 00000100:00100000:0.0:1789477291.952825:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789477291.952848:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789477291.952854:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d4e640a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3312:1876402802560384:0@lo:400:kworker.0 00000100:00100000:0.0:1789477291.952875:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789477291.952899:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802560256 00000100:00100000:0.0:1789477291.952903:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802560256 00000100:00100000:0.0:1789477291.952936:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1789477291.952943:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d4e643480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3312:x1876402802560256:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789477291.952977:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d4e643480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3312:x1876402802560256:12345-0@lo:400:kworker.0 Request processed in 35us (151us total) trans 0 rc 0/0 00000100:00100000:0.0:1789477291.952984:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00080000:0.0:1789477291.953002:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789477291.953005:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1789477291.953031:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d0d4e641500 x1876402802560256/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789477307 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789477291.953060:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d4e641500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1876402802560256:0@lo:400:kworker.0 00000100:00100000:0.0:1789477291.953092:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d4e641880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3311:1876402802560512:0@lo:400:kworker.0 00000100:00100000:0.0:1789477291.953101:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d4e643800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3311:1876402802560128:0@lo:400:kworker.0 00010000:00080000:0.0:1789477291.953125:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d0d74cd9f80 x1876402802559872/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789477307 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789477291.953140:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d74cd9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1876402802559872:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789477291.953158:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802560384 00000100:00100000:0.0:1789477291.953162:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802560384 00000100:00100000:0.0:1789477291.953188:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1789477291.953194:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d4e642a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1876402802560384:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789477291.953227:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d4e642a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1876402802560384:12345-0@lo:400:kworker.0 Request processed in 33us (351us total) trans 0 rc 0/0 00000100:00100000:0.0:1789477291.953233:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00080000:0.0:1789477291.953248:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789477291.953264:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d4e640a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3312:1876402802560384:0@lo:400:kworker.0 00000100:00100000:3.0:1789477291.954166:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802560000 00000100:00100000:3.0:1789477291.954176:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802560000 00000100:00100000:3.0:1789477291.954209:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 191 00000100:00100000:3.0:1789477291.954217:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d48460450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07d5e05c-913f-419f-adbc-d3cf15e9cd51+19:3311:x1876402802560000:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789477291.954270:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d48460450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07d5e05c-913f-419f-adbc-d3cf15e9cd51+19:3311:x1876402802560000:12345-0@lo:400:kworker.0 Request processed in 54us (1816us total) trans 0 rc 0/0 00000100:00100000:3.0:1789477291.954277:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 191 00000100:00100000:2.0:1789477291.959001:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d4e643b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:07d5e05c-913f-419f-adbc-d3cf15e9cd51:3311:1876402802560000:0@lo:400:kworker.0 00010000:00010000:1.0:1789477292.719732:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789477293.028514:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:3.0:1789477293.028555:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:1.0:1789477293.028598:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783656192 00000100:00100000:3.0:1789477293.028604:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:1.0:1789477293.028607:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783656192 00000100:00100000:3.0:1789477293.028636:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:3.0:1789477293.028654:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783656320 00000100:00100000:1.0:1789477293.028655:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 192 00000100:00100000:3.0:1789477293.028657:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783656320 00000100:00100000:1.0:1789477293.028666:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d4ec6c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5c82dded-6a10-4ce8-abd1-52bd956b9523+10:2352:x1876402783656192:12345-192.168.201.23@tcp:400:kworker.0 00000100:00100000:3.0:1789477293.028698:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 31 00000100:00100000:3.0:1789477293.028704:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d74cd8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9bc33f26-0aab-4a14-832f-c58d566de1b0+6:2352:x1876402783656320:12345-192.168.201.23@tcp:400:kworker.0 00000100:00100000:3.0:1789477293.028731:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d74cd8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9bc33f26-0aab-4a14-832f-c58d566de1b0+6:2352:x1876402783656320:12345-192.168.201.23@tcp:400:kworker.0 Request processed in 26us (125us total) trans 0 rc 0/0 00000100:00100000:1.0:1789477293.028731:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d4ec6c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5c82dded-6a10-4ce8-abd1-52bd956b9523+10:2352:x1876402783656192:12345-192.168.201.23@tcp:400:kworker.0 Request processed in 67us (227us total) trans 0 rc 0/0 00000100:00100000:3.0:1789477293.028739:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 31 00000100:00100000:1.0:1789477293.028739:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 192 00000100:00100000:3.0:1789477293.028760:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783656448 00000100:00100000:3.0:1789477293.028763:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783656448 00000100:00100000:3.0:1789477293.028787:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783656576 00000100:00100000:3.0:1789477293.028789:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783656576 00000100:00100000:3.0:1789477293.028809:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 14 00000100:00100000:3.0:1789477293.028815:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d74cdaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9bc33f26-0aab-4a14-832f-c58d566de1b0+5:2352:x1876402783656448:12345-192.168.201.23@tcp:400:kworker.0 00000100:00100000:3.0:1789477293.028844:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d74cdaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9bc33f26-0aab-4a14-832f-c58d566de1b0+5:2352:x1876402783656448:12345-192.168.201.23@tcp:400:kworker.0 Request processed in 27us (287us total) trans 0 rc 0/0 00000100:00100000:3.0:1789477293.028851:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 14 00000100:00100000:3.0:1789477293.028874:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 15 00000100:00100000:3.0:1789477293.028881:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d74cd9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9bc33f26-0aab-4a14-832f-c58d566de1b0+5:2352:x1876402783656576:12345-192.168.201.23@tcp:400:kworker.0 00000100:00100000:3.0:1789477293.028919:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d74cd9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9bc33f26-0aab-4a14-832f-c58d566de1b0+5:2352:x1876402783656576:12345-192.168.201.23@tcp:400:kworker.0 Request processed in 38us (282us total) trans 0 rc 0/0 00000100:00100000:3.0:1789477293.028925:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 15 00000100:00080000:3.0:1789477293.028945:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789477293.028949:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789477293.028952:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1789477293.743719:0:6710:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1789477294.260280:0:8839:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg123-server.virtnet: executing check_logdir /tmp/testlogs/ 00000100:00100000:3.0:1789477294.514905:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d74cdb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1876402802560640:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789477294.514970:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789477294.515042:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802560640 00000100:00100000:3.0:1789477294.515049:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802560640 00000100:00100000:3.0:1789477294.515102:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1789477294.515111:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d74cd8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1876402802560640:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789477294.515147:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789477294.515189:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d74cd8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1876402802560640:12345-0@lo:13:osp-pre-0-0.0 Request processed in 78us (218us total) trans 0 rc 0/0 00000100:00100000:3.0:1789477294.515196:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00080000:3.0:1789477294.515216:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1789477294.515246:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d0d74cdb100 x1876402802560640/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789477310 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789477294.515275:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d74cdb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1876402802560640:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1789477294.769948:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789477295.795892:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789477296.816176:0:6710:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789477297.071926:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d4e643800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3313:1876402802560896:0@lo:400:kworker.0 00000100:00100000:0.0:1789477297.072055:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789477297.072111:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d4e640700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1876402802561408:0@lo:400:kworker.0 00000100:00100000:0.0:1789477297.072138:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789477297.072169:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1789477297.072175:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d4e640a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:07d5e05c-913f-419f-adbc-d3cf15e9cd51:3313:1876402802560768:0@lo:400:kworker.0 00000100:00100000:0.0:1789477297.072252:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789477297.072272:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d4e640380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3313:1876402802561280:0@lo:400:kworker.0 00000100:00100000:0.0:1789477297.072293:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789477297.072496:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802560768 00000100:00100000:2.0:1789477297.072504:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802560768 00000100:00100000:2.0:1789477297.072551:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 193 00000100:00100000:2.0:1789477297.072561:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d4ec6f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07d5e05c-913f-419f-adbc-d3cf15e9cd51+19:3313:x1876402802560768:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789477297.072640:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d4ec6f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07d5e05c-913f-419f-adbc-d3cf15e9cd51+19:3313:x1876402802560768:12345-0@lo:400:kworker.0 Request processed in 80us (387us total) trans 0 rc 0/0 00000100:00100000:2.0:1789477297.072647:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 193 00000100:00100000:2.0:1789477297.072705:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d4e640a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:07d5e05c-913f-419f-adbc-d3cf15e9cd51:3313:1876402802560768:0@lo:400:kworker.0 00000100:00100000:2.0:1789477297.072745:0:6999:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802560896 00000100:00100000:2.0:1789477297.072749:0:6999:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802560896 00000100:00100000:2.0:1789477297.072774:0:6999:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802561280 00000100:00100000:2.0:1789477297.072777:0:6999:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802561280 00000100:00100000:2.0:1789477297.072805:0:6999:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1789477297.072812:0:6999:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d4e643100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1876402802560896:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789477297.072847:0:6999:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d4e643100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1876402802560896:12345-0@lo:400:kworker.0 Request processed in 35us (792us total) trans 0 rc 0/0 00000100:00100000:2.0:1789477297.072853:0:6999:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1789477297.072864:0:6999:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1789477297.072870:0:6999:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d4e642300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1876402802561280:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789477297.072894:0:6999:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d4e642300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1876402802561280:12345-0@lo:400:kworker.0 Request processed in 25us (601us total) trans 0 rc 0/0 00000100:00100000:2.0:1789477297.072900:0:6999:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1789477297.072917:0:8241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802561408 00000100:00100000:2.0:1789477297.072928:0:8241:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802561408 00000100:00100000:3.0:1789477297.073060:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d4e641880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1876402802561024:0@lo:400:kworker.0 00000100:00100000:3.0:1789477297.073088:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789477297.073127:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d74cdb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1876402802561536:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789477297.073161:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789477297.073182:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789477297.073188:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d4e641500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3310:1876402802561152:0@lo:400:kworker.0 00000100:00100000:3.0:1789477297.073214:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789477297.073254:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802561024 00000100:00100000:3.0:1789477297.073258:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802561024 00000100:00100000:3.0:1789477297.073283:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1789477297.073289:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d4e641180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3313:x1876402802561408:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789477297.073320:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d4e641180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3313:x1876402802561408:12345-0@lo:400:kworker.0 Request processed in 31us (1181us total) trans 0 rc 0/0 00000100:00100000:3.0:1789477297.073327:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1789477297.073340:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1789477297.073346:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d74cdb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3310:x1876402802561024:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789477297.073377:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d74cdb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3310:x1876402802561024:12345-0@lo:400:kworker.0 Request processed in 32us (288us total) trans 0 rc 0/0 00000100:00100000:3.0:1789477297.073384:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1789477297.073402:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802561536 00000100:00100000:3.0:1789477297.073405:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802561536 00000100:00100000:3.0:1789477297.073426:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1789477297.073432:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d74cd8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1876402802561536:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789477297.073458:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789477297.073488:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d74cd8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1876402802561536:12345-0@lo:13:osp-pre-1-0.0 Request processed in 56us (326us total) trans 0 rc 0/0 00000100:00100000:3.0:1789477297.073494:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00010000:00080000:3.0:1789477297.073531:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d0d4e641880 x1876402802561024/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789477313 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789477297.073556:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d4e641880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1876402802561024:0@lo:400:kworker.0 00010000:00080000:3.0:1789477297.073569:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d0d74cdb100 x1876402802561536/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789477313 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789477297.073602:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d74cdb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1876402802561536:0@lo:13:osp-pre-1-0.0 00000100:00080000:3.0:1789477297.073636:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789477297.073639:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789477297.073642:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789477297.073651:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802561152 00000100:00100000:3.0:1789477297.073655:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802561152 00000100:00100000:3.0:1789477297.073682:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1789477297.073688:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d74cd8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1876402802561152:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789477297.073723:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d74cd8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1876402802561152:12345-0@lo:400:kworker.0 Request processed in 35us (508us total) trans 0 rc 0/0 00000100:00100000:3.0:1789477297.073729:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00080000:3.0:1789477297.073746:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789477297.073909:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d4e641500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3310:1876402802561152:0@lo:400:kworker.0 00000100:00100000:3.0:1789477297.073945:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d4e640380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3313:1876402802561280:0@lo:400:kworker.0 00000100:00100000:3.0:1789477297.074981:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d4e643800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3313:1876402802560896:0@lo:400:kworker.0 00010000:00080000:3.0:1789477297.075009:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d0d4e640700 x1876402802561408/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789477313 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789477297.075020:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d4e640700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1876402802561408:0@lo:400:kworker.0 00010000:00010000:1.0:1789477297.839920:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789477298.143409:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:1.0:1789477298.143470:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:1.0:1789477298.143498:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:1.0:1789477298.143539:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:1.0:1789477298.143568:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783657088 00000100:00100000:1.0:1789477298.143595:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783657088 00000100:00100000:1.0:1789477298.143787:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783656960 00000100:00100000:1.0:1789477298.143792:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783656960 00000100:00100000:1.0:1789477298.143819:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 18 00000100:00100000:1.0:1789477298.143830:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d74a8b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9bc33f26-0aab-4a14-832f-c58d566de1b0+5:2353:x1876402783657088:12345-192.168.201.23@tcp:400:kworker.0 00000100:00100000:1.0:1789477298.143908:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d74a8b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9bc33f26-0aab-4a14-832f-c58d566de1b0+5:2353:x1876402783657088:12345-192.168.201.23@tcp:400:kworker.0 Request processed in 79us (437us total) trans 0 rc 0/0 00000100:00100000:1.0:1789477298.143915:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 18 00000100:00100000:1.0:1789477298.143933:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 19 00000100:00100000:1.0:1789477298.143950:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d74a88380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9bc33f26-0aab-4a14-832f-c58d566de1b0+5:2353:x1876402783656960:12345-192.168.201.23@tcp:400:kworker.0 00000100:00100000:1.0:1789477298.143977:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d74a88380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9bc33f26-0aab-4a14-832f-c58d566de1b0+5:2353:x1876402783656960:12345-192.168.201.23@tcp:400:kworker.0 Request processed in 29us (437us total) trans 0 rc 0/0 00000100:00100000:1.0:1789477298.143983:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 19 00000100:00100000:1.0:1789477298.144004:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783656704 00000100:00100000:1.0:1789477298.144008:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783656704 00000100:00100000:1.0:1789477298.144033:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 194 00000100:00100000:1.0:1789477298.144041:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d4ec6e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5c82dded-6a10-4ce8-abd1-52bd956b9523+10:2353:x1876402783656704:12345-192.168.201.23@tcp:400:kworker.0 00000100:00100000:1.0:1789477298.144066:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d4ec6e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5c82dded-6a10-4ce8-abd1-52bd956b9523+10:2353:x1876402783656704:12345-192.168.201.23@tcp:400:kworker.0 Request processed in 26us (567us total) trans 0 rc 0/0 00000100:00100000:1.0:1789477298.144072:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 194 00000100:00080000:1.0:1789477298.144102:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789477298.144107:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789477298.144523:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783656832 00000100:00100000:2.0:1789477298.144529:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783656832 00000100:00100000:2.0:1789477298.144598:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 35 00000100:00100000:2.0:1789477298.144606:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d74a88700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9bc33f26-0aab-4a14-832f-c58d566de1b0+6:2353:x1876402783656832:12345-192.168.201.23@tcp:400:kworker.0 00000100:00100000:2.0:1789477298.144780:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d74a88700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9bc33f26-0aab-4a14-832f-c58d566de1b0+6:2353:x1876402783656832:12345-192.168.201.23@tcp:400:kworker.0 Request processed in 174us (1381us total) trans 0 rc 0/0 00000100:00100000:2.0:1789477298.144787:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 35 00000100:00080000:1.0:1789477298.144873:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1789477298.863946:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1789477299.221751:0:9084:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg123-server.virtnet: executing yml_node 00000100:00100000:1.0:1789477299.634965:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789477299.638860:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d74cdb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1876402802561664:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789477299.638941:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789477299.639052:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802561664 00000100:00100000:2.0:1789477299.639061:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802561664 00000100:00100000:2.0:1789477299.639127:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1789477299.639137:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d74a89880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1876402802561664:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789477299.639185:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789477299.639235:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d74a89880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1876402802561664:12345-0@lo:13:osp-pre-0-0.0 Request processed in 99us (294us total) trans 0 rc 0/0 00000100:00100000:2.0:1789477299.639242:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00080000:1.0:1789477299.639298:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1789477299.639329:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d0d74cdb100 x1876402802561664/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789477315 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789477299.639350:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d74cdb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1876402802561664:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1789477299.887758:0:6710:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789477300.911884:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789477301.935814:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789477302.191839:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d4e641500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3311:1876402802562176:0@lo:400:kworker.0 00000100:00100000:2.0:1789477302.191858:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d4e640700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:07d5e05c-913f-419f-adbc-d3cf15e9cd51:3312:1876402802561792:0@lo:400:kworker.0 00000100:00100000:1.0:1789477302.191940:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d4e640380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1876402802562048:0@lo:400:kworker.0 00000100:00100000:3.0:1789477302.191959:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d4e643800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3313:1876402802561920:0@lo:400:kworker.0 00000100:00100000:2.0:1789477302.206193:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789477302.206272:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d4e641880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3312:1876402802562304:0@lo:400:kworker.0 00000100:00100000:2.0:1789477302.206315:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789477302.206395:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802561792 00000100:00100000:2.0:1789477302.206404:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802561792 00000100:00100000:2.0:1789477302.206458:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 195 00000100:00100000:2.0:1789477302.206468:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d4ec6c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:07d5e05c-913f-419f-adbc-d3cf15e9cd51+19:3312:x1876402802561792:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789477302.206522:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d4ec6c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:07d5e05c-913f-419f-adbc-d3cf15e9cd51+19:3312:x1876402802561792:12345-0@lo:400:kworker.0 Request processed in 56us (339us total) trans 0 rc 0/0 00000100:00100000:2.0:1789477302.206726:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 195 00000100:00100000:2.0:1789477302.207488:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d4e640700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:07d5e05c-913f-419f-adbc-d3cf15e9cd51:3312:1876402802561792:0@lo:400:kworker.0 00000100:00100000:0.0:1789477302.208101:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789477302.208275:0:6999:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802562304 00000100:00100000:0.0:1789477302.208282:0:6999:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802562304 00000100:00100000:0.0:1789477302.208352:0:6999:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802562176 00000100:00100000:0.0:1789477302.208356:0:6999:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802562176 00000100:00100000:0.0:1789477302.208379:0:6999:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1789477302.208387:0:6999:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d7c3e5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1876402802562304:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789477302.209443:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1789477302.209469:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d4e643b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1876402802562176:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789477302.209525:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d4e643b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1876402802562176:12345-0@lo:400:kworker.0 Request processed in 62us (1425us total) trans 0 rc 0/0 00000100:00100000:3.0:1789477302.209532:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1789477302.209568:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789477302.209615:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802561920 00000100:00100000:3.0:1789477302.209621:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802561920 00000100:00100000:3.0:1789477302.209645:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1789477302.209651:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d74cdb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1876402802561920:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789477302.209682:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d74cdb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1876402802561920:12345-0@lo:400:kworker.0 Request processed in 31us (113us total) trans 0 rc 0/0 00000100:00100000:3.0:1789477302.209688:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1789477302.209817:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d4e643800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3313:1876402802561920:0@lo:400:kworker.0 00000100:00100000:3.0:1789477302.209829:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d4e640a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1876402802562432:0@lo:400:kworker.0 00000100:00100000:3.0:1789477302.209862:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789477302.209888:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802562432 00000100:00100000:3.0:1789477302.209892:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802562432 00000100:00100000:3.0:1789477302.209939:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1789477302.209946:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d74cd9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3313:x1876402802562432:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789477302.209978:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d74cd9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3313:x1876402802562432:12345-0@lo:400:kworker.0 Request processed in 32us (114us total) trans 0 rc 0/0 00000100:00100000:3.0:1789477302.209984:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00010000:00080000:3.0:1789477302.210012:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d0d4e640a80 x1876402802562432/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789477318 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789477302.210041:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d4e640a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1876402802562432:0@lo:400:kworker.0 00000100:00100000:1.0:1789477302.225661:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789477302.225713:0:8241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802562048 00000100:00100000:1.0:1789477302.225722:0:8241:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802562048 00000100:00100000:1.0:1789477302.225797:0:8241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1789477302.225807:0:8241:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d74a88a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3310:x1876402802562048:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789477302.226275:0:8241:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d74a88a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3310:x1876402802562048:12345-0@lo:400:kworker.0 Request processed in 467us (619us total) trans 0 rc 0/0 00000100:00100000:1.0:1789477302.226284:0:8241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00080000:1.0:1789477302.226336:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d0d4e640380 x1876402802562048/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789477318 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789477302.226352:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d4e640380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1876402802562048:0@lo:400:kworker.0 00000100:00080000:1.0:1789477302.226408:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789477302.226412:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789477302.226416:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789477302.226550:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d4e641500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3311:1876402802562176:0@lo:400:kworker.0 00000100:00100000:0.0:1789477302.227526:0:6999:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d7c3e5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1876402802562304:12345-0@lo:400:kworker.0 Request processed in 19136us (21206us total) trans 0 rc 0/0 00000100:00100000:0.0:1789477302.227537:0:6999:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1789477302.238185:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d4e641880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3312:1876402802562304:0@lo:400:kworker.0 00000100:00100000:2.0:1789477302.248331:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789477302.248358:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d7c3e6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1876402802562560:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789477302.248428:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789477302.248472:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802562560 00000100:00100000:2.0:1789477302.248480:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802562560 00000100:00100000:2.0:1789477302.248539:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1789477302.248549:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d7c3e4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1876402802562560:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789477302.248621:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789477302.248678:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d7c3e4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1876402802562560:12345-0@lo:13:osp-pre-1-0.0 Request processed in 129us (250us total) trans 0 rc 0/0 00000100:00100000:2.0:1789477302.248685:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00010000:00080000:3.0:1789477302.248703:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d0d7c3e6a00 x1876402802562560/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789477318 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789477302.248722:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d7c3e6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1876402802562560:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1789477302.959864:0:6710:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789477303.269152:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:2.0:1789477303.269220:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:3.0:1789477303.269406:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783657344 00000100:00100000:3.0:1789477303.269419:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783657344 00000100:00100000:3.0:1789477303.269502:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 39 00000100:00100000:3.0:1789477303.269514:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d7c3e7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9bc33f26-0aab-4a14-832f-c58d566de1b0+6:2352:x1876402783657344:12345-192.168.201.23@tcp:400:kworker.0 00000100:00100000:3.0:1789477303.269671:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d7c3e7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9bc33f26-0aab-4a14-832f-c58d566de1b0+6:2352:x1876402783657344:12345-192.168.201.23@tcp:400:kworker.0 Request processed in 159us (449us total) trans 0 rc 0/0 00000100:00100000:3.0:1789477303.269678:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 39 00000100:00080000:1.0:1789477303.269801:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789477303.269987:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783657216 00000100:00100000:0.0:1789477303.269992:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783657216 00000100:00100000:0.0:1789477303.270034:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 196 00000100:00100000:0.0:1789477303.270042:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d4ec6f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5c82dded-6a10-4ce8-abd1-52bd956b9523+10:2352:x1876402783657216:12345-192.168.201.23@tcp:400:kworker.0 00000100:00100000:0.0:1789477303.270082:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d4ec6f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5c82dded-6a10-4ce8-abd1-52bd956b9523+10:2352:x1876402783657216:12345-192.168.201.23@tcp:400:kworker.0 Request processed in 41us (945us total) trans 0 rc 0/0 00000100:00100000:0.0:1789477303.270089:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 196 00000100:00100000:2.0:1789477303.287684:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:2.0:1789477303.287729:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:0.0:1789477303.287874:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783657472 00000100:00100000:0.0:1789477303.287888:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783657472 00000100:00100000:0.0:1789477303.287974:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783657600 00000100:00100000:0.0:1789477303.287979:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783657600 00000100:00100000:0.0:1789477303.288022:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 11 00000100:00100000:0.0:1789477303.288034:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d7c3e6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9bc33f26-0aab-4a14-832f-c58d566de1b0+5:2351:x1876402783657472:12345-192.168.201.23@tcp:9:kworker.0 00000020:00000080:0.0:1789477303.288083:0:6697:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xafddb3c8f9281665 00000100:00080000:0.0:1789477303.288096:0:6697:0:(import.c:65:import_set_state_nolock()) ffff9d0d7f529800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1789477303.288162:0:6697:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:0.0:1789477303.288675:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d7c3e6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9bc33f26-0aab-4a14-832f-c58d566de1b0+2:2351:x1876402783657472:12345-192.168.201.23@tcp:9:kworker.0 Request processed in 642us (999us total) trans 0 rc 0/0 00000100:00100000:0.0:1789477303.288684:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 11 00000100:00100000:0.0:1789477303.288704:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 12 00000100:00100000:0.0:1789477303.288712:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d7c3e4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9bc33f26-0aab-4a14-832f-c58d566de1b0+5:2351:x1876402783657600:12345-192.168.201.23@tcp:9:kworker.0 00000020:00000080:0.0:1789477303.288730:0:6697:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xafddb3c8f928166c 00000100:00080000:0.0:1789477303.288736:0:6697:0:(import.c:65:import_set_state_nolock()) ffff9d0d481a7800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1789477303.288760:0:6697:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:0.0:1789477303.288964:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d7c3e4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9bc33f26-0aab-4a14-832f-c58d566de1b0+2:2351:x1876402783657600:12345-192.168.201.23@tcp:9:kworker.0 Request processed in 252us (1233us total) trans 0 rc 0/0 00000100:00100000:0.0:1789477303.288971:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 12 00010000:00010000:0.0:1789477303.289064:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789477303.289228:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1789477303.289521:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789477303.289526:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:02000400:0.0:1789477303.860637:0:9275:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Client: 2.17.57.84 00010000:00010000:2.0:1789477303.984852:0:6710:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789477304.755672:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789477304.755706:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d74a89c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1876402802562688:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789477304.755804:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789477304.759537:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802562688 00000100:00100000:3.0:1789477304.759558:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802562688 00000100:00100000:3.0:1789477304.759932:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1789477304.759946:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d74a8b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1876402802562688:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789477304.760000:0:6698:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789477304.760123:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d74a8b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1876402802562688:12345-0@lo:13:osp-pre-0-0.0 Request processed in 179us (4318us total) trans 0 rc 0/0 00000100:00100000:3.0:1789477304.760131:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00010000:00080000:3.0:1789477304.760196:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d0d74a89c00 x1876402802562688/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789477320 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789477304.760223:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d74a89c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1876402802562688:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1789477304.760428:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1789477305.008853:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789477306.036422:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1789477306.928037:0:9373:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: MDS: 2.17.57.84 00010000:00010000:2.0:1789477307.056225:0:6710:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789477307.311909:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789477307.311945:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d7f738e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1876402802562816:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789477307.312019:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789477307.312073:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d7c3e7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3310:1876402802563072:0@lo:400:kworker.0 00000100:00100000:3.0:1789477307.312093:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d7c3e6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:07d5e05c-913f-419f-adbc-d3cf15e9cd51:3313:1876402802562944:0@lo:400:kworker.0 00000100:00100000:2.0:1789477307.312114:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789477307.312134:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789477307.312145:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d7c3e4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1876402802563584:0@lo:400:kworker.0 00000100:00100000:3.0:1789477307.312166:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d7c3e7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3313:1876402802563456:0@lo:400:kworker.0 00000100:00100000:2.0:1789477307.312183:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789477307.312205:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789477307.312211:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d7c3e5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1876402802563200:0@lo:400:kworker.0 00000100:00100000:2.0:1789477307.312233:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789477307.312268:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802563072 00000100:00100000:2.0:1789477307.312275:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802563072 00000100:00100000:2.0:1789477307.312319:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1789477307.312328:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d6d3d4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1876402802563072:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789477307.312391:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d6d3d4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1876402802563072:12345-0@lo:400:kworker.0 Request processed in 64us (277us total) trans 0 rc 0/0 00000100:00100000:2.0:1789477307.312398:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1789477307.312434:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d7c3e7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3310:1876402802563072:0@lo:400:kworker.0 00000100:00100000:3.0:1789477307.312524:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789477307.312555:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789477307.312561:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d7c3e4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3313:1876402802563328:0@lo:400:kworker.0 00000100:00100000:3.0:1789477307.312606:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789477307.312631:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802562816 00000100:00100000:3.0:1789477307.312635:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802562816 00000100:00100000:3.0:1789477307.312671:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1789477307.312678:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d58247100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1876402802562816:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789477307.312708:0:6698:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789477307.312715:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802563584 00000100:00100000:0.0:1789477307.312721:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802563584 00000100:00100000:3.0:1789477307.312743:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d58247100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3313:x1876402802562816:12345-0@lo:13:osp-pre-1-0.0 Request processed in 65us (726us total) trans 0 rc 0/0 00000100:00100000:3.0:1789477307.312751:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1789477307.312762:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802563200 00000100:00100000:0.0:1789477307.312766:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802563200 00000100:00100000:3.0:1789477307.312777:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802562944 00000100:00100000:3.0:1789477307.312783:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802562944 00000100:00100000:0.0:1789477307.312795:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1789477307.312805:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d6d3d5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3310:x1876402802563584:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789477307.312816:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 197 00000100:00100000:3.0:1789477307.312826:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d4ec6ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07d5e05c-913f-419f-adbc-d3cf15e9cd51+19:3313:x1876402802562944:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789477307.312857:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d6d3d5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3310:x1876402802563584:12345-0@lo:400:kworker.0 Request processed in 54us (674us total) trans 0 rc 0/0 00000100:00100000:0.0:1789477307.312865:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1789477307.312880:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d4ec6ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07d5e05c-913f-419f-adbc-d3cf15e9cd51+19:3313:x1876402802562944:12345-0@lo:400:kworker.0 Request processed in 55us (747us total) trans 0 rc 0/0 00000100:00100000:0.0:1789477307.312885:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1789477307.312894:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 197 00000100:00100000:0.0:1789477307.312898:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d6d3d7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3310:x1876402802563200:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789477307.312934:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d6d3d7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3310:x1876402802563200:12345-0@lo:400:kworker.0 Request processed in 39us (699us total) trans 0 rc 0/0 00000100:00100000:0.0:1789477307.312940:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1789477307.312946:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d7c3e6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:07d5e05c-913f-419f-adbc-d3cf15e9cd51:3313:1876402802562944:0@lo:400:kworker.0 00010000:00080000:3.0:1789477307.312963:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d0d7f738e00 x1876402802562816/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789477323 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789477307.312963:0:6999:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802563456 00000100:00100000:0.0:1789477307.312968:0:6999:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802563456 00000100:00100000:3.0:1789477307.312986:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d7f738e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1876402802562816:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789477307.313007:0:6999:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802563328 00000100:00100000:0.0:1789477307.313012:0:6999:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802563328 00000100:00100000:0.0:1789477307.313026:0:6999:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1789477307.313042:0:6999:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d58245c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1876402802563456:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789477307.313077:0:6999:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d58245c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1876402802563456:12345-0@lo:400:kworker.0 Request processed in 45us (553us total) trans 0 rc 0/0 00000100:00100000:0.0:1789477307.313083:0:6999:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1789477307.313094:0:6999:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1789477307.313100:0:6999:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d58246d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1876402802563328:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789477307.313124:0:6999:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d58246d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1876402802563328:12345-0@lo:400:kworker.0 Request processed in 24us (517us total) trans 0 rc 0/0 00000100:00100000:0.0:1789477307.313129:0:6999:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00080000:2.0:1789477307.315560:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789477307.315569:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789477307.315573:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1789477307.317269:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d0d7c3e5f80 x1876402802563200/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789477323 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789477307.317287:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d7c3e5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1876402802563200:0@lo:400:kworker.0 00010000:00080000:0.0:1789477307.317302:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d0d7c3e4700 x1876402802563584/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789477323 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789477307.317320:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d7c3e4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1876402802563584:0@lo:400:kworker.0 00000100:00100000:0.0:1789477307.320142:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d7c3e4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3313:1876402802563328:0@lo:400:kworker.0 00000100:00100000:0.0:1789477307.320165:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d7c3e7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3313:1876402802563456:0@lo:400:kworker.0 00000001:00100000:3.0:1789477307.353021:0:7678:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 9bc33f26-0aab-4a14-832f-c58d566de1b0 00000020:00000080:3.0:1789477307.353046:0:7678:0:(genops.c:885:class_export_put()) final put ffff9d0d481a0000/9bc33f26-0aab-4a14-832f-c58d566de1b0 00000020:00000080:2.0:1789477307.353107:0:1381:0:(genops.c:844:class_export_destroy()) destroying export ffff9d0d481a0000/9bc33f26-0aab-4a14-832f-c58d566de1b0 for lustre-OST0001 00000020:00000080:2.0:1789477307.353222:0:1381:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9d0d481a7800 for lustre-OST0001 00000001:00100000:2.0:1789477307.894891:0:6730:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 9bc33f26-0aab-4a14-832f-c58d566de1b0 00000020:00000080:2.0:1789477307.894905:0:6730:0:(genops.c:885:class_export_put()) final put ffff9d0d7f528800/9bc33f26-0aab-4a14-832f-c58d566de1b0 00000020:00000080:1.0:1789477307.894965:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9d0d7f528800/9bc33f26-0aab-4a14-832f-c58d566de1b0 for lustre-OST0000 00000020:00000080:1.0:1789477307.895037:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9d0d7f529800 for lustre-OST0000 00010000:00010000:1.0:1789477308.082895:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789477308.385831:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:0.0:1789477308.385898:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:2.0:1789477308.386073:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783657728 00000100:00100000:2.0:1789477308.386087:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783657728 00000100:00100000:2.0:1789477308.386166:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 198 00000100:00100000:2.0:1789477308.386179:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d4ec6d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5c82dded-6a10-4ce8-abd1-52bd956b9523+10:2352:x1876402783657728:12345-192.168.201.23@tcp:400:kworker.0 00000100:00100000:2.0:1789477308.386295:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d4ec6d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5c82dded-6a10-4ce8-abd1-52bd956b9523+10:2352:x1876402783657728:12345-192.168.201.23@tcp:400:kworker.0 Request processed in 118us (501us total) trans 0 rc 0/0 00000100:00100000:2.0:1789477308.386304:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 198 00000100:00100000:1.0:1789477308.393781:0:6999:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783657856 00000100:00100000:1.0:1789477308.395285:0:6999:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783657856 00000100:00100000:1.0:1789477308.395537:0:6999:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 43 00000100:00100000:1.0:1789477308.395552:0:6999:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d4e641880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9bc33f26-0aab-4a14-832f-c58d566de1b0+6:2352:x1876402783657856:12345-192.168.201.23@tcp:400:kworker.0 00000100:00100000:1.0:1789477308.395784:0:6999:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d4e641880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9bc33f26-0aab-4a14-832f-c58d566de1b0+6:2352:x1876402783657856:12345-192.168.201.23@tcp:400:kworker.0 Request processed in 236us (9884us total) trans 0 rc 0/0 00000100:00100000:1.0:1789477308.395804:0:6999:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 43 00000100:00080000:2.0:1789477308.405503:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1789477309.103867:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1789477309.806472:0:9473:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: OSS: 2.17.57.84 00000100:00100000:1.0:1789477309.880059:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789477309.880091:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d74a8a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1876402802563712:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789477309.880184:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789477309.880559:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802563712 00000100:00100000:3.0:1789477309.880572:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802563712 00000100:00100000:3.0:1789477309.880693:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1789477309.880705:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d74a89180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1876402802563712:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789477309.880754:0:6698:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789477309.880815:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d74a89180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1876402802563712:12345-0@lo:13:osp-pre-0-0.0 Request processed in 112us (630us total) trans 0 rc 0/0 00000100:00100000:3.0:1789477309.880822:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00080000:1.0:1789477309.881050:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1789477309.883028:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d0d74a8a680 x1876402802563712/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789477325 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789477309.883068:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d74a8a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1876402802563712:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1789477310.132300:0:6710:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789477311.151776:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1789477311.541100:0:9522:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: -----============= acceptance-small: sanity-pcc ============----- Tue Sep 15 09:01:49 EDT 2026 00010000:00010000:0.0:1789477312.176048:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789477312.433628:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d4e641500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1876402802563840:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789477312.433726:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789477312.433839:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802563840 00000100:00100000:0.0:1789477312.433850:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802563840 00000100:00100000:0.0:1789477312.433923:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1789477312.433934:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d4e640380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1876402802563840:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789477312.433989:0:6698:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00080000:1.0:1789477312.434661:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789477312.437496:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d6d3d6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1876402802564224:0@lo:400:kworker.0 00000100:00100000:2.0:1789477312.437645:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789477312.437708:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789477312.437714:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d6d3d5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3311:1876402802564096:0@lo:400:kworker.0 00000100:00100000:2.0:1789477312.437744:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789477312.437777:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802564096 00000100:00100000:2.0:1789477312.437786:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802564096 00000100:00100000:2.0:1789477312.437845:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1789477312.437855:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d6d3d7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1876402802564096:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789477312.437918:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d6d3d7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1876402802564096:12345-0@lo:400:kworker.0 Request processed in 63us (172us total) trans 0 rc 0/0 00000100:00100000:2.0:1789477312.437926:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1789477312.440355:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d6d3d6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:07d5e05c-913f-419f-adbc-d3cf15e9cd51:3313:1876402802563968:0@lo:400:kworker.0 00000100:00100000:0.0:1789477312.440469:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789477312.440537:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d6d3d7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3313:1876402802564480:0@lo:400:kworker.0 00000100:00100000:0.0:1789477312.440567:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789477312.440627:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789477312.440635:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d6d3d4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3313:1876402802564352:0@lo:400:kworker.0 00000100:00100000:0.0:1789477312.440658:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789477312.440699:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802564224 00000100:00100000:0.0:1789477312.440708:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802564224 00000100:00100000:0.0:1789477312.440774:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1789477312.440802:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d6d3d5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3311:x1876402802564224:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789477312.440855:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d6d3d5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3311:x1876402802564224:12345-0@lo:400:kworker.0 Request processed in 56us (3210us total) trans 0 rc 0/0 00000100:00100000:0.0:1789477312.440863:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1789477312.440892:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802563968 00000100:00100000:0.0:1789477312.440896:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802563968 00000100:00100000:0.0:1789477312.440924:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 199 00000100:00100000:0.0:1789477312.440930:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d4ec6e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07d5e05c-913f-419f-adbc-d3cf15e9cd51+19:3313:x1876402802563968:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789477312.440979:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d4ec6e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07d5e05c-913f-419f-adbc-d3cf15e9cd51+19:3313:x1876402802563968:12345-0@lo:400:kworker.0 Request processed in 49us (511us total) trans 0 rc 0/0 00000100:00100000:0.0:1789477312.440985:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 199 00000100:00100000:0.0:1789477312.441014:0:6999:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802564480 00000100:00100000:0.0:1789477312.441018:0:6999:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802564480 00000100:00100000:0.0:1789477312.441039:0:6999:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802564352 00000100:00100000:0.0:1789477312.441042:0:6999:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802564352 00000100:00100000:0.0:1789477312.441056:0:6999:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1789477312.441078:0:6999:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d4e640a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1876402802564480:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789477312.441109:0:6999:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d4e640a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1876402802564480:12345-0@lo:400:kworker.0 Request processed in 48us (542us total) trans 0 rc 0/0 00000100:00100000:0.0:1789477312.441115:0:6999:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1789477312.441127:0:6999:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1789477312.441133:0:6999:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d4e643800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1876402802564352:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789477312.441160:0:6999:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d4e643800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1876402802564352:12345-0@lo:400:kworker.0 Request processed in 27us (500us total) trans 0 rc 0/0 00000100:00100000:0.0:1789477312.441165:0:6999:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1789477312.441213:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d6d3d4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3313:1876402802564352:0@lo:400:kworker.0 00000100:00100000:0.0:1789477312.441231:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d6d3d6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:07d5e05c-913f-419f-adbc-d3cf15e9cd51:3313:1876402802563968:0@lo:400:kworker.0 00000100:00100000:0.0:1789477312.441240:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d6d3d7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3313:1876402802564480:0@lo:400:kworker.0 00000100:00100000:0.0:1789477312.441296:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d4e640380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1876402802563840:12345-0@lo:13:osp-pre-1-0.0 Request processed in 7364us (7570us total) trans 0 rc 0/0 00000100:00100000:0.0:1789477312.441305:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00080000:0.0:1789477312.441332:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d0d4e641500 x1876402802563840/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789477328 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789477312.441351:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d4e641500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1876402802563840:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789477312.441904:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d6d3d5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3311:1876402802564096:0@lo:400:kworker.0 00010000:00080000:0.0:1789477312.441920:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d0d6d3d6d80 x1876402802564224/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789477328 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789477312.441930:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d6d3d6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1876402802564224:0@lo:400:kworker.0 00000100:00080000:0.0:1789477312.450107:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789477312.450121:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1789477313.199742:0:6710:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789477313.503669:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:0.0:1789477313.503716:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:0.0:1789477313.503751:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783657984 00000100:00100000:0.0:1789477313.503763:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783657984 00000100:00100000:0.0:1789477313.503827:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 200 00000100:00100000:0.0:1789477313.503841:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d4ec6dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5c82dded-6a10-4ce8-abd1-52bd956b9523+10:2352:x1876402783657984:12345-192.168.201.23@tcp:400:kworker.0 00000100:00100000:0.0:1789477313.503944:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d4ec6dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5c82dded-6a10-4ce8-abd1-52bd956b9523+10:2352:x1876402783657984:12345-192.168.201.23@tcp:400:kworker.0 Request processed in 106us (292us total) trans 0 rc 0/0 00000100:00100000:0.0:1789477313.503953:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 200 00000100:00100000:0.0:1789477313.504014:0:6999:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783658112 00000100:00100000:0.0:1789477313.504018:0:6999:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783658112 00000100:00100000:0.0:1789477313.504060:0:6999:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 47 00000100:00100000:0.0:1789477313.504067:0:6999:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d4e641500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9bc33f26-0aab-4a14-832f-c58d566de1b0+6:2352:x1876402783658112:12345-192.168.201.23@tcp:400:kworker.0 00000100:00100000:0.0:1789477313.504100:0:6999:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d4e641500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9bc33f26-0aab-4a14-832f-c58d566de1b0+6:2352:x1876402783658112:12345-192.168.201.23@tcp:400:kworker.0 Request processed in 33us (384us total) trans 0 rc 0/0 00000100:00100000:0.0:1789477313.504107:0:6999:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 47 00000100:00080000:0.0:1789477313.505570:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1789477314.230296:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789477314.993572:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789477314.993621:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d74a8ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1876402802564608:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789477314.993684:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789477314.993821:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802564608 00000100:00100000:1.0:1789477314.993830:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802564608 00000100:00100000:1.0:1789477314.993911:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1789477314.993922:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d6d3d4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1876402802564608:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789477314.993956:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789477314.993998:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d6d3d4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1876402802564608:12345-0@lo:13:osp-pre-0-0.0 Request processed in 78us (314us total) trans 0 rc 0/0 00000100:00100000:1.0:1789477314.994005:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00080000:2.0:1789477314.994076:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1789477314.994101:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d0d74a8ad80 x1876402802564608/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789477330 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789477314.994119:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d74a8ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1876402802564608:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1789477315.248540:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789477316.271729:0:6710:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789477317.296177:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789477317.555258:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d74a8ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1876402802564736:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789477317.555351:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789477317.555407:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d74e8b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3311:1876402802565248:0@lo:400:kworker.0 00000100:00100000:1.0:1789477317.555731:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789477317.555802:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d74e89880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1876402802565120:0@lo:400:kworker.0 00000100:00100000:1.0:1789477317.555834:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789477317.555894:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d74a89c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3313:1876402802564992:0@lo:400:kworker.0 00000100:00100000:1.0:1789477317.555921:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789477317.555949:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d74e89f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1876402802565504:0@lo:400:kworker.0 00000100:00100000:1.0:1789477317.555968:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789477317.555985:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1789477317.555990:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d74a8a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:07d5e05c-913f-419f-adbc-d3cf15e9cd51:3313:1876402802564864:0@lo:400:kworker.0 00000100:00100000:1.0:1789477317.556016:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789477317.556036:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d74e88a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3313:1876402802565376:0@lo:400:kworker.0 00000100:00100000:1.0:1789477317.556055:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789477317.556085:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802564736 00000100:00100000:1.0:1789477317.556093:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802564736 00000100:00100000:1.0:1789477317.556154:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1789477317.556163:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d74e8bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1876402802564736:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789477317.556209:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789477317.557043:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d74e8bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1876402802564736:12345-0@lo:13:osp-pre-1-0.0 Request processed in 876us (1689us total) trans 0 rc 0/0 00000100:00100000:1.0:1789477317.557055:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1789477317.557123:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802565248 00000100:00100000:1.0:1789477317.557130:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802565248 00000100:00100000:0.0:1789477317.557335:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802565120 00000100:00100000:0.0:1789477317.557340:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802565120 00000100:00100000:0.0:1789477317.557371:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802565504 00000100:00100000:0.0:1789477317.557373:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802565504 00000100:00100000:0.0:1789477317.557391:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1789477317.557397:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d74e89500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3310:x1876402802565120:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789477317.557461:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d74e89500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3310:x1876402802565120:12345-0@lo:400:kworker.0 Request processed in 65us (1627us total) trans 0 rc 0/0 00000100:00100000:0.0:1789477317.557468:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1789477317.557481:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1789477317.557487:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d74e88e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3313:x1876402802565504:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789477317.557515:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d74e88e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3313:x1876402802565504:12345-0@lo:400:kworker.0 Request processed in 29us (1547us total) trans 0 rc 0/0 00000100:00100000:0.0:1789477317.557521:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1789477317.557619:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802564992 00000100:00100000:1.0:1789477317.557624:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802564992 00000100:00100000:0.0:1789477317.559994:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802565376 00000100:00100000:0.0:1789477317.560018:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802565376 00000100:00100000:0.0:1789477317.560103:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1789477317.560130:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d74e8a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1876402802565248:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789477317.560265:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d74e8a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1876402802565248:12345-0@lo:400:kworker.0 Request processed in 138us (4533us total) trans 0 rc 0/0 00000100:00100000:0.0:1789477317.560273:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1789477317.560295:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1789477317.560303:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d74e8ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1876402802564992:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789477317.560341:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d74e8ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1876402802564992:12345-0@lo:400:kworker.0 Request processed in 39us (4419us total) trans 0 rc 0/0 00000100:00100000:0.0:1789477317.560347:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1789477317.560359:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1789477317.560365:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d74e89180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1876402802565376:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789477317.560415:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d74e89180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1876402802565376:12345-0@lo:400:kworker.0 Request processed in 51us (4359us total) trans 0 rc 0/0 00000100:00100000:0.0:1789477317.560422:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1789477317.560507:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d74e8b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3311:1876402802565248:0@lo:400:kworker.0 00010000:00080000:0.0:1789477317.560548:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d0d74a8ad80 x1876402802564736/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789477333 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789477317.560596:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d74a8ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1876402802564736:0@lo:13:osp-pre-1-0.0 00000100:00080000:0.0:1789477317.561022:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789477317.561030:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789477317.561035:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789477317.561056:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802564864 00000100:00100000:0.0:1789477317.561062:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802564864 00000100:00100000:0.0:1789477317.561102:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 201 00000100:00100000:0.0:1789477317.561110:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d4ec6fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07d5e05c-913f-419f-adbc-d3cf15e9cd51+19:3313:x1876402802564864:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789477317.561171:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d4ec6fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07d5e05c-913f-419f-adbc-d3cf15e9cd51+19:3313:x1876402802564864:12345-0@lo:400:kworker.0 Request processed in 63us (5154us total) trans 0 rc 0/0 00000100:00100000:0.0:1789477317.561179:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 201 00010000:00080000:0.0:1789477317.561252:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d0d74e89880 x1876402802565120/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789477333 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789477317.561265:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d74e89880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1876402802565120:0@lo:400:kworker.0 00000100:00100000:0.0:1789477317.561359:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d74a8a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:07d5e05c-913f-419f-adbc-d3cf15e9cd51:3313:1876402802564864:0@lo:400:kworker.0 00000100:00100000:0.0:1789477317.561376:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d74e88a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3313:1876402802565376:0@lo:400:kworker.0 00000100:00100000:0.0:1789477317.561394:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d74a89c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3313:1876402802564992:0@lo:400:kworker.0 00010000:00080000:0.0:1789477317.562322:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d0d74e89f80 x1876402802565504/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789477333 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789477317.562336:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d74e89f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1876402802565504:0@lo:400:kworker.0 00010000:00010000:0.0:1789477318.321711:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789477318.624050:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:2.0:1789477318.624105:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:0.0:1789477318.624731:0:6999:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783658368 00000100:00100000:0.0:1789477318.624748:0:6999:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783658368 00000100:00100000:0.0:1789477318.624854:0:6999:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 51 00000100:00080000:2.0:1789477318.624859:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789477318.624866:0:6999:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d6d3d6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9bc33f26-0aab-4a14-832f-c58d566de1b0+6:2355:x1876402783658368:12345-192.168.201.23@tcp:400:kworker.0 00000100:00100000:0.0:1789477318.624975:0:6999:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d6d3d6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9bc33f26-0aab-4a14-832f-c58d566de1b0+6:2355:x1876402783658368:12345-192.168.201.23@tcp:400:kworker.0 Request processed in 111us (939us total) trans 0 rc 0/0 00000100:00100000:0.0:1789477318.624982:0:6999:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 51 00000100:00100000:3.0:1789477318.625071:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783658240 00000100:00100000:3.0:1789477318.625076:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783658240 00000100:00100000:3.0:1789477318.625117:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 202 00000100:00100000:3.0:1789477318.625125:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d4ec6f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5c82dded-6a10-4ce8-abd1-52bd956b9523+10:2355:x1876402783658240:12345-192.168.201.23@tcp:400:kworker.0 00000100:00100000:3.0:1789477318.625153:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d4ec6f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5c82dded-6a10-4ce8-abd1-52bd956b9523+10:2355:x1876402783658240:12345-192.168.201.23@tcp:400:kworker.0 Request processed in 31us (1048us total) trans 0 rc 0/0 00000100:00100000:3.0:1789477318.625161:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 202 00010000:00010000:2.0:1789477319.345550:0:6710:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789477320.119868:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d74e8a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1876402802565632:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789477320.119965:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789477320.120074:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802565632 00000100:00100000:3.0:1789477320.120084:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802565632 00000100:00100000:3.0:1789477320.120156:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1789477320.120176:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d6d3d6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1876402802565632:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789477320.120222:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789477320.132902:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d6d3d6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1876402802565632:12345-0@lo:13:osp-pre-0-0.0 Request processed in 12713us (12922us total) trans 0 rc 0/0 00000100:00100000:3.0:1789477320.132921:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00010000:00080000:2.0:1789477320.134112:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d0d74e8a680 x1876402802565632/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789477336 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789477320.134146:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d74e8a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1876402802565632:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1789477320.138229:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1789477320.374769:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789477321.392197:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789477322.420981:0:6710:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789477322.672353:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789477322.672382:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d74e8b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1876402802565760:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789477322.672472:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789477322.672553:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802565760 00000100:00100000:1.0:1789477322.672563:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802565760 00000100:00100000:1.0:1789477322.672666:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1789477322.672678:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d74e89c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1876402802565760:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789477322.672729:0:6698:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789477322.672802:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d74e89c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1876402802565760:12345-0@lo:13:osp-pre-1-0.0 Request processed in 124us (328us total) trans 0 rc 0/0 00000100:00100000:1.0:1789477322.672822:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00080000:1.0:1789477322.672849:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1789477322.672905:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d0d74e8b100 x1876402802565760/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789477338 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789477322.672927:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d74e8b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1876402802565760:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789477322.673831:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d58244380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:07d5e05c-913f-419f-adbc-d3cf15e9cd51:3312:1876402802565888:0@lo:400:kworker.0 00000100:00100000:0.0:1789477322.673902:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789477322.673938:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d7f703480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3312:1876402802566400:0@lo:400:kworker.0 00000100:00100000:0.0:1789477322.673964:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789477322.674208:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789477322.674217:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d58244e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3312:1876402802566016:0@lo:400:kworker.0 00000100:00100000:0.0:1789477322.674245:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789477322.674313:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802565888 00000100:00100000:0.0:1789477322.674320:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802565888 00000100:00100000:0.0:1789477322.674368:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 203 00000100:00100000:0.0:1789477322.674377:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d595f4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:07d5e05c-913f-419f-adbc-d3cf15e9cd51+19:3312:x1876402802565888:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789477322.674428:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d595f4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:07d5e05c-913f-419f-adbc-d3cf15e9cd51+19:3312:x1876402802565888:12345-0@lo:400:kworker.0 Request processed in 51us (526us total) trans 0 rc 0/0 00000100:00100000:0.0:1789477322.674436:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 203 00000100:00100000:0.0:1789477322.674471:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802566400 00000100:00100000:0.0:1789477322.674474:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802566400 00000100:00100000:0.0:1789477322.674509:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802566016 00000100:00100000:0.0:1789477322.674512:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802566016 00000100:00100000:0.0:1789477322.674531:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1789477322.674539:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d4e640700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1876402802566400:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789477322.674573:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d4e640700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1876402802566400:12345-0@lo:400:kworker.0 Request processed in 35us (608us total) trans 0 rc 0/0 00000100:00100000:3.0:1789477322.677041:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1789477322.677072:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d74a89c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1876402802566016:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789477322.677189:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d74a89c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1876402802566016:12345-0@lo:400:kworker.0 Request processed in 134us (2942us total) trans 0 rc 0/0 00000100:00100000:3.0:1789477322.677197:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1789477322.677304:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1789477322.677356:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d7f738e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3311:1876402802566272:0@lo:400:kworker.0 00000100:00100000:0.0:1789477322.677403:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789477322.677447:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789477322.677454:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d58247800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1876402802566144:0@lo:400:kworker.0 00000100:00100000:0.0:1789477322.677507:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789477322.677543:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802566144 00000100:00100000:0.0:1789477322.677552:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802566144 00000100:00100000:0.0:1789477322.677624:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1789477322.677632:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d74a8ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3311:x1876402802566144:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789477322.677681:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d74a8ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3311:x1876402802566144:12345-0@lo:400:kworker.0 Request processed in 51us (174us total) trans 0 rc 0/0 00000100:00100000:0.0:1789477322.677688:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00080000:0.0:1789477322.678011:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d0d58247800 x1876402802566144/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789477338 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789477322.678028:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d58247800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1876402802566144:0@lo:400:kworker.0 00000100:00100000:0.0:1789477322.678066:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d58244e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3312:1876402802566016:0@lo:400:kworker.0 00000100:00100000:0.0:1789477322.678077:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d58244380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:07d5e05c-913f-419f-adbc-d3cf15e9cd51:3312:1876402802565888:0@lo:400:kworker.0 00000100:00100000:0.0:1789477322.678090:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d7f703480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3312:1876402802566400:0@lo:400:kworker.0 00000100:00080000:1.0:1789477322.678424:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789477322.678430:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789477322.679721:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802566272 00000100:00100000:3.0:1789477322.679736:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802566272 00000100:00100000:3.0:1789477322.679818:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1789477322.679830:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d74a8a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1876402802566272:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789477322.679925:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d74a8a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1876402802566272:12345-0@lo:400:kworker.0 Request processed in 97us (2521us total) trans 0 rc 0/0 00000100:00100000:3.0:1789477322.679933:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00080000:1.0:1789477322.680070:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789477322.683263:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d7f738e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3311:1876402802566272:0@lo:400:kworker.0 00010000:00010000:1.0:1789477323.440890:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789477323.748179:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:0.0:1789477323.748317:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:3.0:1789477323.749381:0:6999:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783658624 00000100:00100000:3.0:1789477323.749402:0:6999:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783658624 00000100:00100000:3.0:1789477323.749515:0:6999:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 55 00000100:00100000:3.0:1789477323.749529:0:6999:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d7f738e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9bc33f26-0aab-4a14-832f-c58d566de1b0+6:2354:x1876402783658624:12345-192.168.201.23@tcp:400:kworker.0 00000100:00100000:3.0:1789477323.749657:0:6999:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d7f738e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9bc33f26-0aab-4a14-832f-c58d566de1b0+6:2354:x1876402783658624:12345-192.168.201.23@tcp:400:kworker.0 Request processed in 131us (1339us total) trans 0 rc 0/0 00000100:00100000:3.0:1789477323.749666:0:6999:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 55 00000100:00080000:0.0:1789477323.753074:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789477323.755888:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783658496 00000100:00100000:1.0:1789477323.755913:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783658496 00000100:00100000:1.0:1789477323.756086:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 204 00000100:00100000:1.0:1789477323.756102:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d595f6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5c82dded-6a10-4ce8-abd1-52bd956b9523+10:2354:x1876402783658496:12345-192.168.201.23@tcp:400:kworker.0 00000100:00100000:1.0:1789477323.756219:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d595f6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5c82dded-6a10-4ce8-abd1-52bd956b9523+10:2354:x1876402783658496:12345-192.168.201.23@tcp:400:kworker.0 Request processed in 119us (8054us total) trans 0 rc 0/0 00000100:00100000:1.0:1789477323.756226:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 204 00010000:00010000:0.0:1789477324.463817:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789477325.231966:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789477325.232000:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d6d3d5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1876402802566528:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789477325.232095:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789477325.232179:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802566528 00000100:00100000:2.0:1789477325.232189:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802566528 00000100:00100000:2.0:1789477325.232256:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1789477325.232266:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d6d3d6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1876402802566528:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789477325.232318:0:6698:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789477325.232371:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d6d3d6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1876402802566528:12345-0@lo:13:osp-pre-0-0.0 Request processed in 106us (276us total) trans 0 rc 0/0 00000100:00100000:2.0:1789477325.232380:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00080000:2.0:1789477325.232406:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1789477325.232444:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d0d6d3d5180 x1876402802566528/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789477341 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789477325.232466:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d6d3d5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1876402802566528:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1789477325.490640:0:6710:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789477326.516118:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789477327.551317:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789477327.805280:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d58244e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3311:1876402802566784:0@lo:400:kworker.0 00000100:00100000:0.0:1789477327.805381:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789477327.805446:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d75368700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1876402802567296:0@lo:400:kworker.0 00000100:00100000:0.0:1789477327.805496:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789477327.805546:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1789477327.805553:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d58244380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:07d5e05c-913f-419f-adbc-d3cf15e9cd51:3311:1876402802566656:0@lo:400:kworker.0 00000100:00100000:0.0:1789477327.805621:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789477327.805643:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d7536b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3311:1876402802567168:0@lo:400:kworker.0 00000100:00100000:0.0:1789477327.805696:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789477327.805730:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d58247800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1876402802566912:0@lo:400:kworker.0 00000100:00100000:0.0:1789477327.805760:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789477327.805779:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789477327.805785:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d7536aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3312:1876402802567040:0@lo:400:kworker.0 00000100:00100000:0.0:1789477327.805806:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789477327.805839:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802567296 00000100:00100000:0.0:1789477327.805849:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802567296 00000100:00100000:0.0:1789477327.805918:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802566912 00000100:00100000:0.0:1789477327.805922:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802566912 00000100:00100000:0.0:1789477327.805950:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1789477327.805959:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d75369c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3311:x1876402802567296:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789477327.806879:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d75369c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3311:x1876402802567296:12345-0@lo:400:kworker.0 Request processed in 914us (1377us total) trans 0 rc 0/0 00000100:00100000:0.0:1789477327.806890:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1789477327.807400:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1789477327.807414:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d6d466680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3312:x1876402802566912:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789477327.807473:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d6d466680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3312:x1876402802566912:12345-0@lo:400:kworker.0 Request processed in 64us (1712us total) trans 0 rc 0/0 00000100:00100000:0.0:1789477327.807480:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1789477327.808357:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802566784 00000100:00100000:3.0:1789477327.808388:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802566784 00000100:00100000:3.0:1789477327.808438:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802567168 00000100:00100000:3.0:1789477327.808443:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802567168 00000100:00100000:3.0:1789477327.808462:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802567040 00000100:00100000:3.0:1789477327.808466:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802567040 00000100:00100000:3.0:1789477327.808483:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1789477327.808490:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d7536a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1876402802566784:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789477327.809097:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802566656 00000100:00100000:0.0:1789477327.809113:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802566656 00000100:00100000:0.0:1789477327.809158:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 205 00000100:00100000:0.0:1789477327.809166:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d595f7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07d5e05c-913f-419f-adbc-d3cf15e9cd51+19:3311:x1876402802566656:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789477327.809244:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d595f7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07d5e05c-913f-419f-adbc-d3cf15e9cd51+19:3311:x1876402802566656:12345-0@lo:400:kworker.0 Request processed in 78us (3622us total) trans 0 rc 0/0 00000100:00100000:0.0:1789477327.809251:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 205 00000100:00080000:0.0:1789477327.809304:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789477327.809311:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789477327.809314:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1789477327.809381:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d0d58247800 x1876402802566912/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789477343 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789477327.809399:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d58247800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1876402802566912:0@lo:400:kworker.0 00000100:00100000:0.0:1789477327.809441:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d58244380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:07d5e05c-913f-419f-adbc-d3cf15e9cd51:3311:1876402802566656:0@lo:400:kworker.0 00010000:00080000:0.0:1789477327.809458:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d0d75368700 x1876402802567296/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789477343 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789477327.809468:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d75368700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1876402802567296:0@lo:400:kworker.0 00000100:00100000:1.0:1789477327.810472:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789477327.810493:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d74e8b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1876402802567424:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789477327.810572:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789477327.810658:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802567424 00000100:00100000:1.0:1789477327.810677:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802567424 00000100:00100000:1.0:1789477327.810727:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1789477327.810736:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d74e8aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1876402802567424:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789477327.810778:0:6698:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789477327.810825:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d74e8aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1876402802567424:12345-0@lo:13:osp-pre-1-0.0 Request processed in 89us (253us total) trans 0 rc 0/0 00000100:00100000:1.0:1789477327.810852:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00010000:00080000:1.0:1789477327.810897:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d0d74e8b100 x1876402802567424/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789477343 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789477327.810919:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d74e8b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1876402802567424:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789477327.812800:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d7536a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1876402802566784:12345-0@lo:400:kworker.0 Request processed in 4298us (7407us total) trans 0 rc 0/0 00000100:00100000:3.0:1789477327.812819:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1789477327.812865:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1789477327.812879:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d6d465180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1876402802567168:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789477327.812928:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d6d465180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1876402802567168:12345-0@lo:400:kworker.0 Request processed in 54us (7231us total) trans 0 rc 0/0 00000100:00100000:3.0:1789477327.812934:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1789477327.812946:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1789477327.812953:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d6d467100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1876402802567040:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789477327.814294:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d7536b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3311:1876402802567168:0@lo:400:kworker.0 00000100:00100000:1.0:1789477327.814317:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d58244e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3311:1876402802566784:0@lo:400:kworker.0 00000100:00100000:3.0:1789477327.815092:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d6d467100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1876402802567040:12345-0@lo:400:kworker.0 Request processed in 2133us (9278us total) trans 0 rc 0/0 00000100:00100000:3.0:1789477327.815106:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1789477327.815268:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d7536aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3312:1876402802567040:0@lo:400:kworker.0 00010000:00010000:0.0:1789477328.559900:0:6710:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789477328.872215:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:0.0:1789477328.872288:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:3.0:1789477328.872406:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783658880 00000100:00100000:3.0:1789477328.872419:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783658880 00000100:00100000:3.0:1789477328.872534:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 59 00000100:00100000:3.0:1789477328.872547:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d6d465c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9bc33f26-0aab-4a14-832f-c58d566de1b0+6:2353:x1876402783658880:12345-192.168.201.23@tcp:400:kworker.0 00000100:00100000:3.0:1789477328.872704:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d6d465c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9bc33f26-0aab-4a14-832f-c58d566de1b0+6:2353:x1876402783658880:12345-192.168.201.23@tcp:400:kworker.0 Request processed in 158us (503us total) trans 0 rc 0/0 00000100:00100000:3.0:1789477328.872734:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 59 00000100:00100000:1.0:1789477328.874147:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783658752 00000100:00100000:1.0:1789477328.874163:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783658752 00000100:00080000:0.0:1789477328.874310:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789477328.876797:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 206 00000100:00100000:1.0:1789477328.876826:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d595f4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5c82dded-6a10-4ce8-abd1-52bd956b9523+10:2353:x1876402783658752:12345-192.168.201.23@tcp:400:kworker.0 00000100:00100000:1.0:1789477328.876954:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d595f4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5c82dded-6a10-4ce8-abd1-52bd956b9523+10:2353:x1876402783658752:12345-192.168.201.23@tcp:400:kworker.0 Request processed in 140us (4663us total) trans 0 rc 0/0 00000100:00100000:1.0:1789477328.876964:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 206 00010000:00010000:3.0:1789477329.584163:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789477330.359962:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d7f700700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1876402802567552:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789477330.360040:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789477330.360117:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802567552 00000100:00100000:3.0:1789477330.360124:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802567552 00000100:00100000:3.0:1789477330.360180:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1789477330.360191:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d7f700000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1876402802567552:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789477330.360226:0:6698:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789477330.360267:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d7f700000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1876402802567552:12345-0@lo:13:osp-pre-0-0.0 Request processed in 78us (227us total) trans 0 rc 0/0 00000100:00100000:3.0:1789477330.360274:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00080000:3.0:1789477330.360295:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1789477330.360324:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d0d7f700700 x1876402802567552/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789477346 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789477330.360341:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d7f700700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1876402802567552:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1789477330.607890:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1789477330.767851:0:10153:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: start setup 09:02:08 (1789477328) === 00000100:00100000:0.0:1789477331.470693:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:3.0:1789477331.471361:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783659008 00000100:00100000:3.0:1789477331.471376:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783659008 00000100:00100000:3.0:1789477331.471479:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 207 00000100:00100000:3.0:1789477331.471491:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d595f6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5c82dded-6a10-4ce8-abd1-52bd956b9523+10:8130:x1876402783659008:12345-192.168.201.23@tcp:101:mount.lustre.0 00010000:00010000:3.0:1789477331.471514:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789477331.471540:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d0d49ecbe00/0xafddb3c8f9281730 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0xa90d500d7b8f29f5 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477331.471638:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d0d49ecbe00/0xafddb3c8f9281730 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f29f5 expref: 11 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477331.471675:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d0d49ecbe00/0xafddb3c8f9281730 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f29f5 expref: 11 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477331.471686:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d0d49ecbe00, rc 0) 00000100:00100000:3.0:1789477331.471780:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d595f6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5c82dded-6a10-4ce8-abd1-52bd956b9523+11:8130:x1876402783659008:12345-192.168.201.23@tcp:101:mount.lustre.0 Request processed in 290us (1102us total) trans 0 rc 0/0 00000100:00100000:3.0:1789477331.471787:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 207 00000100:00100000:3.0:1789477331.478536:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:1.0:1789477331.479184:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783659136 00000100:00100000:1.0:1789477331.479199:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783659136 00000100:00100000:1.0:1789477331.479275:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 208 00000100:00100000:1.0:1789477331.479289:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d595f7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5c82dded-6a10-4ce8-abd1-52bd956b9523+11:8130:x1876402783659136:12345-192.168.201.23@tcp:501:mount.lustre.0 00000100:00100000:1.0:1789477331.479779:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d595f7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5c82dded-6a10-4ce8-abd1-52bd956b9523+11:8130:x1876402783659136:12345-192.168.201.23@tcp:501:mount.lustre.0 Request processed in 492us (1256us total) trans 0 rc 0/0 00000100:00100000:1.0:1789477331.479790:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 208 00000100:00100000:0.0:1789477331.484953:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:2.0:1789477331.494644:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783659264 00000100:00100000:2.0:1789477331.494669:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783659264 00000100:00100000:2.0:1789477331.497507:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 209 00000100:00100000:2.0:1789477331.497542:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d595f5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5c82dded-6a10-4ce8-abd1-52bd956b9523+11:8130:x1876402783659264:12345-192.168.201.23@tcp:503:mount.lustre.0 00000100:00100000:2.0:1789477331.497930:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d595f5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5c82dded-6a10-4ce8-abd1-52bd956b9523+11:8130:x1876402783659264:12345-192.168.201.23@tcp:503:mount.lustre.0 Request processed in 405us (12990us total) trans 0 rc 0/0 00000100:00100000:2.0:1789477331.497940:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 209 00000100:00100000:0.0:1789477331.505856:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:1.0:1789477331.509573:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783659392 00000100:00100000:1.0:1789477331.509622:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783659392 00000100:00100000:1.0:1789477331.509758:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 210 00000100:00100000:1.0:1789477331.509772:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d595f6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5c82dded-6a10-4ce8-abd1-52bd956b9523+11:8134:x1876402783659392:12345-192.168.201.23@tcp:502:llog_process_th.0 00000100:00100000:1.0:1789477331.513428:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d595f6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5c82dded-6a10-4ce8-abd1-52bd956b9523+11:8134:x1876402783659392:12345-192.168.201.23@tcp:502:llog_process_th.0 Request processed in 3642us (7569us total) trans 0 rc 0/0 00000100:00100000:1.0:1789477331.513448:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 210 00000100:00100000:3.0:1789477331.530315:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:2.0:1789477331.532499:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783659520 00000100:00100000:2.0:1789477331.532523:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783659520 00000100:00100000:0.0:1789477331.535712:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 211 00000100:00100000:0.0:1789477331.535748:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d595f5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5c82dded-6a10-4ce8-abd1-52bd956b9523+11:8134:x1876402783659520:12345-192.168.201.23@tcp:502:llog_process_th.0 00000100:00100000:0.0:1789477331.536708:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d595f5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5c82dded-6a10-4ce8-abd1-52bd956b9523+11:8134:x1876402783659520:12345-192.168.201.23@tcp:502:llog_process_th.0 Request processed in 971us (6402us total) trans 0 rc 0/0 00000100:00100000:0.0:1789477331.536723:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 211 00000100:00100000:0.0:1789477331.549300:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:3.0:1789477331.551288:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783659648 00000100:00100000:3.0:1789477331.551310:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783659648 00000100:00100000:3.0:1789477331.551495:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 212 00000100:00100000:3.0:1789477331.551509:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d595f7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5c82dded-6a10-4ce8-abd1-52bd956b9523+11:8130:x1876402783659648:12345-192.168.201.23@tcp:101:mount.lustre.0 00010000:00010000:3.0:1789477331.551533:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789477331.551563:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d0d49ecac00/0xafddb3c8f9281737 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xa90d500d7b8f2a1f expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477331.551678:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d0d49ecac00/0xafddb3c8f9281737 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2a1f expref: 12 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477331.551692:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d0d49ecac00/0xafddb3c8f9281737 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2a1f expref: 12 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477331.551704:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d0d49ecac00, rc 0) 00000100:00100000:3.0:1789477331.555440:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d595f7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5c82dded-6a10-4ce8-abd1-52bd956b9523+12:8130:x1876402783659648:12345-192.168.201.23@tcp:101:mount.lustre.0 Request processed in 3913us (6137us total) trans 0 rc 0/0 00000100:00100000:3.0:1789477331.555488:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 212 00000100:00100000:1.0:1789477331.570407:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:0.0:1789477331.570642:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783659776 00000100:00100000:0.0:1789477331.570656:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783659776 00000100:00100000:0.0:1789477331.570723:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 213 00000100:00100000:0.0:1789477331.570736:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d595f7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5c82dded-6a10-4ce8-abd1-52bd956b9523+12:8130:x1876402783659776:12345-192.168.201.23@tcp:256:mount.lustre.0 20000000:01000000:0.0:1789477331.570771:0:5838:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:0.0:1789477331.570807:0:5838:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:0.0:1789477331.570812:0:5838:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:0.0:1789477331.570816:0:5838:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:0.0:1789477331.570818:0:5838:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 5 00000100:00100000:0.0:1789477331.575255:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d595f7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5c82dded-6a10-4ce8-abd1-52bd956b9523+12:8130:x1876402783659776:12345-192.168.201.23@tcp:256:mount.lustre.0 Request processed in 4501us (4854us total) trans 0 rc 0/0 00000100:00100000:0.0:1789477331.575275:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 213 00000100:00100000:2.0:1789477331.589897:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:0.0:1789477331.590018:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783659904 00000100:00100000:0.0:1789477331.590032:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783659904 00000100:00100000:0.0:1789477331.590114:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 214 00000100:00100000:0.0:1789477331.590127:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d595f5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5c82dded-6a10-4ce8-abd1-52bd956b9523+12:8130:x1876402783659904:12345-192.168.201.23@tcp:101:mount.lustre.0 00010000:00010000:0.0:1789477331.590150:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789477331.590174:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d0d82151200/0xafddb3c8f928173e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xa90d500d7b8f2a26 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477331.590212:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d0d82151200/0xafddb3c8f928173e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2a26 expref: 13 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477331.590252:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d0d82151200/0xafddb3c8f928173e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2a26 expref: 13 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477331.590263:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d0d82151200, rc 0) 00000100:00100000:0.0:1789477331.590341:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d595f5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5c82dded-6a10-4ce8-abd1-52bd956b9523+13:8130:x1876402783659904:12345-192.168.201.23@tcp:101:mount.lustre.0 Request processed in 216us (459us total) trans 0 rc 0/0 00000100:00100000:0.0:1789477331.592390:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 214 00000100:00100000:1.0:1789477331.592912:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:0.0:1789477331.594208:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783660032 00000100:00100000:0.0:1789477331.594225:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783660032 00000100:00100000:0.0:1789477331.594307:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 215 00000100:00100000:0.0:1789477331.594320:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d595f5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5c82dded-6a10-4ce8-abd1-52bd956b9523+13:8130:x1876402783660032:12345-192.168.201.23@tcp:501:mount.lustre.0 00000100:00100000:0.0:1789477331.594983:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d595f5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5c82dded-6a10-4ce8-abd1-52bd956b9523+13:8130:x1876402783660032:12345-192.168.201.23@tcp:501:mount.lustre.0 Request processed in 664us (2070us total) trans 0 rc 0/0 00000100:00100000:0.0:1789477331.594993:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 215 00000100:00100000:2.0:1789477331.607364:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:0.0:1789477331.607563:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783660160 00000100:00100000:0.0:1789477331.607605:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783660160 00000100:00100000:0.0:1789477331.607756:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 216 00000100:00100000:0.0:1789477331.607770:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d595f4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5c82dded-6a10-4ce8-abd1-52bd956b9523+13:8130:x1876402783660160:12345-192.168.201.23@tcp:503:mount.lustre.0 00000100:00100000:0.0:1789477331.608847:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d595f4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5c82dded-6a10-4ce8-abd1-52bd956b9523+13:8130:x1876402783660160:12345-192.168.201.23@tcp:503:mount.lustre.0 Request processed in 1071us (1501us total) trans 0 rc 0/0 00000100:00100000:0.0:1789477331.608862:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 216 00000100:00100000:3.0:1789477331.617300:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:0.0:1789477331.617552:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783660288 00000100:00100000:0.0:1789477331.617567:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783660288 00000100:00100000:0.0:1789477331.617827:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 217 00000100:00100000:0.0:1789477331.617841:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d595f6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5c82dded-6a10-4ce8-abd1-52bd956b9523+13:8137:x1876402783660288:12345-192.168.201.23@tcp:502:llog_process_th.0 00000100:00100000:0.0:1789477331.618281:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d595f6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5c82dded-6a10-4ce8-abd1-52bd956b9523+13:8137:x1876402783660288:12345-192.168.201.23@tcp:502:llog_process_th.0 Request processed in 441us (996us total) trans 0 rc 0/0 00000100:00100000:0.0:1789477331.618292:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 217 00000100:00100000:2.0:1789477331.624288:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00010000:00010000:1.0:1789477331.633109:0:6710:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789477331.634286:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783660416 00000100:00100000:0.0:1789477331.634305:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783660416 00000100:00100000:0.0:1789477331.635769:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 218 00000100:00100000:0.0:1789477331.635795:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d44523050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5c82dded-6a10-4ce8-abd1-52bd956b9523+13:8137:x1876402783660416:12345-192.168.201.23@tcp:502:llog_process_th.0 00000100:00100000:0.0:1789477331.636704:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d44523050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5c82dded-6a10-4ce8-abd1-52bd956b9523+13:8137:x1876402783660416:12345-192.168.201.23@tcp:502:llog_process_th.0 Request processed in 912us (12423us total) trans 0 rc 0/0 00000100:00100000:0.0:1789477331.636716:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 218 00000100:00100000:2.0:1789477331.648771:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:2.0:1789477331.648885:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:3.0:1789477331.655310:0:6999:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783660672 00000100:00100000:3.0:1789477331.655334:0:6999:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783660672 00000100:00080000:1.0:1789477331.657750:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789477331.658161:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783660544 00000100:00100000:2.0:1789477331.658177:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783660544 00000100:00100000:2.0:1789477331.658229:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 60 00000100:00100000:2.0:1789477331.658246:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d6d3d5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9bc33f26-0aab-4a14-832f-c58d566de1b0+6:2352:x1876402783660672:12345-192.168.201.23@tcp:400:kworker.0 00000100:00100000:2.0:1789477331.658383:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d6d3d5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9bc33f26-0aab-4a14-832f-c58d566de1b0+6:2352:x1876402783660672:12345-192.168.201.23@tcp:400:kworker.0 Request processed in 143us (9638us total) trans 0 rc 0/0 00000100:00100000:2.0:1789477331.658393:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 60 00000100:00100000:2.0:1789477331.658417:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 10 00000100:00100000:2.0:1789477331.658422:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d6d3d5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2351:x1876402783660544:12345-192.168.201.23@tcp:38:mount.lustre.0 00010000:00080000:2.0:1789477331.658453:0:5845:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from cf70c55a-e056-446b-8936-49e7cd31fc79@192.168.201.23@tcp t0 exp 0000000000000000 cur 276 last 0 00000020:00000080:2.0:1789477331.658498:0:5845:0:(genops.c:1385:class_connect()) connect: client cf70c55a-e056-446b-8936-49e7cd31fc79, cookie 0xafddb3c8f9281745 00000004:00100000:2.0:1789477331.658544:0:5845:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:2.0:1789477331.658935:0:5845:0:(import.c:65:import_set_state_nolock()) ffff9d0d74a81800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789477331.658981:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d6d3d5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cf70c55a-e056-446b-8936-49e7cd31fc79+6:2351:x1876402783660544:12345-192.168.201.23@tcp:38:mount.lustre.0 Request processed in 556us (10095us total) trans 0 rc 0/0 00000100:00100000:2.0:1789477331.659011:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 10 00000100:00100000:3.0:1789477331.668826:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:2.0:1789477331.669314:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783660800 00000100:00100000:2.0:1789477331.669330:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783660800 00000100:00100000:2.0:1789477331.669678:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 11 00000100:00100000:2.0:1789477331.669690:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d7f700700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cf70c55a-e056-446b-8936-49e7cd31fc79+6:0:x1876402783660800:12345-192.168.201.23@tcp:41:mount.lustre.0 00000004:00000024:2.0:1789477331.669764:0:5845:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:2.0:1789477331.669891:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d7f700700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cf70c55a-e056-446b-8936-49e7cd31fc79+6:0:x1876402783660800:12345-192.168.201.23@tcp:41:mount.lustre.0 Request processed in 203us (1328us total) trans 0 rc 0/0 00000100:00100000:2.0:1789477331.669899:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 11 00000100:00100000:2.0:1789477331.674414:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:3.0:1789477331.674652:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783660928 00000100:00100000:3.0:1789477331.674667:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783660928 00000100:00100000:3.0:1789477331.674745:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 12 00000100:00100000:3.0:1789477331.674758:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d6d3d7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cf70c55a-e056-446b-8936-49e7cd31fc79+6:8130:x1876402783660928:12345-192.168.201.23@tcp:41:mount.lustre.0 00000004:00000024:3.0:1789477331.674799:0:5844:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:3.0:1789477331.674884:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d6d3d7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cf70c55a-e056-446b-8936-49e7cd31fc79+6:8130:x1876402783660928:12345-192.168.201.23@tcp:41:mount.lustre.0 Request processed in 128us (487us total) trans 0 rc 0/0 00000100:00100000:3.0:1789477331.674892:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 12 00000100:00080000:1.0:1789477331.675962:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789477331.676880:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:2.0:1789477331.676993:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783661056 00000100:00100000:2.0:1789477331.677005:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783661056 00000100:00100000:2.0:1789477331.677229:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 13 00000100:00100000:2.0:1789477331.677244:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d6d466a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cf70c55a-e056-446b-8936-49e7cd31fc79+6:8130:x1876402783661056:12345-192.168.201.23@tcp:40:mount.lustre.0 00000100:00100000:2.0:1789477331.677367:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d6d466a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cf70c55a-e056-446b-8936-49e7cd31fc79+6:8130:x1876402783661056:12345-192.168.201.23@tcp:40:mount.lustre.0 Request processed in 127us (495us total) trans 0 rc 0/0 00000100:00100000:2.0:1789477331.677377:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 13 00000100:00100000:0.0:1789477331.682889:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:0.0:1789477331.682956:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:0.0:1789477331.683008:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:1.0:1789477331.683281:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783661184 00000100:00100000:1.0:1789477331.683296:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783661184 00000100:00100000:1.0:1789477331.683360:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783661312 00000100:00100000:1.0:1789477331.683364:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783661312 00000100:00100000:1.0:1789477331.683391:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 13 00000100:00100000:1.0:1789477331.683402:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d6d467480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2351:x1876402783661184:12345-192.168.201.23@tcp:8:mount.lustre.0 00010000:00080000:1.0:1789477331.683446:0:6697:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from cf70c55a-e056-446b-8936-49e7cd31fc79@192.168.201.23@tcp t0 exp 0000000000000000 cur 276 last 0 00000020:00000080:1.0:1789477331.683493:0:6697:0:(genops.c:1385:class_connect()) connect: client cf70c55a-e056-446b-8936-49e7cd31fc79, cookie 0xafddb3c8f928174c 00002000:00100000:1.0:1789477331.683510:0:6697:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli cf70c55a-e056-446b-8936-49e7cd31fc79/ffff9d0d7c06d000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113954 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1789477331.683522:0:6697:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:1.0:1789477331.683872:0:6697:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1789477331.683913:0:6697:0:(import.c:65:import_set_state_nolock()) ffff9d0d7c06e000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789477331.684029:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d6d467480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:cf70c55a-e056-446b-8936-49e7cd31fc79+6:2351:x1876402783661184:12345-192.168.201.23@tcp:8:mount.lustre.0 Request processed in 628us (1071us total) trans 0 rc 0/0 00000100:00100000:1.0:1789477331.684037:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 13 00000100:00100000:2.0:1789477331.684452:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783661440 00000100:00100000:2.0:1789477331.684461:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783661440 00000100:00100000:2.0:1789477331.684511:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 1 00000100:00100000:2.0:1789477331.684520:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d6d464380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:cf70c55a-e056-446b-8936-49e7cd31fc79+6:8130:x1876402783661440:12345-192.168.201.23@tcp:33:mount.lustre.0 00000004:00200000:2.0:1789477331.684894:0:5847:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000100:00100000:0.0:1789477331.685380:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 14 00000100:00100000:0.0:1789477331.685389:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d6d464700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2351:x1876402783661312:12345-192.168.201.23@tcp:8:mount.lustre.0 00010000:00080000:0.0:1789477331.685420:0:6694:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from cf70c55a-e056-446b-8936-49e7cd31fc79@192.168.201.23@tcp t0 exp 0000000000000000 cur 276 last 0 00000020:00000080:0.0:1789477331.685459:0:6694:0:(genops.c:1385:class_connect()) connect: client cf70c55a-e056-446b-8936-49e7cd31fc79, cookie 0xafddb3c8f9281753 00002000:00100000:0.0:1789477331.685471:0:6694:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli cf70c55a-e056-446b-8936-49e7cd31fc79/ffff9d0d7f52b000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113954 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1789477331.685499:0:6694:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:0.0:1789477331.685766:0:6694:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1789477331.685800:0:6694:0:(import.c:65:import_set_state_nolock()) ffff9d0d7f52a800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789477331.685844:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d6d464700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:cf70c55a-e056-446b-8936-49e7cd31fc79+6:2351:x1876402783661312:12345-192.168.201.23@tcp:8:mount.lustre.0 Request processed in 454us (2834us total) trans 0 rc 0/0 00000100:00100000:0.0:1789477331.685868:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 14 00000100:00100000:2.0:1789477331.686219:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d6d464380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:cf70c55a-e056-446b-8936-49e7cd31fc79+6:8130:x1876402783661440:12345-192.168.201.23@tcp:33:mount.lustre.0 Request processed in 532us (2180us total) trans 0 rc 0/0 00000100:00100000:2.0:1789477331.686235:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 1 00010000:00010000:3.0:1789477332.655876:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789477332.912057:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d7c3e7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1876402802567936:0@lo:400:kworker.0 00000100:00100000:2.0:1789477332.912180:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789477332.912261:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789477332.912268:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d7c3e4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3312:1876402802568064:0@lo:400:kworker.0 00000100:00100000:2.0:1789477332.912301:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789477332.912343:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802568064 00000100:00100000:2.0:1789477332.912355:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802568064 00000100:00100000:2.0:1789477332.912445:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1789477332.912458:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d7c3e7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1876402802568064:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789477332.912522:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d7c3e7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1876402802568064:12345-0@lo:400:kworker.0 Request processed in 67us (219us total) trans 0 rc 0/0 00000100:00100000:2.0:1789477332.912530:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1789477332.912629:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d7c3e4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3312:1876402802568064:0@lo:400:kworker.0 00000100:00100000:2.0:1789477332.912680:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d6d3d6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:07d5e05c-913f-419f-adbc-d3cf15e9cd51:3310:1876402802567680:0@lo:400:kworker.0 00000100:00100000:2.0:1789477332.912714:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789477332.912741:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d7c3e4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3310:1876402802568192:0@lo:400:kworker.0 00000100:00100000:2.0:1789477332.912762:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789477332.912782:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1789477332.912788:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d6d3d4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3310:1876402802567808:0@lo:400:kworker.0 00000100:00100000:2.0:1789477332.912843:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789477332.912865:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d7c3e5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1876402802568320:0@lo:400:kworker.0 00000100:00100000:2.0:1789477332.912891:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789477332.912920:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802568192 00000100:00100000:2.0:1789477332.912925:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802568192 00000100:00100000:2.0:1789477332.912957:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802567808 00000100:00100000:2.0:1789477332.912960:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802567808 00000100:00100000:2.0:1789477332.912995:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1789477332.913002:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d7c3e4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1876402802568192:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789477332.913042:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d7c3e4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1876402802568192:12345-0@lo:400:kworker.0 Request processed in 41us (279us total) trans 0 rc 0/0 00000100:00100000:2.0:1789477332.913048:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1789477332.913062:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1789477332.913069:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d74f84380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1876402802567808:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789477332.913097:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d74f84380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1876402802567808:12345-0@lo:400:kworker.0 Request processed in 28us (256us total) trans 0 rc 0/0 00000100:00100000:2.0:1789477332.913103:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1789477332.913140:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d6d3d4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3310:1876402802567808:0@lo:400:kworker.0 00000100:00100000:2.0:1789477332.913151:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d7c3e4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3310:1876402802568192:0@lo:400:kworker.0 00000100:00080000:2.0:1789477332.913190:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789477332.913397:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802567936 00000100:00100000:0.0:1789477332.913403:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802567936 00000100:00100000:0.0:1789477332.913459:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802568320 00000100:00100000:0.0:1789477332.913462:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802568320 00000100:00100000:0.0:1789477332.913486:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1789477332.913494:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d7c3e6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3312:x1876402802567936:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789477332.913540:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d7c3e6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3312:x1876402802567936:12345-0@lo:400:kworker.0 Request processed in 47us (1362us total) trans 0 rc 0/0 00000100:00100000:0.0:1789477332.913546:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1789477332.913559:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1789477332.913565:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d74f87480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3310:x1876402802568320:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789477332.913635:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d74f87480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3310:x1876402802568320:12345-0@lo:400:kworker.0 Request processed in 70us (742us total) trans 0 rc 0/0 00000100:00100000:0.0:1789477332.913642:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00080000:0.0:1789477332.913666:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789477332.913669:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1789477332.913691:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d0d7c3e5f80 x1876402802568320/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789477348 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789477332.913702:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d7c3e5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1876402802568320:0@lo:400:kworker.0 00010000:00080000:0.0:1789477332.913722:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d0d7c3e7800 x1876402802567936/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789477348 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789477332.913730:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d7c3e7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1876402802567936:0@lo:400:kworker.0 00000100:00100000:0.0:1789477332.913758:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802567680 00000100:00100000:0.0:1789477332.913762:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802567680 00000100:00100000:0.0:1789477332.913800:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 219 00000100:00100000:0.0:1789477332.913807:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d44522c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07d5e05c-913f-419f-adbc-d3cf15e9cd51+19:3310:x1876402802567680:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789477332.913844:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d44522c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07d5e05c-913f-419f-adbc-d3cf15e9cd51+19:3310:x1876402802567680:12345-0@lo:400:kworker.0 Request processed in 38us (1129us total) trans 0 rc 0/0 00000100:00100000:0.0:1789477332.913850:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 219 00000100:00100000:0.0:1789477332.913887:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d6d3d6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:07d5e05c-913f-419f-adbc-d3cf15e9cd51:3310:1876402802567680:0@lo:400:kworker.0 00000100:00100000:1.0:1789477332.929758:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d74e8b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1876402802568448:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789477332.929874:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789477332.930256:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802568448 00000100:00100000:1.0:1789477332.930266:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802568448 00000100:00100000:1.0:1789477332.930323:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1789477332.930332:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d74e88380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1876402802568448:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789477332.930377:0:6698:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789477332.930434:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d74e88380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1876402802568448:12345-0@lo:13:osp-pre-1-0.0 Request processed in 102us (561us total) trans 0 rc 0/0 00000100:00100000:1.0:1789477332.930442:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00010000:00080000:1.0:1789477332.930508:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d0d74e8b100 x1876402802568448/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789477348 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789477332.930532:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d74e8b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1876402802568448:0@lo:13:osp-pre-1-0.0 00000001:00100000:1.0:1789477333.013440:0:5868:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of cf70c55a-e056-446b-8936-49e7cd31fc79 00000001:00100000:0.0:1789477333.062225:0:7678:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of cf70c55a-e056-446b-8936-49e7cd31fc79 00000001:00100000:2.0:1789477333.479475:0:6730:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of cf70c55a-e056-446b-8936-49e7cd31fc79 00010000:00010000:3.0:1789477333.682140:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789477334.708875:0:6710:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789477335.473839:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d74f84700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1876402802568576:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789477335.473916:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789477335.474213:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802568576 00000100:00100000:2.0:1789477335.474222:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802568576 00000100:00100000:2.0:1789477335.474292:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1789477335.474304:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d74e8b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1876402802568576:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789477335.474345:0:6698:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789477335.474403:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d74e8b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1876402802568576:12345-0@lo:13:osp-pre-0-0.0 Request processed in 101us (486us total) trans 0 rc 0/0 00000100:00100000:2.0:1789477335.474410:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00010000:00080000:2.0:1789477335.474448:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d0d74f84700 x1876402802568576/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789477351 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789477335.474467:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d74f84700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1876402802568576:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1789477335.474657:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1789477335.728151:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789477336.753074:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789477337.064098:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:1.0:1789477337.064142:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:1.0:1789477337.064177:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:1.0:1789477337.064209:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:1.0:1789477337.064232:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:1.0:1789477337.064261:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783662080 00000100:00100000:1.0:1789477337.064284:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783662080 00000100:00100000:1.0:1789477337.064342:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783661952 00000100:00100000:1.0:1789477337.064346:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783661952 00000100:00100000:1.0:1789477337.064370:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 32 00000100:00100000:1.0:1789477337.064380:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d74e88700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:cf70c55a-e056-446b-8936-49e7cd31fc79+5:2352:x1876402783662080:12345-192.168.201.23@tcp:400:kworker.0 00000100:00100000:1.0:1789477337.064476:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d74e88700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:cf70c55a-e056-446b-8936-49e7cd31fc79+5:2352:x1876402783662080:12345-192.168.201.23@tcp:400:kworker.0 Request processed in 97us (297us total) trans 0 rc 0/0 00000100:00100000:1.0:1789477337.064484:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 32 00000100:00100000:1.0:1789477337.064512:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 33 00000100:00100000:1.0:1789477337.064520:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d74e8a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:cf70c55a-e056-446b-8936-49e7cd31fc79+5:2352:x1876402783661952:12345-192.168.201.23@tcp:400:kworker.0 00000100:00100000:1.0:1789477337.064543:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d74e8a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:cf70c55a-e056-446b-8936-49e7cd31fc79+5:2352:x1876402783661952:12345-192.168.201.23@tcp:400:kworker.0 Request processed in 24us (310us total) trans 0 rc 0/0 00000100:00100000:1.0:1789477337.064549:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 33 00000100:00080000:3.0:1789477337.064721:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789477337.064726:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789477337.065928:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783661568 00000100:00100000:0.0:1789477337.065937:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783661568 00000100:00100000:0.0:1789477337.065988:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 220 00000100:00100000:0.0:1789477337.066004:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d44521450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5c82dded-6a10-4ce8-abd1-52bd956b9523+13:2352:x1876402783661568:12345-192.168.201.23@tcp:400:kworker.0 00000100:00100000:0.0:1789477337.066059:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d44521450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5c82dded-6a10-4ce8-abd1-52bd956b9523+13:2352:x1876402783661568:12345-192.168.201.23@tcp:400:kworker.0 Request processed in 63us (1970us total) trans 0 rc 0/0 00000100:00100000:0.0:1789477337.066066:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 220 00000100:00100000:2.0:1789477337.068466:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783661824 00000100:00100000:2.0:1789477337.068481:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783661824 00000100:00100000:2.0:1789477337.068570:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783661696 00000100:00100000:2.0:1789477337.068574:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783661696 00000100:00100000:2.0:1789477337.068639:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 64 00000100:00100000:2.0:1789477337.068649:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d74e8b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cf70c55a-e056-446b-8936-49e7cd31fc79+5:2352:x1876402783661824:12345-192.168.201.23@tcp:400:kworker.0 00000100:00100000:2.0:1789477337.068741:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d74e8b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cf70c55a-e056-446b-8936-49e7cd31fc79+5:2352:x1876402783661824:12345-192.168.201.23@tcp:400:kworker.0 Request processed in 93us (4598us total) trans 0 rc 0/0 00000100:00100000:2.0:1789477337.068750:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 64 00000100:00100000:2.0:1789477337.068768:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 65 00000100:00100000:2.0:1789477337.068775:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d74e88000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9bc33f26-0aab-4a14-832f-c58d566de1b0+6:2352:x1876402783661696:12345-192.168.201.23@tcp:400:kworker.0 00000100:00100000:2.0:1789477337.068798:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d74e88000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9bc33f26-0aab-4a14-832f-c58d566de1b0+6:2352:x1876402783661696:12345-192.168.201.23@tcp:400:kworker.0 Request processed in 25us (4589us total) trans 0 rc 0/0 00000100:00100000:2.0:1789477337.068803:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 65 00000100:00080000:3.0:1789477337.069190:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1789477337.781849:0:6710:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789477338.033131:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789477338.033166:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d74f84700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1876402802568704:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789477338.033269:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789477338.033355:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802568704 00000100:00100000:2.0:1789477338.033365:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802568704 00000100:00100000:2.0:1789477338.033441:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1789477338.033455:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d74f84000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1876402802568704:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789477338.033516:0:6698:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789477338.033575:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d74f84000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1876402802568704:12345-0@lo:13:osp-pre-1-0.0 Request processed in 123us (306us total) trans 0 rc 0/0 00000100:00100000:2.0:1789477338.033618:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00080000:2.0:1789477338.033646:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:2.0:1789477338.033998:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d0d74f84700 x1876402802568704/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789477354 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789477338.034026:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d74f84700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1876402802568704:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789477338.035059:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d6d465880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3312:1876402802568960:0@lo:400:kworker.0 00000100:00100000:0.0:1789477338.035130:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789477338.035172:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789477338.035179:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d6d467800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1876402802569088:0@lo:400:kworker.0 00000100:00100000:0.0:1789477338.035209:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789477338.035260:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802568960 00000100:00100000:0.0:1789477338.035268:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802568960 00000100:00100000:0.0:1789477338.035325:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1789477338.035334:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d6d467b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1876402802568960:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789477338.035386:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d6d467b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1876402802568960:12345-0@lo:400:kworker.0 Request processed in 53us (256us total) trans 0 rc 0/0 00000100:00100000:0.0:1789477338.035409:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1789477338.035437:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802569088 00000100:00100000:0.0:1789477338.035441:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802569088 00000100:00100000:0.0:1789477338.035498:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1789477338.035506:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d6d466300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3312:x1876402802569088:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789477338.035543:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d6d466300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3312:x1876402802569088:12345-0@lo:400:kworker.0 Request processed in 38us (333us total) trans 0 rc 0/0 00000100:00100000:0.0:1789477338.035549:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1789477338.035616:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d6d464a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3310:1876402802569216:0@lo:400:kworker.0 00000100:00100000:0.0:1789477338.035648:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789477338.035793:0:6999:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802569216 00000100:00100000:2.0:1789477338.035797:0:6999:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802569216 00000100:00100000:2.0:1789477338.036297:0:6999:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1789477338.036308:0:6999:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d6d465500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1876402802569216:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789477338.036369:0:6999:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d6d465500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1876402802569216:12345-0@lo:400:kworker.0 Request processed in 64us (721us total) trans 0 rc 0/0 00000100:00100000:2.0:1789477338.036377:0:6999:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00080000:2.0:1789477338.036404:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789477338.036408:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789477338.038494:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d6d464a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3310:1876402802569216:0@lo:400:kworker.0 00000100:00100000:0.0:1789477338.038537:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1789477338.038551:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d6d464000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:07d5e05c-913f-419f-adbc-d3cf15e9cd51:3310:1876402802568832:0@lo:400:kworker.0 00000100:00100000:0.0:1789477338.038734:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789477338.038775:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d6d465f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3310:1876402802569344:0@lo:400:kworker.0 00000100:00100000:0.0:1789477338.038927:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789477338.038978:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802569344 00000100:00100000:0.0:1789477338.038986:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802569344 00000100:00100000:0.0:1789477338.039060:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1789477338.039071:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d6d464a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1876402802569344:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789477338.039136:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d6d464a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1876402802569344:12345-0@lo:400:kworker.0 Request processed in 66us (207us total) trans 0 rc 0/0 00000100:00100000:0.0:1789477338.039144:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00010000:00080000:0.0:1789477338.039197:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d0d6d467800 x1876402802569088/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789477354 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789477338.039237:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d6d467800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1876402802569088:0@lo:400:kworker.0 00000100:00100000:0.0:1789477338.039257:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d6d465880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3312:1876402802568960:0@lo:400:kworker.0 00000100:00100000:0.0:1789477338.039305:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d6d465f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3310:1876402802569344:0@lo:400:kworker.0 00000100:00100000:2.0:1789477338.040273:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802568832 00000100:00100000:2.0:1789477338.040289:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802568832 00000100:00100000:2.0:1789477338.040342:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 221 00000100:00100000:2.0:1789477338.040354:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d44522050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07d5e05c-913f-419f-adbc-d3cf15e9cd51+19:3310:x1876402802568832:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789477338.040434:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d44522050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07d5e05c-913f-419f-adbc-d3cf15e9cd51+19:3310:x1876402802568832:12345-0@lo:400:kworker.0 Request processed in 83us (1770us total) trans 0 rc 0/0 00000100:00100000:2.0:1789477338.040442:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 221 00000100:00080000:2.0:1789477338.040500:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789477338.040925:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d6d464000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:07d5e05c-913f-419f-adbc-d3cf15e9cd51:3310:1876402802568832:0@lo:400:kworker.0 00000001:02000400:3.0:1789477338.275267:0:10349:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg123-client.virtnet: executing check_config_client /mnt/lustre 00010000:00010000:3.0:1789477338.802179:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789477339.824866:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789477340.592014:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d74f84700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1876402802569472:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789477340.592124:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789477340.592307:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802569472 00000100:00100000:2.0:1789477340.592319:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802569472 00000100:00100000:2.0:1789477340.592396:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1789477340.592407:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d7f701880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1876402802569472:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789477340.592461:0:6698:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789477340.595236:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d7f701880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1876402802569472:12345-0@lo:13:osp-pre-0-0.0 Request processed in 2813us (3094us total) trans 0 rc 0/0 00000100:00100000:2.0:1789477340.595270:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00080000:2.0:1789477340.595331:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1789477340.600228:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d0d74f84700 x1876402802569472/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789477356 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789477340.600268:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d74f84700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1876402802569472:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1789477340.848856:0:6710:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789477341.876275:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789477342.182573:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:1.0:1789477342.182643:0:6999:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783662336 00000100:00100000:2.0:1789477342.182645:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:1.0:1789477342.182656:0:6999:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783662336 00000100:00100000:2.0:1789477342.182680:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:2.0:1789477342.182701:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:2.0:1789477342.182724:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:1.0:1789477342.182728:0:6999:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783662464 00000100:00100000:1.0:1789477342.182731:0:6999:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783662464 00000100:00100000:1.0:1789477342.182759:0:6999:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 69 00000100:00100000:2.0:1789477342.182762:0:8241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783662592 00000100:00100000:2.0:1789477342.182765:0:8241:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783662592 00000100:00100000:1.0:1789477342.182770:0:6999:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d74f85880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9bc33f26-0aab-4a14-832f-c58d566de1b0+6:2355:x1876402783662336:12345-192.168.201.23@tcp:400:kworker.0 00000100:00100000:2.0:1789477342.182795:0:8241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783662720 00000100:00100000:2.0:1789477342.182798:0:8241:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783662720 00000100:00100000:2.0:1789477342.182818:0:8241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 35 00000100:00100000:2.0:1789477342.182825:0:8241:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d74f87800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:cf70c55a-e056-446b-8936-49e7cd31fc79+5:2355:x1876402783662592:12345-192.168.201.23@tcp:400:kworker.0 00000100:00100000:1.0:1789477342.182874:0:6999:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d74f85880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9bc33f26-0aab-4a14-832f-c58d566de1b0+6:2355:x1876402783662336:12345-192.168.201.23@tcp:400:kworker.0 Request processed in 104us (329us total) trans 0 rc 0/0 00000100:00100000:1.0:1789477342.182882:0:6999:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 69 00000100:00100000:1.0:1789477342.182904:0:6999:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 70 00000100:00100000:1.0:1789477342.182923:0:6999:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d74f84a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cf70c55a-e056-446b-8936-49e7cd31fc79+5:2355:x1876402783662464:12345-192.168.201.23@tcp:400:kworker.0 00000100:00100000:2.0:1789477342.189151:0:8241:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d74f87800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:cf70c55a-e056-446b-8936-49e7cd31fc79+5:2355:x1876402783662592:12345-192.168.201.23@tcp:400:kworker.0 Request processed in 6304us (6483us total) trans 0 rc 0/0 00000100:00100000:2.0:1789477342.189173:0:8241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 35 00000100:00100000:2.0:1789477342.189225:0:8241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 36 00000100:00100000:2.0:1789477342.189244:0:8241:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d74f85f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:cf70c55a-e056-446b-8936-49e7cd31fc79+5:2355:x1876402783662720:12345-192.168.201.23@tcp:400:kworker.0 00000100:00100000:1.0:1789477342.189316:0:6999:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d74f84a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cf70c55a-e056-446b-8936-49e7cd31fc79+5:2355:x1876402783662464:12345-192.168.201.23@tcp:400:kworker.0 Request processed in 6391us (6610us total) trans 0 rc 0/0 00000100:00100000:1.0:1789477342.189328:0:6999:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 70 00000100:00100000:2.0:1789477342.189341:0:8241:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d74f85f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:cf70c55a-e056-446b-8936-49e7cd31fc79+5:2355:x1876402783662720:12345-192.168.201.23@tcp:400:kworker.0 Request processed in 107us (6616us total) trans 0 rc 0/0 00000100:00100000:2.0:1789477342.189347:0:8241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 36 00000100:00080000:1.0:1789477342.189366:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789477342.189369:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783662208 00000100:00080000:1.0:1789477342.189372:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789477342.189379:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783662208 00000100:00080000:1.0:1789477342.189382:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789477342.189433:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 222 00000100:00100000:2.0:1789477342.189440:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d44521c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5c82dded-6a10-4ce8-abd1-52bd956b9523+13:2355:x1876402783662208:12345-192.168.201.23@tcp:400:kworker.0 00000100:00100000:2.0:1789477342.190883:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d44521c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5c82dded-6a10-4ce8-abd1-52bd956b9523+13:2355:x1876402783662208:12345-192.168.201.23@tcp:400:kworker.0 Request processed in 1433us (8191us total) trans 0 rc 0/0 00000100:00100000:2.0:1789477342.190898:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 222 00010000:00010000:0.0:1789477342.896111:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789477343.152205:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d74f87b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1876402802569600:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789477343.152312:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789477343.152420:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802569600 00000100:00100000:2.0:1789477343.152432:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802569600 00000100:00100000:2.0:1789477343.152518:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1789477343.152540:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d74f86300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1876402802569600:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789477343.152615:0:6698:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789477343.152667:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d74f86300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1876402802569600:12345-0@lo:13:osp-pre-1-0.0 Request processed in 140us (356us total) trans 0 rc 0/0 00000100:00100000:2.0:1789477343.152676:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00080000:1.0:1789477343.153612:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:2.0:1789477343.154271:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d0d74f87b80 x1876402802569600/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789477359 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789477343.154302:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d74f87b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1876402802569600:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789477343.165183:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d74e89f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:07d5e05c-913f-419f-adbc-d3cf15e9cd51:3310:1876402802569728:0@lo:400:kworker.0 00000100:00100000:0.0:1789477343.165296:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789477343.165363:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d753e2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3310:1876402802570240:0@lo:400:kworker.0 00000100:00100000:0.0:1789477343.165406:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789477343.165446:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789477343.165454:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d74e88a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3310:1876402802569856:0@lo:400:kworker.0 00000100:00100000:0.0:1789477343.165481:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789477343.165541:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802569728 00000100:00100000:0.0:1789477343.165552:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802569728 00000100:00100000:0.0:1789477343.165632:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 223 00000100:00100000:0.0:1789477343.165642:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d44523c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:07d5e05c-913f-419f-adbc-d3cf15e9cd51+19:3310:x1876402802569728:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789477343.165707:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d44523c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:07d5e05c-913f-419f-adbc-d3cf15e9cd51+19:3310:x1876402802569728:12345-0@lo:400:kworker.0 Request processed in 65us (411us total) trans 0 rc 0/0 00000100:00100000:0.0:1789477343.165715:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 223 00000100:00100000:0.0:1789477343.165754:0:6999:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802570240 00000100:00100000:0.0:1789477343.165757:0:6999:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802570240 00000100:00100000:0.0:1789477343.165811:0:6999:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802569856 00000100:00100000:0.0:1789477343.165814:0:6999:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802569856 00000100:00100000:0.0:1789477343.165832:0:6999:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1789477343.165839:0:6999:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d6d464000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1876402802570240:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789477343.165873:0:6999:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d6d464000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1876402802570240:12345-0@lo:400:kworker.0 Request processed in 36us (467us total) trans 0 rc 0/0 00000100:00100000:0.0:1789477343.165880:0:6999:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1789477343.166123:0:6999:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1789477343.166132:0:6999:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d6d465f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1876402802569856:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789477343.166165:0:6999:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d6d465f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1876402802569856:12345-0@lo:400:kworker.0 Request processed in 35us (683us total) trans 0 rc 0/0 00000100:00100000:0.0:1789477343.166171:0:6999:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1789477343.166220:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d74e88a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3310:1876402802569856:0@lo:400:kworker.0 00000100:00100000:0.0:1789477343.166232:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d74e89f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:07d5e05c-913f-419f-adbc-d3cf15e9cd51:3310:1876402802569728:0@lo:400:kworker.0 00000100:00100000:0.0:1789477343.166241:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d753e2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3310:1876402802570240:0@lo:400:kworker.0 00000100:00080000:0.0:1789477343.166275:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789477343.172997:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d74e8b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3313:1876402802570112:0@lo:400:kworker.0 00000100:00100000:2.0:1789477343.173106:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789477343.173184:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789477343.173192:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d74e89880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1876402802569984:0@lo:400:kworker.0 00000100:00100000:2.0:1789477343.173223:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789477343.173268:0:8241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802569984 00000100:00100000:2.0:1789477343.173278:0:8241:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802569984 00000100:00100000:2.0:1789477343.173351:0:8241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1789477343.173363:0:8241:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d74f85500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3313:x1876402802569984:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789477343.173454:0:8241:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d74f85500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3313:x1876402802569984:12345-0@lo:400:kworker.0 Request processed in 93us (230us total) trans 0 rc 0/0 00000100:00100000:2.0:1789477343.173462:0:8241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00010000:00080000:2.0:1789477343.173509:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d0d74e89880 x1876402802569984/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789477359 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789477343.173524:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d74e89880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1876402802569984:0@lo:400:kworker.0 00000100:00100000:0.0:1789477343.174274:0:6999:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802570112 00000100:00100000:0.0:1789477343.174284:0:6999:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802570112 00000100:00100000:0.0:1789477343.174334:0:6999:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1789477343.174343:0:6999:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d74f87b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1876402802570112:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789477343.174435:0:6999:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d74f87b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1876402802570112:12345-0@lo:400:kworker.0 Request processed in 93us (1329us total) trans 0 rc 0/0 00000100:00100000:0.0:1789477343.174443:0:6999:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00080000:0.0:1789477343.174463:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789477343.174469:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789477343.174494:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d74e8b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3313:1876402802570112:0@lo:400:kworker.0 00010000:00010000:0.0:1789477343.924657:0:6710:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789477344.944922:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789477345.718187:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d74f86d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1876402802570368:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789477345.718300:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789477345.718379:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802570368 00000100:00100000:2.0:1789477345.718391:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802570368 00000100:00100000:2.0:1789477345.718497:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1789477345.718509:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d7f703800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1876402802570368:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789477345.718562:0:6698:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789477345.718654:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d7f703800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1876402802570368:12345-0@lo:13:osp-pre-0-0.0 Request processed in 146us (354us total) trans 0 rc 0/0 00000100:00080000:3.0:1789477345.718658:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1789477345.718704:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d0d74f86d80 x1876402802570368/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789477361 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789477345.718730:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d74f86d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1876402802570368:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789477345.719223:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00010000:00010000:0.0:1789477345.971212:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789477347.002799:0:6710:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789477347.295121:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:3.0:1789477347.295179:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:3.0:1789477347.295211:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:3.0:1789477347.295246:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:3.0:1789477347.295275:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:3.0:1789477347.295326:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783663360 00000100:00100000:3.0:1789477347.295339:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783663360 00000100:00100000:3.0:1789477347.295416:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783663232 00000100:00100000:3.0:1789477347.295420:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783663232 00000100:00100000:3.0:1789477347.295450:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 38 00000100:00100000:3.0:1789477347.295464:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d7f701f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:cf70c55a-e056-446b-8936-49e7cd31fc79+5:2353:x1876402783663360:12345-192.168.201.23@tcp:400:kworker.0 00000100:00100000:3.0:1789477347.295573:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d7f701f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:cf70c55a-e056-446b-8936-49e7cd31fc79+5:2353:x1876402783663360:12345-192.168.201.23@tcp:400:kworker.0 Request processed in 113us (360us total) trans 0 rc 0/0 00000100:00100000:3.0:1789477347.295612:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 38 00000100:00100000:3.0:1789477347.295632:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 39 00000100:00100000:3.0:1789477347.295650:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d7f702300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:cf70c55a-e056-446b-8936-49e7cd31fc79+5:2353:x1876402783663232:12345-192.168.201.23@tcp:400:kworker.0 00000100:00100000:3.0:1789477347.295680:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d7f702300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:cf70c55a-e056-446b-8936-49e7cd31fc79+5:2353:x1876402783663232:12345-192.168.201.23@tcp:400:kworker.0 Request processed in 31us (405us total) trans 0 rc 0/0 00000100:00100000:3.0:1789477347.295707:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 39 00000100:00100000:3.0:1789477347.295728:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783663104 00000100:00100000:3.0:1789477347.295732:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783663104 00000100:00100000:3.0:1789477347.295756:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783662976 00000100:00100000:3.0:1789477347.295759:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783662976 00000100:00100000:3.0:1789477347.295778:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 74 00000100:00100000:3.0:1789477347.295784:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d7f700a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cf70c55a-e056-446b-8936-49e7cd31fc79+5:2353:x1876402783663104:12345-192.168.201.23@tcp:400:kworker.0 00000100:00100000:3.0:1789477347.295812:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d7f700a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cf70c55a-e056-446b-8936-49e7cd31fc79+5:2353:x1876402783663104:12345-192.168.201.23@tcp:400:kworker.0 Request processed in 29us (633us total) trans 0 rc 0/0 00000100:00100000:3.0:1789477347.295818:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 74 00000100:00100000:3.0:1789477347.295828:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 75 00000100:00100000:3.0:1789477347.295833:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d7f703b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9bc33f26-0aab-4a14-832f-c58d566de1b0+6:2353:x1876402783662976:12345-192.168.201.23@tcp:400:kworker.0 00000100:00100000:3.0:1789477347.295851:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d7f703b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9bc33f26-0aab-4a14-832f-c58d566de1b0+6:2353:x1876402783662976:12345-192.168.201.23@tcp:400:kworker.0 Request processed in 18us (605us total) trans 0 rc 0/0 00000100:00100000:3.0:1789477347.295856:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 75 00000100:00080000:3.0:1789477347.295874:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789477347.295879:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789477347.295881:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789477347.297083:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783662848 00000100:00100000:2.0:1789477347.297099:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783662848 00000100:00100000:2.0:1789477347.297167:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 224 00000100:00100000:2.0:1789477347.297178:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d44523450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5c82dded-6a10-4ce8-abd1-52bd956b9523+13:2353:x1876402783662848:12345-192.168.201.23@tcp:400:kworker.0 00000100:00100000:2.0:1789477347.297252:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d44523450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5c82dded-6a10-4ce8-abd1-52bd956b9523+13:2353:x1876402783662848:12345-192.168.201.23@tcp:400:kworker.0 Request processed in 77us (2146us total) trans 0 rc 0/0 00000100:00100000:2.0:1789477347.297261:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 224 00010000:00010000:1.0:1789477348.016528:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789477348.274449:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789477348.274487:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d74f84e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1876402802570496:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789477348.274626:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789477348.277941:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802570496 00000100:00100000:2.0:1789477348.277967:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802570496 00000100:00100000:2.0:1789477348.278069:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1789477348.278085:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d6d465880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1876402802570496:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789477348.278461:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d753e0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:07d5e05c-913f-419f-adbc-d3cf15e9cd51:3313:1876402802570624:0@lo:400:kworker.0 00000100:00100000:1.0:1789477348.278555:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00000024:2.0:1789477348.278836:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789477348.278903:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d6d465880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1876402802570496:12345-0@lo:13:osp-pre-1-0.0 Request processed in 822us (4285us total) trans 0 rc 0/0 00000100:00100000:2.0:1789477348.278913:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00080000:2.0:1789477348.278945:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789477348.280043:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d753e1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3313:1876402802571136:0@lo:400:kworker.0 00000100:00100000:1.0:1789477348.280103:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:1.0:1789477348.280173:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d0d74f84e00 x1876402802570496/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789477364 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789477348.280200:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d74f84e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1876402802570496:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789477348.280228:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789477348.280235:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d753e3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3313:1876402802571008:0@lo:400:kworker.0 00000100:00100000:1.0:1789477348.280262:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789477348.282051:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802570624 00000100:00100000:0.0:1789477348.282072:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802570624 00000100:00100000:0.0:1789477348.282135:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 225 00000100:00100000:0.0:1789477348.282158:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d44521850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07d5e05c-913f-419f-adbc-d3cf15e9cd51+19:3313:x1876402802570624:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789477348.282260:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d44521850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07d5e05c-913f-419f-adbc-d3cf15e9cd51+19:3313:x1876402802570624:12345-0@lo:400:kworker.0 Request processed in 104us (3704us total) trans 0 rc 0/0 00000100:00100000:0.0:1789477348.282268:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 225 00000100:00100000:0.0:1789477348.282355:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d753e2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1876402802570880:0@lo:400:kworker.0 00000100:00100000:0.0:1789477348.282401:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789477348.282438:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789477348.282446:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d753e1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3311:1876402802570752:0@lo:400:kworker.0 00000100:00100000:0.0:1789477348.282473:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789477348.282506:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802570880 00000100:00100000:0.0:1789477348.282510:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802570880 00000100:00100000:0.0:1789477348.282558:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1789477348.282565:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d75411c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3311:x1876402802570880:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789477348.282634:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d75411c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3311:x1876402802570880:12345-0@lo:400:kworker.0 Request processed in 57us (220us total) trans 0 rc 0/0 00000100:00100000:0.0:1789477348.282642:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1789477348.283078:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802571136 00000100:00100000:0.0:1789477348.283085:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802571136 00000100:00100000:0.0:1789477348.283116:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802571008 00000100:00100000:0.0:1789477348.283147:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802571008 00000100:00100000:0.0:1789477348.283166:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802570752 00000100:00100000:0.0:1789477348.283169:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802570752 00000100:00100000:0.0:1789477348.283182:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1789477348.283187:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d753e2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1876402802571136:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789477348.283233:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d753e2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1876402802571136:12345-0@lo:400:kworker.0 Request processed in 46us (3130us total) trans 0 rc 0/0 00000100:00100000:0.0:1789477348.283240:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1789477348.283252:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1789477348.283258:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d753e0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1876402802571008:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789477348.283283:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d753e0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1876402802571008:12345-0@lo:400:kworker.0 Request processed in 27us (3021us total) trans 0 rc 0/0 00000100:00100000:0.0:1789477348.283289:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1789477348.283312:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1789477348.283317:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d6d467800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1876402802570752:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789477348.283342:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d6d467800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1876402802570752:12345-0@lo:400:kworker.0 Request processed in 26us (868us total) trans 0 rc 0/0 00000100:00100000:0.0:1789477348.283348:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1789477348.283401:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d753e1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3311:1876402802570752:0@lo:400:kworker.0 00010000:00080000:0.0:1789477348.283417:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d0d753e2680 x1876402802570880/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789477364 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789477348.283429:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d753e2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1876402802570880:0@lo:400:kworker.0 00000100:00100000:0.0:1789477348.283515:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d753e3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3313:1876402802571008:0@lo:400:kworker.0 00000100:00100000:0.0:1789477348.283526:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d753e0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:07d5e05c-913f-419f-adbc-d3cf15e9cd51:3313:1876402802570624:0@lo:400:kworker.0 00000100:00100000:0.0:1789477348.283549:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d753e1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3313:1876402802571136:0@lo:400:kworker.0 00000100:00080000:2.0:1789477348.289533:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789477348.289547:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1789477349.042822:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789477350.066058:0:6710:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789477350.834423:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d7f701500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1876402802571264:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789477350.834528:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789477350.838805:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802571264 00000100:00100000:3.0:1789477350.838832:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802571264 00000100:00100000:3.0:1789477350.838970:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1789477350.838986:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d753e3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1876402802571264:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789477350.839047:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789477350.839160:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d753e3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1876402802571264:12345-0@lo:13:osp-pre-0-0.0 Request processed in 179us (4633us total) trans 0 rc 0/0 00000100:00100000:3.0:1789477350.839187:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00080000:3.0:1789477350.839216:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1789477350.839549:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d0d7f701500 x1876402802571264/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789477366 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789477350.839604:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d7f701500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1876402802571264:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1789477351.087834:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789477352.114894:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789477352.424867:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:1.0:1789477352.424927:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:0.0:1789477352.424935:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783663616 00000100:00100000:1.0:1789477352.424958:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:0.0:1789477352.424962:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783663616 00000100:00100000:1.0:1789477352.425000:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:1.0:1789477352.425039:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:1.0:1789477352.425098:0:6999:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783663744 00000100:00100000:0.0:1789477352.425117:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 79 00000100:00100000:1.0:1789477352.425122:0:6999:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783663744 00000100:00100000:0.0:1789477352.425140:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d753e0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9bc33f26-0aab-4a14-832f-c58d566de1b0+6:2353:x1876402783663616:12345-192.168.201.23@tcp:400:kworker.0 00000100:00100000:1.0:1789477352.425191:0:6999:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 80 00000100:00100000:1.0:1789477352.425230:0:6999:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d753e0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cf70c55a-e056-446b-8936-49e7cd31fc79+5:2353:x1876402783663744:12345-192.168.201.23@tcp:400:kworker.0 00000100:00100000:0.0:1789477352.425269:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d753e0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9bc33f26-0aab-4a14-832f-c58d566de1b0+6:2353:x1876402783663616:12345-192.168.201.23@tcp:400:kworker.0 Request processed in 135us (413us total) trans 0 rc 0/0 00000100:00100000:0.0:1789477352.425279:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 79 00000100:00100000:1.0:1789477352.425300:0:6999:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d753e0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cf70c55a-e056-446b-8936-49e7cd31fc79+5:2353:x1876402783663744:12345-192.168.201.23@tcp:400:kworker.0 Request processed in 97us (340us total) trans 0 rc 0/0 00000100:00100000:1.0:1789477352.425311:0:6999:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 80 00000100:00080000:0.0:1789477352.425318:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789477352.425352:0:8241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783663872 00000100:00100000:1.0:1789477352.425358:0:8241:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783663872 00000100:00100000:1.0:1789477352.425407:0:8241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783664000 00000100:00100000:1.0:1789477352.425411:0:8241:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783664000 00000100:00100000:1.0:1789477352.425438:0:8241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 15 00000100:00100000:1.0:1789477352.425446:0:8241:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d753e1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:cf70c55a-e056-446b-8936-49e7cd31fc79+5:2351:x1876402783663872:12345-192.168.201.23@tcp:9:kworker.0 00000020:00000080:1.0:1789477352.425471:0:8241:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xafddb3c8f928174c 00000100:00080000:1.0:1789477352.425485:0:8241:0:(import.c:65:import_set_state_nolock()) ffff9d0d7c06e000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1789477352.425541:0:8241:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:0.0:1789477352.425552:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 16 00000100:00100000:0.0:1789477352.425565:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d753e3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:cf70c55a-e056-446b-8936-49e7cd31fc79+5:2351:x1876402783664000:12345-192.168.201.23@tcp:9:kworker.0 00000020:00000080:0.0:1789477352.425630:0:6696:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xafddb3c8f9281753 00000100:00080000:0.0:1789477352.425642:0:6696:0:(import.c:65:import_set_state_nolock()) ffff9d0d7f52a800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1789477352.425684:0:6696:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:1.0:1789477352.426145:0:8241:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d753e1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:cf70c55a-e056-446b-8936-49e7cd31fc79+2:2351:x1876402783663872:12345-192.168.201.23@tcp:9:kworker.0 Request processed in 694us (1140us total) trans 0 rc 0/0 00000100:00100000:1.0:1789477352.426155:0:8241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 15 00010000:00010000:1.0:1789477352.426200:0:6710:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789477352.426260:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d753e3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:cf70c55a-e056-446b-8936-49e7cd31fc79+2:2351:x1876402783664000:12345-192.168.201.23@tcp:9:kworker.0 Request processed in 696us (1218us total) trans 0 rc 0/0 00000100:00100000:0.0:1789477352.426269:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 16 00010000:00010000:0.0:1789477352.426294:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1789477352.426375:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789477352.426378:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789477352.426741:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783663488 00000100:00100000:2.0:1789477352.426749:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783663488 00000100:00100000:2.0:1789477352.426786:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 226 00000100:00100000:2.0:1789477352.426794:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d44521050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5c82dded-6a10-4ce8-abd1-52bd956b9523+13:2353:x1876402783663488:12345-192.168.201.23@tcp:400:kworker.0 00000100:00100000:2.0:1789477352.426825:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d44521050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5c82dded-6a10-4ce8-abd1-52bd956b9523+13:2353:x1876402783663488:12345-192.168.201.23@tcp:400:kworker.0 Request processed in 32us (1901us total) trans 0 rc 0/0 00000100:00100000:2.0:1789477352.426831:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 226 00010000:00010000:3.0:1789477353.153935:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789477353.410082:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d753e3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3313:1876402802571648:0@lo:400:kworker.0 00000100:00100000:1.0:1789477353.410142:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d753e0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1876402802571392:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789477353.410703:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789477353.410871:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789477353.410904:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d753e0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1876402802572160:0@lo:400:kworker.0 00000100:00100000:1.0:1789477353.411002:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d753e1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3311:1876402802571904:0@lo:400:kworker.0 00000100:00100000:1.0:1789477353.411043:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789477353.411087:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789477353.411094:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d753e2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1876402802571776:0@lo:400:kworker.0 00000100:00100000:1.0:1789477353.411123:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789477353.411185:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d753e1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:07d5e05c-913f-419f-adbc-d3cf15e9cd51:3312:1876402802571520:0@lo:400:kworker.0 00000100:00100000:1.0:1789477353.411233:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789477353.411260:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d753e1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3312:1876402802572032:0@lo:400:kworker.0 00000100:00100000:1.0:1789477353.411282:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789477353.411370:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802571392 00000100:00100000:1.0:1789477353.411386:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802571392 00000100:00100000:1.0:1789477353.411473:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1789477353.411486:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d753e3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1876402802571392:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789477353.411524:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00000024:1.0:1789477353.411547:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789477353.411567:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802571648 00000100:00100000:0.0:1789477353.411571:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802571648 00000100:00100000:0.0:1789477353.411631:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802571904 00000100:00100000:0.0:1789477353.411635:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802571904 00000100:00100000:0.0:1789477353.411650:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802572032 00000100:00100000:0.0:1789477353.411652:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802572032 00000100:00100000:0.0:1789477353.411668:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1789477353.411675:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d6d466680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1876402802571648:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789477353.411710:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d6d466680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1876402802571648:12345-0@lo:400:kworker.0 Request processed in 36us (840us total) trans 0 rc 0/0 00000100:00100000:0.0:1789477353.411719:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1789477353.411743:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1789477353.411749:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d753e2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1876402802571904:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789477353.411774:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d753e3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1876402802571392:12345-0@lo:13:osp-pre-1-0.0 Request processed in 221us (1004us total) trans 0 rc 0/0 00000100:00100000:0.0:1789477353.411776:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d753e2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1876402802571904:12345-0@lo:400:kworker.0 Request processed in 28us (732us total) trans 0 rc 0/0 00000100:00100000:1.0:1789477353.411782:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1789477353.411805:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1789477353.411813:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d753e2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1876402802572032:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789477353.411854:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d753e2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1876402802572032:12345-0@lo:400:kworker.0 Request processed in 43us (571us total) trans 0 rc 0/0 00000100:00100000:1.0:1789477353.411861:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1789477353.411888:0:8241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802571776 00000100:00100000:1.0:1789477353.411892:0:8241:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802571776 00000100:00100000:1.0:1789477353.411922:0:8241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802572160 00000100:00100000:1.0:1789477353.411926:0:8241:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802572160 00000100:00100000:1.0:1789477353.411947:0:8241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1789477353.411954:0:8241:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d753e1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3311:x1876402802571776:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789477353.411986:0:8241:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d753e1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3311:x1876402802571776:12345-0@lo:400:kworker.0 Request processed in 32us (862us total) trans 0 rc 0/0 00000100:00100000:1.0:1789477353.411992:0:8241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1789477353.412003:0:8241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1789477353.412023:0:8241:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d6d467480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3313:x1876402802572160:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789477353.412052:0:8241:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d6d467480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3313:x1876402802572160:12345-0@lo:400:kworker.0 Request processed in 31us (528us total) trans 0 rc 0/0 00000100:00100000:1.0:1789477353.412058:0:8241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1789477353.412080:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802571520 00000100:00100000:1.0:1789477353.412084:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802571520 00000100:00100000:1.0:1789477353.412110:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 227 00000100:00100000:1.0:1789477353.412116:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d595f4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07d5e05c-913f-419f-adbc-d3cf15e9cd51+19:3312:x1876402802571520:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789477353.412152:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d595f4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07d5e05c-913f-419f-adbc-d3cf15e9cd51+19:3312:x1876402802571520:12345-0@lo:400:kworker.0 Request processed in 36us (918us total) trans 0 rc 0/0 00000100:00100000:1.0:1789477353.412158:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 227 00000100:00080000:1.0:1789477353.412192:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789477353.412197:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789477353.412199:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1789477353.412258:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d0d753e2300 x1876402802571776/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789477369 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789477353.412277:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d753e2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1876402802571776:0@lo:400:kworker.0 00010000:00080000:1.0:1789477353.412292:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d0d753e0a80 x1876402802571392/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789477369 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789477353.412481:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d753e0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1876402802571392:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789477353.412500:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d753e1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3311:1876402802571904:0@lo:400:kworker.0 00000100:00100000:1.0:1789477353.412536:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d753e1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:07d5e05c-913f-419f-adbc-d3cf15e9cd51:3312:1876402802571520:0@lo:400:kworker.0 00000100:00100000:1.0:1789477353.412547:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d753e1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3312:1876402802572032:0@lo:400:kworker.0 00000100:00100000:0.0:1789477353.413375:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1789477353.413540:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d753e3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3313:1876402802571648:0@lo:400:kworker.0 00010000:00080000:0.0:1789477353.413567:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d0d753e0e00 x1876402802572160/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789477369 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789477353.413599:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d753e0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1876402802572160:0@lo:400:kworker.0 00000001:00100000:0.0:1789477353.481944:0:7678:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of cf70c55a-e056-446b-8936-49e7cd31fc79 00000020:00000080:0.0:1789477353.481959:0:7678:0:(genops.c:885:class_export_put()) final put ffff9d0d7f52b000/cf70c55a-e056-446b-8936-49e7cd31fc79 00000020:00000080:0.0:1789477353.482004:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9d0d7f52b000/cf70c55a-e056-446b-8936-49e7cd31fc79 for lustre-OST0001 00000020:00000080:0.0:1789477353.482083:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9d0d7f52a800 for lustre-OST0001 00000001:00100000:2.0:1789477354.009571:0:6730:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of cf70c55a-e056-446b-8936-49e7cd31fc79 00000020:00000080:2.0:1789477354.009611:0:6730:0:(genops.c:885:class_export_put()) final put ffff9d0d7c06d000/cf70c55a-e056-446b-8936-49e7cd31fc79 00000020:00000080:2.0:1789477354.009647:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9d0d7c06d000/cf70c55a-e056-446b-8936-49e7cd31fc79 for lustre-OST0000 00000020:00000080:2.0:1789477354.009701:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9d0d7c06e000 for lustre-OST0000 00010000:00010000:1.0:1789477354.163178:0:6710:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789477355.191826:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789477355.956760:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789477355.956795:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d753e1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1876402802572288:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789477355.956914:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789477355.957003:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802572288 00000100:00100000:1.0:1789477355.957013:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802572288 00000100:00100000:1.0:1789477355.957086:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1789477355.957097:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d753e1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1876402802572288:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789477355.957149:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789477355.957214:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d753e1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1876402802572288:12345-0@lo:13:osp-pre-0-0.0 Request processed in 118us (299us total) trans 0 rc 0/0 00000100:00100000:1.0:1789477355.957222:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00080000:1.0:1789477355.957246:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1789477355.957285:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d0d753e1c00 x1876402802572288/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789477371 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789477355.957307:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d753e1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1876402802572288:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1789477356.218349:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789477357.233463:0:6710:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789477357.542197:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:2.0:1789477357.542518:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:2.0:1789477357.542561:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:2.0:1789477357.542641:0:6999:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783664256 00000100:00100000:2.0:1789477357.542652:0:6999:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783664256 00000100:00100000:0.0:1789477357.542712:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783664128 00000100:00100000:2.0:1789477357.542714:0:6999:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783664384 00000100:00100000:2.0:1789477357.542717:0:6999:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783664384 00000100:00100000:0.0:1789477357.542717:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783664128 00000100:00100000:2.0:1789477357.542742:0:6999:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 84 00000100:00100000:2.0:1789477357.542753:0:6999:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d7f702d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9bc33f26-0aab-4a14-832f-c58d566de1b0+6:2354:x1876402783664256:12345-192.168.201.23@tcp:400:kworker.0 00000100:00100000:0.0:1789477357.542763:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 228 00000100:00100000:0.0:1789477357.542769:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d44520850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5c82dded-6a10-4ce8-abd1-52bd956b9523+13:2354:x1876402783664128:12345-192.168.201.23@tcp:400:kworker.0 00000100:00100000:0.0:1789477357.542834:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d44520850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5c82dded-6a10-4ce8-abd1-52bd956b9523+13:2354:x1876402783664128:12345-192.168.201.23@tcp:400:kworker.0 Request processed in 66us (318us total) trans 0 rc 0/0 00000100:00100000:0.0:1789477357.542842:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 228 00000100:00100000:1.0:1789477357.542857:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 85 00000100:00100000:1.0:1789477357.542865:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d74f85180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cf70c55a-e056-446b-8936-49e7cd31fc79+5:2354:x1876402783664384:12345-192.168.201.23@tcp:400:kworker.0 00000100:00100000:2.0:1789477357.543010:0:6999:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d7f702d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9bc33f26-0aab-4a14-832f-c58d566de1b0+6:2354:x1876402783664256:12345-192.168.201.23@tcp:400:kworker.0 Request processed in 258us (825us total) trans 0 rc 0/0 00000100:00100000:2.0:1789477357.543024:0:6999:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 84 00000100:00080000:2.0:1789477357.543042:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789477357.551024:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d74f85180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cf70c55a-e056-446b-8936-49e7cd31fc79+5:2354:x1876402783664384:12345-192.168.201.23@tcp:400:kworker.0 Request processed in 8146us (8448us total) trans 0 rc 0/0 00000100:00100000:1.0:1789477357.551040:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 85 00000001:02000400:0.0:1789477357.929265:0:11051:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:0.0:1789477358.255889:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789477358.512756:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d7f700e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1876402802572416:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789477358.512862:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789477358.512970:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802572416 00000100:00100000:3.0:1789477358.512979:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802572416 00000100:00100000:3.0:1789477358.513054:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1789477358.513066:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d7f701180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1876402802572416:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789477358.513105:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789477358.513172:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d7f701180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1876402802572416:12345-0@lo:13:osp-pre-1-0.0 Request processed in 108us (309us total) trans 0 rc 0/0 00000100:00100000:3.0:1789477358.513180:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00010000:00080000:3.0:1789477358.513237:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d0d7f700e00 x1876402802572416/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789477374 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789477358.513256:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d7f700e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1876402802572416:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789477358.516509:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d6d466d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1876402802572800:0@lo:400:kworker.0 00000100:00100000:0.0:1789477358.516606:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789477358.516686:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789477358.516699:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d6d464e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3310:1876402802572928:0@lo:400:kworker.0 00000100:00100000:2.0:1789477358.516710:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d6d464700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:07d5e05c-913f-419f-adbc-d3cf15e9cd51:3312:1876402802572544:0@lo:400:kworker.0 00000100:00100000:0.0:1789477358.516741:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789477358.516791:0:8241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802572800 00000100:00100000:0.0:1789477358.516799:0:8241:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802572800 00000100:00100000:2.0:1789477358.516810:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789477358.516866:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d7f73a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3312:1876402802573056:0@lo:400:kworker.0 00000100:00100000:0.0:1789477358.516879:0:8241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1789477358.516895:0:8241:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d7f738a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3310:x1876402802572800:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789477358.516906:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789477358.516947:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789477358.516970:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d6d466300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3312:1876402802572672:0@lo:400:kworker.0 00000100:00100000:0.0:1789477358.516982:0:8241:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d7f738a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3310:x1876402802572800:12345-0@lo:400:kworker.0 Request processed in 86us (371us total) trans 0 rc 0/0 00000100:00100000:0.0:1789477358.516992:0:8241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1789477358.517014:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1789477358.517105:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789477358.517123:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789477358.517184:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802572544 00000100:00100000:1.0:1789477358.517189:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802572544 00000100:00100000:1.0:1789477358.517224:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 229 00000100:00100000:1.0:1789477358.517232:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d44522850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:07d5e05c-913f-419f-adbc-d3cf15e9cd51+19:3312:x1876402802572544:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789477358.517314:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d44522850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:07d5e05c-913f-419f-adbc-d3cf15e9cd51+19:3312:x1876402802572544:12345-0@lo:400:kworker.0 Request processed in 84us (507us total) trans 0 rc 0/0 00000100:00100000:1.0:1789477358.517321:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 229 00000100:00100000:1.0:1789477358.517453:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d6d464700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:07d5e05c-913f-419f-adbc-d3cf15e9cd51:3312:1876402802572544:0@lo:400:kworker.0 00000100:00100000:0.0:1789477358.517863:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802572928 00000100:00100000:0.0:1789477358.517869:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802572928 00000100:00100000:0.0:1789477358.517907:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802573056 00000100:00100000:0.0:1789477358.517910:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802573056 00000100:00100000:0.0:1789477358.517923:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802572672 00000100:00100000:0.0:1789477358.517926:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802572672 00000100:00100000:0.0:1789477358.517949:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1789477358.517955:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d7f73a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1876402802572928:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789477358.517996:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d7f73a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1876402802572928:12345-0@lo:400:kworker.0 Request processed in 41us (1256us total) trans 0 rc 0/0 00000100:00100000:0.0:1789477358.518003:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1789477358.518015:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1789477358.518021:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d74f86680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1876402802573056:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789477358.518055:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d74f86680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1876402802573056:12345-0@lo:400:kworker.0 Request processed in 35us (1151us total) trans 0 rc 0/0 00000100:00100000:0.0:1789477358.518061:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1789477358.518072:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1789477358.518077:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d74f87100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1876402802572672:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789477358.518101:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d74f87100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1876402802572672:12345-0@lo:400:kworker.0 Request processed in 24us (1090us total) trans 0 rc 0/0 00000100:00100000:0.0:1789477358.518106:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00080000:0.0:1789477358.518243:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789477358.518268:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d6d464e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3310:1876402802572928:0@lo:400:kworker.0 00010000:00080000:0.0:1789477358.518283:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d0d6d466d80 x1876402802572800/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789477374 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789477358.518293:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d6d466d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1876402802572800:0@lo:400:kworker.0 00000100:00100000:0.0:1789477358.518321:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d6d466300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3312:1876402802572672:0@lo:400:kworker.0 00000100:00100000:0.0:1789477358.518331:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d7f73a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3312:1876402802573056:0@lo:400:kworker.0 00010000:00010000:0.0:1789477359.279856:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789477360.303967:0:6710:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789477361.075224:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d753e1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1876402802573184:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789477361.075332:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789477361.075444:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802573184 00000100:00100000:3.0:1789477361.075454:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802573184 00000100:00100000:3.0:1789477361.075513:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1789477361.075523:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d7f700e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1876402802573184:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789477361.075560:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789477361.075695:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d7f700e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1876402802573184:12345-0@lo:13:osp-pre-0-0.0 Request processed in 173us (362us total) trans 0 rc 0/0 00000100:00100000:3.0:1789477361.075702:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00080000:3.0:1789477361.075728:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1789477361.075758:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d0d753e1c00 x1876402802573184/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789477377 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789477361.075776:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d753e1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1876402802573184:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1789477361.328987:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1789477361.776359:0:11201:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffcf78a90f0 20000000:00000080:0.0:1789477361.776506:0:11201:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9d0d5806b400 uarg=0000000000000000 20000000:01000000:0.0:1789477361.776679:0:11201:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:0.0:1789477361.776685:0:11201:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:0.0:1789477361.776690:0:11201:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:3.0:1789477361.778818:0:11202:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 7 20000000:00000400:0.0:1789477361.779291:0:11201:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:0.0:1789477361.787713:0:11201:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1789477361.787746:0:11201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9d0d82151c00/0xafddb3c8f928175a lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477361.787765:0:11201:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9d0d49ecbc00/0xafddb3c8f9281706 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xafddb3c8f92816ff expref: 18 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477361.787773:0:11201:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9d0d82150800/0xafddb3c8f9281714 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xafddb3c8f928170d expref: 18 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477361.787779:0:11201:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9d0d59d6a800/0xafddb3c8f9281722 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xafddb3c8f928171b expref: 18 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477361.787788:0:11201:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9d0d49eca600/0xafddb3c8f9281729 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f29ee expref: 12 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477361.787794:0:11201:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9d0d82151200/0xafddb3c8f928173e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2a26 expref: 12 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477361.787802:0:11201:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9d0d82151c00/0xafddb3c8f928175a lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 11201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477361.787912:0:11201:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9d0d82151200/0xafddb3c8f928173e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2a26 expref: 12 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477361.788005:0:11201:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9d0d82151200/0xafddb3c8f928173e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2a26 expref: 12 pid: 5839 timeout: 406 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789477361.788021:0:11201:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d7f73a680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11201:1876402802573312:192.168.201.23@tcp:104: 00010000:00010000:0.0:1789477361.788206:0:11201:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9d0d49eca600/0xafddb3c8f9281729 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f29ee expref: 12 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477361.788216:0:11201:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9d0d49eca600/0xafddb3c8f9281729 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f29ee expref: 12 pid: 5837 timeout: 406 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789477361.788226:0:11201:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d7f73ad80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11201:1876402802573440:192.168.201.23@tcp:104: 00010000:00010000:0.0:1789477361.788260:0:11201:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9d0d59d6a800/0xafddb3c8f9281722 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xafddb3c8f928171b expref: 18 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477361.788268:0:11201:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9d0d59d6a800/0xafddb3c8f9281722 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xafddb3c8f928171b expref: 18 pid: 5837 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789477361.788277:0:11201:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d7f738380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11201:1876402802573568:0@lo:104: 00000100:00100000:0.0:1789477361.788320:0:11201:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789477361.788367:0:11201:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9d0d82150800/0xafddb3c8f9281714 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xafddb3c8f928170d expref: 18 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477361.788386:0:11201:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9d0d82150800/0xafddb3c8f9281714 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xafddb3c8f928170d expref: 18 pid: 5838 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789477361.788395:0:11201:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d7bddd500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11201:1876402802573696:0@lo:104: 00000100:00100000:0.0:1789477361.788416:0:11201:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789477361.788467:0:11201:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9d0d49ecbc00/0xafddb3c8f9281706 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xafddb3c8f92816ff expref: 18 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477361.788476:0:11201:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9d0d49ecbc00/0xafddb3c8f9281706 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xafddb3c8f92816ff expref: 18 pid: 5838 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789477361.788484:0:11201:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d7bddd880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11201:1876402802573824:0@lo:104: 00000100:00100000:0.0:1789477361.788505:0:11201:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789477361.788516:0:11201:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d0d7f6e0000 going to sleep for 11 seconds 00000100:00100000:3.0:1789477361.788614:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802573568 00000100:00100000:3.0:1789477361.788622:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802573568 00000100:00100000:3.0:1789477361.788665:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802573696 00000100:00100000:3.0:1789477361.788667:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802573696 00000100:00100000:3.0:1789477361.788677:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802573824 00000100:00100000:3.0:1789477361.788680:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802573824 00000100:00100000:3.0:1789477361.788692:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1789477361.788701:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d7bddce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:07d5e05c-913f-419f-adbc-d3cf15e9cd51+5:11201:x1876402802573568:12345-0@lo:104: 00010000:00010000:3.0:1789477361.788714:0:5828:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.123@tcp lock: ffff9d0d49eca800/0xafddb3c8f928171b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xafddb3c8f9281722 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477361.788774:0:5828:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1789477361.788780:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d7bddce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:07d5e05c-913f-419f-adbc-d3cf15e9cd51+5:11201:x1876402802573568:12345-0@lo:104: Request processed in 80us (461us total) trans 0 rc 0/0 00000100:00100000:3.0:1789477361.788787:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1789477361.788805:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1789477361.788811:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d7bdde680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:07d5e05c-913f-419f-adbc-d3cf15e9cd51+4:11201:x1876402802573696:12345-0@lo:104: 00010000:00010000:3.0:1789477361.788818:0:5828:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.123@tcp lock: ffff9d0d49ecb200/0xafddb3c8f928170d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xafddb3c8f9281714 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477361.788874:0:5828:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1789477361.788880:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d7bdde680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:07d5e05c-913f-419f-adbc-d3cf15e9cd51+4:11201:x1876402802573696:12345-0@lo:104: Request processed in 69us (463us total) trans 0 rc 0/0 00000100:00100000:3.0:1789477361.788887:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1789477361.788902:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1789477361.788908:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d4e643480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:07d5e05c-913f-419f-adbc-d3cf15e9cd51+3:11201:x1876402802573824:12345-0@lo:104: 00010000:00010000:3.0:1789477361.788915:0:5828:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.123@tcp lock: ffff9d0d59d6b400/0xafddb3c8f92816ff lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xafddb3c8f9281706 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477361.788958:0:5828:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:3.0:1789477361.788963:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d4e643480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:07d5e05c-913f-419f-adbc-d3cf15e9cd51+3:11201:x1876402802573824:12345-0@lo:104: Request processed in 55us (458us total) trans 0 rc 0/0 00000100:00100000:3.0:1789477361.788970:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00010000:00010000:3.0:1789477361.788986:0:5833:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1789477361.788993:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.123@tcp lock: ffff9d0d49eca800/0xafddb3c8f928171b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xafddb3c8f9281722 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477361.789000:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d0d49eca800 already unused, calling callback (ffffffffc1bb3c20) 10000000:00010000:3.0:1789477361.789004:0:5833:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.123@tcp lock: ffff9d0d49eca800/0xafddb3c8f928171b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xafddb3c8f9281722 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477361.789013:0:5833:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.123@tcp lock: ffff9d0d49eca800/0xafddb3c8f928171b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xafddb3c8f9281722 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789477361.789021:0:5833:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.123@tcp lock: ffff9d0d49eca800/0xafddb3c8f928171b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xafddb3c8f9281722 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789477361.789026:0:5833:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1789477361.789074:0:5833:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.123@tcp lock: ffff9d0d49eca800/0xafddb3c8f928171b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xafddb3c8f9281722 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477361.789082:0:5833:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789477361.789106:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.123@tcp lock: ffff9d0d49eca800/0xafddb3c8f928171b lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xafddb3c8f9281722 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477361.789112:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.123@tcp lock: ffff9d0d49eca800/0xafddb3c8f928171b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xafddb3c8f9281722 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477361.789125:0:5833:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1789477361.789129:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.123@tcp lock: ffff9d0d49ecb200/0xafddb3c8f928170d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xafddb3c8f9281714 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477361.789135:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d0d49ecb200 already unused, calling callback (ffffffffc1bb3c20) 10000000:00010000:3.0:1789477361.789138:0:5833:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.123@tcp lock: ffff9d0d49ecb200/0xafddb3c8f928170d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xafddb3c8f9281714 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477361.789143:0:5833:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.123@tcp lock: ffff9d0d49ecb200/0xafddb3c8f928170d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xafddb3c8f9281714 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789477361.789149:0:5833:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.123@tcp lock: ffff9d0d49ecb200/0xafddb3c8f928170d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xafddb3c8f9281714 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789477361.789155:0:5833:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1789477361.789168:0:5833:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.123@tcp lock: ffff9d0d49ecb200/0xafddb3c8f928170d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xafddb3c8f9281714 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477361.789173:0:5833:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789477361.789178:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.123@tcp lock: ffff9d0d49ecb200/0xafddb3c8f928170d lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xafddb3c8f9281714 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477361.789193:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.123@tcp lock: ffff9d0d49ecb200/0xafddb3c8f928170d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xafddb3c8f9281714 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477361.789202:0:5833:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789477361.789205:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.123@tcp lock: ffff9d0d59d6b400/0xafddb3c8f92816ff lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xafddb3c8f9281706 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477361.789211:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d0d59d6b400 already unused, calling callback (ffffffffc1bb3c20) 10000000:00010000:3.0:1789477361.789214:0:5833:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.123@tcp lock: ffff9d0d59d6b400/0xafddb3c8f92816ff lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xafddb3c8f9281706 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477361.789221:0:5833:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.123@tcp lock: ffff9d0d59d6b400/0xafddb3c8f92816ff lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xafddb3c8f9281706 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789477361.789226:0:5833:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.123@tcp lock: ffff9d0d59d6b400/0xafddb3c8f92816ff lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xafddb3c8f9281706 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789477361.789232:0:5833:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1789477361.789246:0:5833:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.123@tcp lock: ffff9d0d59d6b400/0xafddb3c8f92816ff lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xafddb3c8f9281706 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477361.789252:0:5833:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789477361.789267:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.123@tcp lock: ffff9d0d59d6b400/0xafddb3c8f92816ff lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xafddb3c8f9281706 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477361.789274:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.123@tcp lock: ffff9d0d59d6b400/0xafddb3c8f92816ff lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xafddb3c8f9281706 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477361.789285:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789477361.789292:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789477361.789294:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789477361.789301:0:6710:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789477361.789306:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789477361.789317:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d7f702680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:07d5e05c-913f-419f-adbc-d3cf15e9cd51:3310:1876402802573952:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789477361.789350:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789477361.789371:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789477361.789376:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d7f703100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:07d5e05c-913f-419f-adbc-d3cf15e9cd51:3310:1876402802574080:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789477361.789397:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789477361.789423:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d7f701c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:07d5e05c-913f-419f-adbc-d3cf15e9cd51:3312:1876402802574208:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789477361.789445:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789477361.789575:0:11201:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d7f738380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11201:1876402802573568:0@lo:104: 00000100:00100000:0.0:1789477361.789607:0:11201:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d7bddd500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11201:1876402802573696:0@lo:104: 00000100:00100000:0.0:1789477361.789614:0:11201:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d7bddd880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11201:1876402802573824:0@lo:104: 00000100:00100000:1.0:1789477361.789684:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802573952 00000100:00100000:1.0:1789477361.789689:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802573952 00010000:00010000:1.0:1789477361.789710:0:5831:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9d0d59d6a800/0xafddb3c8f9281722 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xafddb3c8f928171b expref: 19 pid: 5837 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789477361.789737:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802574080 00000100:00100000:1.0:1789477361.789740:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802574080 00010000:00010000:1.0:1789477361.789751:0:5831:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9d0d82150800/0xafddb3c8f9281714 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xafddb3c8f928170d expref: 20 pid: 5838 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789477361.789760:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802574208 00000100:00100000:1.0:1789477361.789763:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802574208 00010000:00010000:1.0:1789477361.789771:0:5831:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9d0d49ecbc00/0xafddb3c8f9281706 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xafddb3c8f92816ff expref: 21 pid: 5838 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789477361.789781:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1789477361.789786:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d50a83450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:07d5e05c-913f-419f-adbc-d3cf15e9cd51+21:3310:x1876402802573952:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789477361.789796:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789477361.789800:0:5831:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9d0d59d6a800/0xafddb3c8f9281722 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xafddb3c8f928171b expref: 21 pid: 5837 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477361.789810:0:5831:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9d0d59d6a800/0xafddb3c8f9281722 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xafddb3c8f928171b expref: 21 pid: 5837 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477361.789822:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d0d59d6a800/0xafddb3c8f9281722 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xafddb3c8f928171b expref: 21 pid: 5837 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477361.789842:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789477361.789873:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d50a83450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:07d5e05c-913f-419f-adbc-d3cf15e9cd51+20:3310:x1876402802573952:12345-0@lo:103:ldlm_bl.0 Request processed in 86us (523us total) trans 0 rc 0/0 00000100:00100000:1.0:1789477361.789879:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1789477361.789917:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1789477361.789923:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d7f702a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:07d5e05c-913f-419f-adbc-d3cf15e9cd51+19:3310:x1876402802574080:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789477361.789930:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789477361.789934:0:5831:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9d0d82150800/0xafddb3c8f9281714 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xafddb3c8f928170d expref: 19 pid: 5838 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477361.789943:0:5831:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9d0d82150800/0xafddb3c8f9281714 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xafddb3c8f928170d expref: 19 pid: 5838 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477361.789953:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d0d82150800/0xafddb3c8f9281714 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xafddb3c8f928170d expref: 19 pid: 5838 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477361.789962:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789477361.789981:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d7f702a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:07d5e05c-913f-419f-adbc-d3cf15e9cd51+18:3310:x1876402802574080:12345-0@lo:103:ldlm_bl.0 Request processed in 59us (584us total) trans 0 rc 0/0 00000100:00100000:1.0:1789477361.789986:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1789477361.789998:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1789477361.790003:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d7f700380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:07d5e05c-913f-419f-adbc-d3cf15e9cd51+17:3312:x1876402802574208:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789477361.790009:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789477361.790012:0:5831:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9d0d49ecbc00/0xafddb3c8f9281706 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xafddb3c8f92816ff expref: 17 pid: 5838 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477361.790019:0:5831:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9d0d49ecbc00/0xafddb3c8f9281706 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xafddb3c8f92816ff expref: 17 pid: 5838 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477361.790034:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d0d49ecbc00/0xafddb3c8f9281706 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xafddb3c8f92816ff expref: 17 pid: 5838 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477361.790041:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789477361.790082:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d7f700380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:07d5e05c-913f-419f-adbc-d3cf15e9cd51+16:3312:x1876402802574208:12345-0@lo:103:ldlm_bl.0 Request processed in 78us (636us total) trans 0 rc 0/0 00000100:00100000:1.0:1789477361.790088:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1789477361.790112:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d7f701c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:07d5e05c-913f-419f-adbc-d3cf15e9cd51:3312:1876402802574208:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789477361.790133:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d7f703100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:07d5e05c-913f-419f-adbc-d3cf15e9cd51:3310:1876402802574080:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789477361.790139:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d7f702680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:07d5e05c-913f-419f-adbc-d3cf15e9cd51:3310:1876402802573952:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789477361.796156:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:2.0:1789477361.796243:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:1.0:1789477361.796312:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783664512 00000100:00100000:1.0:1789477361.796322:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783664512 00010000:00010000:1.0:1789477361.796363:0:5831:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9d0d82151200/0xafddb3c8f928173e lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2a26 expref: 13 pid: 5839 timeout: 406 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789477361.796407:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783664640 00000100:00100000:1.0:1789477361.796411:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783664640 00010000:00010000:1.0:1789477361.796426:0:5831:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9d0d49eca600/0xafddb3c8f9281729 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f29ee expref: 14 pid: 5837 timeout: 406 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789477361.796450:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 28 00000100:00100000:1.0:1789477361.796459:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d74f85c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5c82dded-6a10-4ce8-abd1-52bd956b9523+14:2354:x1876402783664512:12345-192.168.201.23@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789477361.796473:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789477361.796480:0:5831:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9d0d82151200/0xafddb3c8f928173e lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2a26 expref: 14 pid: 5839 timeout: 406 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477361.796530:0:5831:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9d0d82151200/0xafddb3c8f928173e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2a26 expref: 14 pid: 5839 timeout: 406 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477361.796552:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789477361.796635:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d74f85c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5c82dded-6a10-4ce8-abd1-52bd956b9523+14:2354:x1876402783664512:12345-192.168.201.23@tcp:103:ldlm_bl.0 Request processed in 175us (500us total) trans 0 rc 0/0 00000100:00100000:1.0:1789477361.796643:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 28 00000100:00100000:1.0:1789477361.796660:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 29 00000100:00100000:1.0:1789477361.796667:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d74f86a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5c82dded-6a10-4ce8-abd1-52bd956b9523+13:2355:x1876402783664640:12345-192.168.201.23@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789477361.796724:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789477361.796729:0:5831:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9d0d49eca600/0xafddb3c8f9281729 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f29ee expref: 13 pid: 5837 timeout: 406 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477361.796791:0:5831:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9d0d49eca600/0xafddb3c8f9281729 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f29ee expref: 13 pid: 5837 timeout: 406 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477361.796803:0:5831:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9d0d82151c00/0xafddb3c8f928175a lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 11201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477361.796811:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d0d82151c00/0xafddb3c8f928175a lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 11201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477361.796827:0:5831:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9d0d82151c00/0xafddb3c8f928175a lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477361.796834:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9d0d82151c00/0xafddb3c8f928175a lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477361.796840:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9d0d82151c00/0xafddb3c8f928175a lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477361.796851:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9d0d82151c00/0xafddb3c8f928175a lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477361.796858:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d0d82151c00 already unused, calling callback (ffffffffc15972a0) 00010000:00010000:1.0:1789477361.796863:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9d0d82151c00/0xafddb3c8f928175a lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477361.796871:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9d0d82151c00/0xafddb3c8f928175a lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 11201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477361.796878:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9d0d82151c00/0xafddb3c8f928175a lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477361.796887:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789477361.796904:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d74f86a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5c82dded-6a10-4ce8-abd1-52bd956b9523+13:2355:x1876402783664640:12345-192.168.201.23@tcp:103:ldlm_bl.0 Request processed in 238us (662us total) trans 0 rc 0/0 00000100:00100000:1.0:1789477361.796909:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 29 00010000:00010000:0.0:1789477361.797091:0:11201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d0d82151200/0xafddb3c8f928173e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2a26 expref: 12 pid: 5839 timeout: 406 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789477361.797105:0:11201:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d7f73a680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11201:1876402802573312:192.168.201.23@tcp:104: 00010000:00010000:0.0:1789477361.797116:0:11201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d0d49eca600/0xafddb3c8f9281729 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f29ee expref: 11 pid: 5837 timeout: 406 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789477361.797126:0:11201:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d7f73ad80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11201:1876402802573440:192.168.201.23@tcp:104: 00010000:00010000:0.0:1789477361.797159:0:11201:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9d0d82151c00/0xafddb3c8f928175a lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477361.797168:0:11201:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9d0d82151c00/0xafddb3c8f928175a lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477361.797175:0:11201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9d0d82151c00/0xafddb3c8f928175a lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477361.797192:0:11201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d0d82151c00/0xafddb3c8f928175a lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477362.353638:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789477362.658505:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:2.0:1789477362.658615:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:0.0:1789477362.658741:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783664768 00000100:00100000:0.0:1789477362.658752:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783664768 00000100:00100000:0.0:1789477362.658814:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 230 00000100:00100000:0.0:1789477362.658825:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d44520c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5c82dded-6a10-4ce8-abd1-52bd956b9523+11:2353:x1876402783664768:12345-192.168.201.23@tcp:400:kworker.0 00000100:00100000:0.0:1789477362.658897:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d44520c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5c82dded-6a10-4ce8-abd1-52bd956b9523+11:2353:x1876402783664768:12345-192.168.201.23@tcp:400:kworker.0 Request processed in 74us (401us total) trans 0 rc 0/0 00000100:00100000:0.0:1789477362.658913:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 230 00000100:00100000:2.0:1789477362.659164:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:1.0:1789477362.664910:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783665024 00000100:00100000:1.0:1789477362.664930:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783665024 00000100:00080000:3.0:1789477362.665341:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789477362.668105:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783664896 00000100:00100000:1.0:1789477362.668121:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783664896 00000100:00100000:1.0:1789477362.668204:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 89 00000100:00100000:1.0:1789477362.668216:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d74f87480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cf70c55a-e056-446b-8936-49e7cd31fc79+5:2353:x1876402783665024:12345-192.168.201.23@tcp:400:kworker.0 00000100:00100000:1.0:1789477362.668300:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d74f87480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cf70c55a-e056-446b-8936-49e7cd31fc79+5:2353:x1876402783665024:12345-192.168.201.23@tcp:400:kworker.0 Request processed in 87us (9684us total) trans 0 rc 0/0 00000100:00100000:1.0:1789477362.668308:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 89 00000100:00100000:1.0:1789477362.668327:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 90 00000100:00100000:1.0:1789477362.668334:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d74f87800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9bc33f26-0aab-4a14-832f-c58d566de1b0+6:2353:x1876402783664896:12345-192.168.201.23@tcp:400:kworker.0 00000100:00100000:1.0:1789477362.668377:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d74f87800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9bc33f26-0aab-4a14-832f-c58d566de1b0+6:2353:x1876402783664896:12345-192.168.201.23@tcp:400:kworker.0 Request processed in 43us (9213us total) trans 0 rc 0/0 00000100:00100000:1.0:1789477362.668384:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 90 00000100:00080000:2.0:1789477362.669286:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 10000000:01000000:0.0:1789477363.311731:0:5841:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1789477363.311742:0:5841:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9d0d514ce000 from 7 10000000:01000000:0.0:1789477363.311750:0:5841:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1789477363.311882:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.123@tcp lock: ffff9d0d82150600/0xafddb3c8f9281761 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477363.311897:0:5841:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.123@tcp lock: ffff9d0d82150600/0xafddb3c8f9281761 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477363.311911:0:5841:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.123@tcp lock: ffff9d0d82150600/0xafddb3c8f9281761 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789477363.312176:0:5841:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d4e641180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07d5e05c-913f-419f-adbc-d3cf15e9cd51:5841:1876402802574336:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789477363.312248:0:5841:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789477363.312374:0:5841:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d0d7f6e0840 going to sleep for 11 seconds 00000100:00100000:2.0:1789477363.312441:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802574336 00000100:00100000:2.0:1789477363.312454:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802574336 00000100:00100000:2.0:1789477363.312544:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 231 00000100:00100000:2.0:1789477363.312556:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d44520450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07d5e05c-913f-419f-adbc-d3cf15e9cd51+16:5841:x1876402802574336:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789477363.312572:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789477363.312653:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d0d59d6b600/0xafddb3c8f9281768 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xafddb3c8f9281761 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477363.312683:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d0d59d6b600/0xafddb3c8f9281768 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xafddb3c8f9281761 expref: 17 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477363.312694:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d0d59d6b600/0xafddb3c8f9281768 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xafddb3c8f9281761 expref: 17 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477363.312719:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d0d59d6b600, rc 0) 00000100:00100000:2.0:1789477363.312759:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d44520450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07d5e05c-913f-419f-adbc-d3cf15e9cd51+17:5841:x1876402802574336:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 205us (511us total) trans 0 rc 0/0 00000100:00100000:2.0:1789477363.312766:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 231 00000100:00100000:1.0:1789477363.312925:0:5841:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d4e641180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07d5e05c-913f-419f-adbc-d3cf15e9cd51:5841:1876402802574336:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789477363.312940:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.123@tcp lock: ffff9d0d82150600/0xafddb3c8f9281761 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xafddb3c8f9281768 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477363.312962:0:5841:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.123@tcp lock: ffff9d0d82150600/0xafddb3c8f9281761 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xafddb3c8f9281768 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789477363.313038:0:5841:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d753e1500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07d5e05c-913f-419f-adbc-d3cf15e9cd51:5841:1876402802574464:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789477363.313073:0:5841:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789477363.313232:0:5841:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d0d7c1ae000 going to sleep for 11 seconds 00000100:00100000:0.0:1789477363.313337:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802574464 00000100:00100000:0.0:1789477363.313342:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802574464 00000100:00100000:0.0:1789477363.313368:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 232 00000100:00100000:0.0:1789477363.313382:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d44523850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07d5e05c-913f-419f-adbc-d3cf15e9cd51+17:5841:x1876402802574464:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789477363.313621:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d44523850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07d5e05c-913f-419f-adbc-d3cf15e9cd51+17:5841:x1876402802574464:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 240us (547us total) trans 0 rc 0/0 00000100:00100000:0.0:1789477363.313627:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 232 00000100:00100000:1.0:1789477363.313690:0:5841:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d753e1500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07d5e05c-913f-419f-adbc-d3cf15e9cd51:5841:1876402802574464:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789477363.313719:0:5841:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d753e1500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07d5e05c-913f-419f-adbc-d3cf15e9cd51:5841:1876402802574592:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789477363.313754:0:5841:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789477363.313778:0:5841:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d0d7c1ae000 going to sleep for 11 seconds 00000100:00100000:0.0:1789477363.313834:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802574592 00000100:00100000:0.0:1789477363.313837:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802574592 00000100:00100000:0.0:1789477363.313851:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 233 00000100:00100000:0.0:1789477363.313855:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d44522450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07d5e05c-913f-419f-adbc-d3cf15e9cd51+17:5841:x1876402802574592:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789477363.313984:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d44522450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07d5e05c-913f-419f-adbc-d3cf15e9cd51+17:5841:x1876402802574592:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 127us (229us total) trans 0 rc 0/0 00000100:00100000:0.0:1789477363.313991:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 233 00000100:00100000:1.0:1789477363.314124:0:5841:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d753e1500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07d5e05c-913f-419f-adbc-d3cf15e9cd51:5841:1876402802574592:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1789477363.316806:0:11232:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:0.0:1789477363.317124:0:5841:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:0.0:1789477363.317146:0:5841:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.123@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1789477363.317161:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.123@tcp lock: ffff9d0d82150600/0xafddb3c8f9281761 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xafddb3c8f9281768 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477363.317174:0:5841:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.123@tcp lock: ffff9d0d82150600/0xafddb3c8f9281761 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xafddb3c8f9281768 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789477363.317186:0:5841:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1789477363.317190:0:5841:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9d0d585fc800 from 7 10000000:01000000:0.0:1789477363.317194:0:5841:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1789477363.317246:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.123@tcp lock: ffff9d0d82151200/0xafddb3c8f928176f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477363.317254:0:5841:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.123@tcp lock: ffff9d0d82151200/0xafddb3c8f928176f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477363.317267:0:5841:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.123@tcp lock: ffff9d0d82151200/0xafddb3c8f928176f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789477363.317314:0:5841:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d4e641180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07d5e05c-913f-419f-adbc-d3cf15e9cd51:5841:1876402802574720:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789477363.317385:0:5841:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789477363.317441:0:5841:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d0d7f6e0180 going to sleep for 11 seconds 00000100:00100000:1.0:1789477363.317505:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802574720 00000100:00100000:1.0:1789477363.317514:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802574720 00000100:00100000:1.0:1789477363.317561:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 234 00000100:00100000:1.0:1789477363.317572:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d44520050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07d5e05c-913f-419f-adbc-d3cf15e9cd51+17:5841:x1876402802574720:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789477363.317631:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789477363.317654:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d0d41647a00/0xafddb3c8f9281776 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xafddb3c8f928176f expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477363.317683:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d0d41647a00/0xafddb3c8f9281776 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xafddb3c8f928176f expref: 18 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477363.317694:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d0d41647a00/0xafddb3c8f9281776 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xafddb3c8f928176f expref: 18 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477363.317703:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d0d41647a00, rc 0) 00000100:00100000:1.0:1789477363.317744:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d44520050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07d5e05c-913f-419f-adbc-d3cf15e9cd51+18:5841:x1876402802574720:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 174us (358us total) trans 0 rc 0/0 00000100:00100000:1.0:1789477363.317752:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 234 00000100:00100000:0.0:1789477363.317846:0:5841:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d4e641180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07d5e05c-913f-419f-adbc-d3cf15e9cd51:5841:1876402802574720:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789477363.317862:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.123@tcp lock: ffff9d0d82151200/0xafddb3c8f928176f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xafddb3c8f9281776 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477363.317873:0:5841:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.123@tcp lock: ffff9d0d82151200/0xafddb3c8f928176f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xafddb3c8f9281776 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789477363.317927:0:5841:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d4e641180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07d5e05c-913f-419f-adbc-d3cf15e9cd51:5841:1876402802574848:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789477363.318081:0:5841:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789477363.318107:0:5841:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d0d7f6e0180 going to sleep for 11 seconds 00000100:00100000:1.0:1789477363.318171:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802574848 00000100:00100000:1.0:1789477363.318174:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802574848 00000100:00100000:1.0:1789477363.318188:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 235 00000100:00100000:1.0:1789477363.318191:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d4e677850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07d5e05c-913f-419f-adbc-d3cf15e9cd51+18:5841:x1876402802574848:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789477363.318433:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d4e677850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07d5e05c-913f-419f-adbc-d3cf15e9cd51+18:5841:x1876402802574848:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 240us (352us total) trans 0 rc 0/0 00000100:00100000:1.0:1789477363.318438:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 235 00000100:00100000:0.0:1789477363.320141:0:5841:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d4e641180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07d5e05c-913f-419f-adbc-d3cf15e9cd51:5841:1876402802574848:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789477363.325232:0:5841:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d753e1500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07d5e05c-913f-419f-adbc-d3cf15e9cd51:5841:1876402802574976:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789477363.325342:0:5841:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789477363.326011:0:5841:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d0d7c1ae000 going to sleep for 11 seconds 00000100:00100000:0.0:1789477363.331037:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802574976 00000100:00100000:0.0:1789477363.331052:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802574976 00000100:00100000:1.0:1789477363.331215:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 236 00000100:00100000:1.0:1789477363.331226:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d4e676450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07d5e05c-913f-419f-adbc-d3cf15e9cd51+18:5841:x1876402802574976:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789477363.331492:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d4e676450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07d5e05c-913f-419f-adbc-d3cf15e9cd51+18:5841:x1876402802574976:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 267us (6149us total) trans 0 rc 0/0 00000100:00100000:1.0:1789477363.331510:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 236 00000100:00100000:3.0:1789477363.331667:0:5841:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d753e1500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07d5e05c-913f-419f-adbc-d3cf15e9cd51:5841:1876402802574976:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1789477363.333092:0:11234:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:1.0:1789477363.333336:0:5841:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:1.0:1789477363.333368:0:5841:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.123@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1789477363.333381:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.123@tcp lock: ffff9d0d82151200/0xafddb3c8f928176f lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xafddb3c8f9281776 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477363.333393:0:5841:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.123@tcp lock: ffff9d0d82151200/0xafddb3c8f928176f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xafddb3c8f9281776 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789477363.333404:0:5841:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1789477363.333406:0:5841:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9d0d4444e800 from 7 10000000:01000000:1.0:1789477363.333409:0:5841:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1789477363.333444:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.123@tcp lock: ffff9d0d41646a00/0xafddb3c8f928177d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477363.333453:0:5841:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.123@tcp lock: ffff9d0d41646a00/0xafddb3c8f928177d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477363.333464:0:5841:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.123@tcp lock: ffff9d0d41646a00/0xafddb3c8f928177d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789477363.333488:0:5841:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d753e0a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07d5e05c-913f-419f-adbc-d3cf15e9cd51:5841:1876402802575104:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789477363.333544:0:5841:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789477363.333600:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802575104 00000100:00100000:1.0:1789477363.333607:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802575104 00000100:00100000:1.0:1789477363.333645:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 237 00000100:00100000:1.0:1789477363.333653:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d4e674050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:07d5e05c-913f-419f-adbc-d3cf15e9cd51+18:5841:x1876402802575104:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789477363.333666:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789477363.333678:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d0d41647000/0xafddb3c8f9281784 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xafddb3c8f928177d expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789477363.334686:0:5841:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d0d7c1ae600 going to sleep for 11 seconds 00010000:00010000:1.0:1789477363.334884:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d0d41647000/0xafddb3c8f9281784 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xafddb3c8f928177d expref: 19 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477363.334897:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d0d41647000/0xafddb3c8f9281784 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xafddb3c8f928177d expref: 19 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477363.334907:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d0d41647000, rc 0) 00000100:00100000:1.0:1789477363.339666:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d4e674050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:07d5e05c-913f-419f-adbc-d3cf15e9cd51+19:5841:x1876402802575104:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 5997us (6106us total) trans 0 rc 0/0 00000100:00100000:1.0:1789477363.339682:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 237 00000100:00100000:2.0:1789477363.339956:0:5841:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d753e0a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07d5e05c-913f-419f-adbc-d3cf15e9cd51:5841:1876402802575104:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789477363.339983:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.123@tcp lock: ffff9d0d41646a00/0xafddb3c8f928177d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xafddb3c8f9281784 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477363.339995:0:5841:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.123@tcp lock: ffff9d0d41646a00/0xafddb3c8f928177d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xafddb3c8f9281784 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789477363.340102:0:5841:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d74f85f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07d5e05c-913f-419f-adbc-d3cf15e9cd51:5841:1876402802575232:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789477363.340162:0:5841:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789477363.340197:0:5841:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d0d47741300 going to sleep for 11 seconds 00000100:00100000:0.0:1789477363.340334:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802575232 00000100:00100000:0.0:1789477363.340344:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802575232 00000100:00100000:0.0:1789477363.340408:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 238 00000100:00100000:0.0:1789477363.340419:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d4e677050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07d5e05c-913f-419f-adbc-d3cf15e9cd51+19:5841:x1876402802575232:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789477363.340777:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d4e677050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07d5e05c-913f-419f-adbc-d3cf15e9cd51+19:5841:x1876402802575232:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 359us (614us total) trans 0 rc 0/0 00000100:00100000:0.0:1789477363.340784:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 238 00000100:00100000:2.0:1789477363.341174:0:5841:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d74f85f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07d5e05c-913f-419f-adbc-d3cf15e9cd51:5841:1876402802575232:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789477363.341211:0:5841:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d74f85f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07d5e05c-913f-419f-adbc-d3cf15e9cd51:5841:1876402802575360:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789477363.341254:0:5841:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789477363.341279:0:5841:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d0d47741300 going to sleep for 11 seconds 00000100:00100000:0.0:1789477363.341372:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802575360 00000100:00100000:0.0:1789477363.341377:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802575360 00000100:00100000:0.0:1789477363.341415:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 239 00000100:00100000:0.0:1789477363.341422:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d4e676c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:07d5e05c-913f-419f-adbc-d3cf15e9cd51+19:5841:x1876402802575360:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789477363.341566:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d4e676c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:07d5e05c-913f-419f-adbc-d3cf15e9cd51+19:5841:x1876402802575360:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 144us (310us total) trans 0 rc 0/0 00000100:00100000:0.0:1789477363.341574:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 239 00000100:00100000:2.0:1789477363.341825:0:5841:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d74f85f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07d5e05c-913f-419f-adbc-d3cf15e9cd51:5841:1876402802575360:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1789477363.343254:0:11236:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:1.0:1789477363.343538:0:5841:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:1.0:1789477363.343557:0:5841:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.123@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1789477363.343568:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.123@tcp lock: ffff9d0d41646a00/0xafddb3c8f928177d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xafddb3c8f9281784 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477363.343730:0:5841:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.123@tcp lock: ffff9d0d41646a00/0xafddb3c8f928177d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xafddb3c8f9281784 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477363.378926:0:6710:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789477363.491183:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:1.0:1789477363.493213:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783665152 00000100:00100000:1.0:1789477363.493228:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783665152 00000100:00100000:1.0:1789477363.493291:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 240 00000100:00100000:1.0:1789477363.493301:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d4e675450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5c82dded-6a10-4ce8-abd1-52bd956b9523+11:5607:x1876402783665152:12345-192.168.201.23@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789477363.493318:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789477363.493336:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d0d41647800/0xafddb3c8f928178b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xa90d500d7b8f2a50 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477363.493362:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d0d41647800/0xafddb3c8f928178b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2a50 expref: 12 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477363.493381:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d0d41647800/0xafddb3c8f928178b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2a50 expref: 12 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477363.493391:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d0d41647800, rc 0) 00000100:00100000:1.0:1789477363.493462:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d4e675450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5c82dded-6a10-4ce8-abd1-52bd956b9523+12:5607:x1876402783665152:12345-192.168.201.23@tcp:101:ll_cfg_requeue.0 Request processed in 162us (2288us total) trans 0 rc 0/0 00000100:00100000:1.0:1789477363.493469:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 240 00000100:00100000:1.0:1789477363.499149:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:2.0:1789477363.499225:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783665280 00000100:00100000:2.0:1789477363.499236:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783665280 00000100:00100000:2.0:1789477363.499295:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 241 00000100:00100000:2.0:1789477363.499305:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d4e676050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5c82dded-6a10-4ce8-abd1-52bd956b9523+12:5607:x1876402783665280:12345-192.168.201.23@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789477363.500126:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d4e676050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5c82dded-6a10-4ce8-abd1-52bd956b9523+12:5607:x1876402783665280:12345-192.168.201.23@tcp:501:ll_cfg_requeue.0 Request processed in 819us (983us total) trans 0 rc 0/0 00000100:00100000:2.0:1789477363.500135:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 241 00000100:00100000:0.0:1789477363.507379:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:2.0:1789477363.507520:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783665408 00000100:00100000:2.0:1789477363.507531:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783665408 00000100:00100000:2.0:1789477363.507645:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 242 00000100:00100000:2.0:1789477363.507664:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d4e675c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5c82dded-6a10-4ce8-abd1-52bd956b9523+12:5607:x1876402783665408:12345-192.168.201.23@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789477363.507933:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d4e675c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5c82dded-6a10-4ce8-abd1-52bd956b9523+12:5607:x1876402783665408:12345-192.168.201.23@tcp:503:ll_cfg_requeue.0 Request processed in 276us (562us total) trans 0 rc 0/0 00000100:00100000:2.0:1789477363.508151:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 242 00000100:00100000:3.0:1789477363.514137:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:1.0:1789477363.514899:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783665536 00000100:00100000:1.0:1789477363.514916:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783665536 00000100:00100000:1.0:1789477363.515164:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 243 00000100:00100000:1.0:1789477363.515175:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d4e677c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5c82dded-6a10-4ce8-abd1-52bd956b9523+12:5607:x1876402783665536:12345-192.168.201.23@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789477363.515193:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789477363.515227:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d0d7f519000/0xafddb3c8f9281792 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xa90d500d7b8f2a57 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477363.515257:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d0d7f519000/0xafddb3c8f9281792 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2a57 expref: 13 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477363.515269:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d0d7f519000/0xafddb3c8f9281792 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2a57 expref: 13 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477363.515279:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d0d7f519000, rc 0) 00000100:00100000:1.0:1789477363.515358:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d4e677c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5c82dded-6a10-4ce8-abd1-52bd956b9523+13:5607:x1876402783665536:12345-192.168.201.23@tcp:101:ll_cfg_requeue.0 Request processed in 185us (1238us total) trans 0 rc 0/0 00000100:00100000:1.0:1789477363.515366:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 243 00000100:00100000:1.0:1789477363.521851:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:3.0:1789477363.521932:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783665664 00000100:00100000:3.0:1789477363.521942:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783665664 00000100:00100000:3.0:1789477363.522090:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 244 00000100:00100000:3.0:1789477363.522102:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d4e677450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5c82dded-6a10-4ce8-abd1-52bd956b9523+13:5607:x1876402783665664:12345-192.168.201.23@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789477363.522411:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d4e677450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5c82dded-6a10-4ce8-abd1-52bd956b9523+13:5607:x1876402783665664:12345-192.168.201.23@tcp:501:ll_cfg_requeue.0 Request processed in 311us (569us total) trans 0 rc 0/0 00000100:00100000:3.0:1789477363.522419:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 244 00000100:00100000:2.0:1789477363.528400:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:1.0:1789477363.528465:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783665792 00000100:00100000:1.0:1789477363.528475:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783665792 00000100:00100000:1.0:1789477363.528673:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 245 00000100:00100000:1.0:1789477363.528686:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d4e675850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5c82dded-6a10-4ce8-abd1-52bd956b9523+13:5607:x1876402783665792:12345-192.168.201.23@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789477363.528976:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d4e675850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5c82dded-6a10-4ce8-abd1-52bd956b9523+13:5607:x1876402783665792:12345-192.168.201.23@tcp:503:ll_cfg_requeue.0 Request processed in 292us (632us total) trans 0 rc 0/0 00000100:00100000:1.0:1789477363.528984:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 245 00000100:00100000:0.0:1789477363.632202:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d4e641180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1876402802575616:0@lo:400:kworker.0 00000100:00100000:0.0:1789477363.632270:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789477363.632333:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789477363.632467:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d4e641f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3313:1876402802575488:0@lo:400:kworker.0 00000100:00100000:3.0:1789477363.632501:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789477363.632530:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d7f73ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1876402802576000:0@lo:400:kworker.0 00000100:00100000:3.0:1789477363.632550:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789477363.632567:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789477363.632571:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d7bddd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3313:1876402802575872:0@lo:400:kworker.0 00000100:00100000:3.0:1789477363.632604:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789477363.632685:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802575488 00000100:00100000:3.0:1789477363.632692:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802575488 00000100:00100000:3.0:1789477363.633077:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802575872 00000100:00100000:3.0:1789477363.633082:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802575872 00000100:00100000:0.0:1789477363.633123:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d7bddd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3310:1876402802575744:0@lo:400:kworker.0 00000100:00100000:0.0:1789477363.633152:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789477363.636792:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802575616 00000100:00100000:3.0:1789477363.636809:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802575616 00000100:00100000:3.0:1789477363.636866:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802576000 00000100:00100000:3.0:1789477363.636870:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802576000 00000100:00100000:3.0:1789477363.636899:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1789477363.636911:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d7f73a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3310:x1876402802575616:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789477363.637002:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d7f73a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3310:x1876402802575616:12345-0@lo:400:kworker.0 Request processed in 93us (4732us total) trans 0 rc 0/0 00000100:00100000:3.0:1789477363.637010:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1789477363.637044:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1789477363.637060:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d7f703100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3313:x1876402802576000:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789477363.637096:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d7f703100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3313:x1876402802576000:12345-0@lo:400:kworker.0 Request processed in 46us (4544us total) trans 0 rc 0/0 00000100:00100000:3.0:1789477363.637102:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00010000:00080000:0.0:1789477363.640084:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d0d4e641180 x1876402802575616/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789477379 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789477363.640104:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d4e641180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1876402802575616:0@lo:400:kworker.0 00000100:00100000:0.0:1789477363.640138:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d7f701500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1876402802576128:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789477363.640205:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789477363.640423:0:6999:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802575744 00000100:00100000:2.0:1789477363.640432:0:6999:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802575744 00000100:00100000:2.0:1789477363.640481:0:6999:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1789477363.640490:0:6999:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d7f702680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1876402802575488:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789477363.640768:0:6999:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d7f702680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1876402802575488:12345-0@lo:400:kworker.0 Request processed in 278us (8265us total) trans 0 rc 0/0 00000100:00100000:2.0:1789477363.640775:0:6999:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1789477363.640795:0:6999:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1789477363.640802:0:6999:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d7f701c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1876402802575872:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789477363.640833:0:6999:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d7f701c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1876402802575872:12345-0@lo:400:kworker.0 Request processed in 33us (8229us total) trans 0 rc 0/0 00000100:00100000:2.0:1789477363.640840:0:6999:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1789477363.640852:0:6999:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1789477363.640858:0:6999:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d7f738380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1876402802575744:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789477363.640907:0:6999:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d7f738380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1876402802575744:12345-0@lo:400:kworker.0 Request processed in 50us (7755us total) trans 0 rc 0/0 00000100:00100000:2.0:1789477363.640913:0:6999:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1789477363.641005:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d7bddd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3310:1876402802575744:0@lo:400:kworker.0 00000100:00080000:2.0:1789477363.642044:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789477363.642051:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789477363.642055:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789477363.647506:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d7bddd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3313:1876402802575872:0@lo:400:kworker.0 00000100:00100000:0.0:1789477363.647538:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d4e641f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3313:1876402802575488:0@lo:400:kworker.0 00010000:00080000:0.0:1789477363.647553:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d0d7f73ad80 x1876402802576000/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789477379 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789477363.647563:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d7f73ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1876402802576000:0@lo:400:kworker.0 00000100:00100000:3.0:1789477363.648940:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802576128 00000100:00100000:3.0:1789477363.648950:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802576128 00000100:00100000:3.0:1789477363.649003:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1789477363.649014:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d4e641180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1876402802576128:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789477363.649071:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789477363.649171:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d4e641180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1876402802576128:12345-0@lo:13:osp-pre-1-0.0 Request processed in 159us (8964us total) trans 0 rc 0/0 00000100:00100000:3.0:1789477363.649178:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00010000:00080000:0.0:1789477363.649441:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d0d7f701500 x1876402802576128/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789477379 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789477363.649458:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d7f701500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1876402802576128:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1789477364.399766:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789477365.425107:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1789477366.092861:0:11399:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg123-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00100000:0.0:1789477366.194488:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d753e2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1876402802576256:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789477366.194565:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789477366.195225:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802576256 00000100:00100000:3.0:1789477366.195234:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802576256 00000100:00080000:0.0:1789477366.195286:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789477366.195298:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1789477366.195308:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d4e641f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1876402802576256:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789477366.195343:0:6698:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789477366.195401:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d4e641f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1876402802576256:12345-0@lo:13:osp-pre-0-0.0 Request processed in 95us (835us total) trans 0 rc 0/0 00000100:00100000:3.0:1789477366.195409:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00010000:00080000:0.0:1789477366.195458:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d0d753e2300 x1876402802576256/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789477382 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789477366.195479:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d753e2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1876402802576256:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1789477366.447817:0:6710:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789477367.472947:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789477367.815565:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:2.0:1789477367.815647:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:2.0:1789477367.815678:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:2.0:1789477367.815700:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783666048 00000100:00100000:2.0:1789477367.815711:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783666048 00000100:00100000:3.0:1789477367.815782:0:6999:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783666176 00000100:00100000:3.0:1789477367.815786:0:6999:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783666176 00000100:00100000:2.0:1789477367.815799:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 94 00000100:00100000:2.0:1789477367.815809:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d74f85f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9bc33f26-0aab-4a14-832f-c58d566de1b0+6:2355:x1876402783666048:12345-192.168.201.23@tcp:400:kworker.0 00000100:00100000:3.0:1789477367.815814:0:6999:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 95 00000100:00100000:3.0:1789477367.815819:0:6999:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d74f85500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cf70c55a-e056-446b-8936-49e7cd31fc79+5:2354:x1876402783666176:12345-192.168.201.23@tcp:400:kworker.0 00000100:00100000:3.0:1789477367.815877:0:6999:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d74f85500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cf70c55a-e056-446b-8936-49e7cd31fc79+5:2354:x1876402783666176:12345-192.168.201.23@tcp:400:kworker.0 Request processed in 57us (197us total) trans 0 rc 0/0 00000100:00100000:3.0:1789477367.815885:0:6999:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 95 00000100:00100000:1.0:1789477367.815894:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783665920 00000100:00100000:1.0:1789477367.815898:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783665920 00000100:00100000:1.0:1789477367.815924:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 246 00000100:00100000:1.0:1789477367.815930:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d4e675050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5c82dded-6a10-4ce8-abd1-52bd956b9523+13:2354:x1876402783665920:12345-192.168.201.23@tcp:400:kworker.0 00000100:00100000:2.0:1789477367.821015:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d74f85f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9bc33f26-0aab-4a14-832f-c58d566de1b0+6:2355:x1876402783666048:12345-192.168.201.23@tcp:400:kworker.0 Request processed in 5194us (5444us total) trans 0 rc 0/0 00000100:00100000:2.0:1789477367.821032:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 94 00000100:00080000:2.0:1789477367.821073:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789477367.821795:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d4e675050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5c82dded-6a10-4ce8-abd1-52bd956b9523+13:2354:x1876402783665920:12345-192.168.201.23@tcp:400:kworker.0 Request processed in 5859us (6142us total) trans 0 rc 0/0 00000100:00100000:1.0:1789477367.821805:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 246 00010000:00010000:3.0:1789477368.496027:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789477368.753294:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d74f84e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:07d5e05c-913f-419f-adbc-d3cf15e9cd51:3312:1876402802576384:0@lo:400:kworker.0 00000100:00100000:2.0:1789477368.753396:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789477368.753480:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d7c3e7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3312:1876402802576896:0@lo:400:kworker.0 00000100:00100000:2.0:1789477368.753509:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789477368.753684:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802576384 00000100:00100000:1.0:1789477368.753701:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802576384 00000100:00100000:2.0:1789477368.753735:0:6999:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802576896 00000100:00100000:2.0:1789477368.753745:0:6999:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802576896 00000100:00100000:1.0:1789477368.753778:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 247 00000100:00100000:1.0:1789477368.753792:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d4e674850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07d5e05c-913f-419f-adbc-d3cf15e9cd51+19:3312:x1876402802576384:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789477368.753812:0:6999:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1789477368.753825:0:6999:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d7c3e4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1876402802576896:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789477368.754039:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d74f86d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3313:1876402802576512:0@lo:400:kworker.0 00000100:00100000:3.0:1789477368.754054:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d74f84e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:07d5e05c-913f-419f-adbc-d3cf15e9cd51:3312:1876402802576384:0@lo:400:kworker.0 00000100:00080000:3.0:1789477368.754089:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789477368.754123:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d7c3e6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3311:1876402802576768:0@lo:400:kworker.0 00000100:00100000:2.0:1789477368.759775:0:6999:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d7c3e4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1876402802576896:12345-0@lo:400:kworker.0 Request processed in 5939us (6249us total) trans 0 rc 0/0 00000100:00100000:2.0:1789477368.759816:0:6999:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1789477368.760002:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d74f84700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1876402802576640:0@lo:400:kworker.0 00000100:00100000:2.0:1789477368.760071:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789477368.760102:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d7f701f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1876402802577152:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789477368.760128:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789477368.760190:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d7c3e7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3312:1876402802576896:0@lo:400:kworker.0 00000100:00100000:2.0:1789477368.760228:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802576640 00000100:00100000:2.0:1789477368.760235:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802576640 00000100:00100000:2.0:1789477368.760288:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1789477368.760297:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d7c3e6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3310:x1876402802576640:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789477368.760914:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d4e674850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07d5e05c-913f-419f-adbc-d3cf15e9cd51+19:3312:x1876402802576384:12345-0@lo:400:kworker.0 Request processed in 7114us (7506us total) trans 0 rc 0/0 00000100:00100000:1.0:1789477368.760938:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 247 00000100:00100000:2.0:1789477368.761469:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d7c3e6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3310:x1876402802576640:12345-0@lo:400:kworker.0 Request processed in 1166us (1390us total) trans 0 rc 0/0 00000100:00100000:2.0:1789477368.761482:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00010000:00080000:2.0:1789477368.761535:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d0d74f84700 x1876402802576640/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789477384 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789477368.761550:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d74f84700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1876402802576640:0@lo:400:kworker.0 00000100:00100000:2.0:1789477368.762490:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802577152 00000100:00100000:2.0:1789477368.762501:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802577152 00000100:00100000:2.0:1789477368.762566:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1789477368.762587:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d7c3e7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1876402802577152:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789477368.762621:0:6698:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789477368.762671:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d7c3e7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1876402802577152:12345-0@lo:13:osp-pre-1-0.0 Request processed in 98us (2542us total) trans 0 rc 0/0 00000100:00100000:2.0:1789477368.762676:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00010000:00080000:2.0:1789477368.762716:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d0d7f701f80 x1876402802577152/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789477384 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789477368.762729:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d7f701f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1876402802577152:0@lo:13:osp-pre-1-0.0 00000100:00080000:2.0:1789477368.762756:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789477368.762759:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789477368.768377:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789477368.769823:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d7c3e6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1876402802577024:0@lo:400:kworker.0 00000100:00100000:0.0:1789477368.769922:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789477368.770087:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802577024 00000100:00100000:1.0:1789477368.770105:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802577024 00000100:00100000:1.0:1789477368.770191:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1789477368.770203:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d7bddd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3313:x1876402802577024:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789477368.770338:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d7bddd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3313:x1876402802577024:12345-0@lo:400:kworker.0 Request processed in 136us (414us total) trans 0 rc 0/0 00000100:00100000:1.0:1789477368.770347:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1789477368.771911:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802576512 00000100:00100000:2.0:1789477368.771936:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802576512 00000100:00100000:2.0:1789477368.772008:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1789477368.772019:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d7f73ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1876402802576512:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789477368.772117:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d7f73ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1876402802576512:12345-0@lo:400:kworker.0 Request processed in 99us (3754us total) trans 0 rc 0/0 00000100:00100000:2.0:1789477368.772125:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1789477368.772481:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789477368.772811:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802576768 00000100:00100000:2.0:1789477368.772817:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802576768 00000100:00100000:2.0:1789477368.772907:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1789477368.772915:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d7f702300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1876402802576768:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789477368.772992:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d7f702300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1876402802576768:12345-0@lo:400:kworker.0 Request processed in 78us (512us total) trans 0 rc 0/0 00000100:00100000:2.0:1789477368.772999:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1789477368.773052:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d7c3e6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3311:1876402802576768:0@lo:400:kworker.0 00000100:00080000:3.0:1789477368.773098:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789477368.782741:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d74f86d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3313:1876402802576512:0@lo:400:kworker.0 00010000:00080000:0.0:1789477368.782769:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d0d7c3e6a00 x1876402802577024/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789477384 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789477368.782781:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d7c3e6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1876402802577024:0@lo:400:kworker.0 00010000:00010000:3.0:1789477369.520932:0:6710:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1789477369.960707:0:11499:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: finish setup 09:02:47 (1789477367) === 00000100:00100000:0.0:1789477370.208786:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:0.0:1789477370.208847:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783666304 00000100:00100000:0.0:1789477370.208864:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783666304 00000100:00100000:0.0:1789477370.208974:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 14 00000100:00100000:0.0:1789477370.208989:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d7bddd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9bc33f26-0aab-4a14-832f-c58d566de1b0+6:2352:x1876402783666304:12345-192.168.201.23@tcp:41:mkdir.0 00000004:00000024:0.0:1789477370.209070:0:5846:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1789477370.209217:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d7bddd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9bc33f26-0aab-4a14-832f-c58d566de1b0+6:2352:x1876402783666304:12345-192.168.201.23@tcp:41:mkdir.0 Request processed in 231us (446us total) trans 0 rc 0/0 00000100:00100000:0.0:1789477370.209227:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 14 00000100:00100000:0.0:1789477370.209991:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:1.0:1789477370.212813:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783666432 00000100:00100000:1.0:1789477370.212834:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783666432 00000100:00100000:1.0:1789477370.212933:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 0 00000100:00100000:1.0:1789477370.212946:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d74cd9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:9bc33f26-0aab-4a14-832f-c58d566de1b0+6:9684:x1876402783666432:12345-192.168.201.23@tcp:700:mkdir.0 00000100:00100000:1.0:1789477370.213073:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d74cd9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:9bc33f26-0aab-4a14-832f-c58d566de1b0+6:9684:x1876402783666432:12345-192.168.201.23@tcp:700:mkdir.0 Request processed in 128us (3087us total) trans 0 rc 0/0 00000100:00100000:1.0:1789477370.213081:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 0 00000100:00080000:3.0:1789477370.216965:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789477370.226896:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:3.0:1789477370.234068:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783666688 00000100:00100000:3.0:1789477370.234088:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783666688 00000100:00100000:3.0:1789477370.234191:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 15 00000100:00100000:3.0:1789477370.234204:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d74cda680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9bc33f26-0aab-4a14-832f-c58d566de1b0+6:9684:x1876402783666688:12345-192.168.201.23@tcp:36:mkdir.0 00010000:00010000:3.0:1789477370.234937:0:5844:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789477370.235407:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d40030e00/0xafddb3c8f928167a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f29d9 expref: 6 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477370.235444:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9d0d596ae500) 00010000:00010000:3.0:1789477370.235457:0:5844:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789477370.235920:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49eca000/0xafddb3c8f9281799 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477370.235937:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49eca000/0xafddb3c8f9281799 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477370.235950:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49eca000/0xafddb3c8f9281799 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477370.235993:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49ecb200/0xafddb3c8f92817a0 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477370.236011:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49ecb200/0xafddb3c8f92817a0 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477370.236018:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49ecb200/0xafddb3c8f92817a0 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789477370.237912:0:5844:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 512 00010000:00010000:3.0:1789477370.237932:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49eca000/0xafddb3c8f9281799 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477370.237943:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49eca000/0xafddb3c8f9281799 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477370.237952:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49eca000/0xafddb3c8f9281799 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477370.237959:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d0d49eca000 already unused, calling callback (ffffffffc1fd54f0) 00010000:00010000:3.0:1789477370.237965:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49eca000/0xafddb3c8f9281799 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477370.237974:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49eca000/0xafddb3c8f9281799 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477370.237990:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9d0d44568d00) 00010000:00010000:3.0:1789477370.242087:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789477370.242105:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49eca000/0xafddb3c8f9281799 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477370.242117:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49eca000/0xafddb3c8f9281799 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789477370.242151:0:5844:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000050152864 reply state 0000000053e56212 transno 4294967297 ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49ecb200/0xafddb3c8f92817a0 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789477370.242161:0:5844:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789477370.242665:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d74cda680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9bc33f26-0aab-4a14-832f-c58d566de1b0+7:9684:x1876402783666688:12345-192.168.201.23@tcp:36:mkdir.0 Request processed in 8457us (15780us total) trans 4294967297 rc 0/0 00000100:00100000:3.0:1789477370.242689:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 15 00010000:00010000:2.0:1789477370.246158:0:3296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49ecb200/0xafddb3c8f92817a0 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477370.246177:0:3296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49ecb200/0xafddb3c8f92817a0 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477370.246185:0:3296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49ecb200/0xafddb3c8f92817a0 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477370.246197:0:3296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d0d49ecb200 already unused, calling callback (ffffffffc1fd54f0) 00010000:00010000:2.0:1789477370.246202:0:3296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49ecb200/0xafddb3c8f92817a0 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477370.246209:0:3296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49ecb200/0xafddb3c8f92817a0 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477370.246227:0:3296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff9d0d44568f00) 00010000:00010000:2.0:1789477370.246230:0:3296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789477370.246234:0:3296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49ecb200/0xafddb3c8f92817a0 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477370.246241:0:3296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49ecb200/0xafddb3c8f92817a0 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789477370.268187:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:3.0:1789477370.268239:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783666816 00000100:00100000:3.0:1789477370.268254:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783666816 00000100:00100000:3.0:1789477370.268345:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 16 00000100:00100000:3.0:1789477370.268359:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d7f703480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9bc33f26-0aab-4a14-832f-c58d566de1b0+6:9685:x1876402783666816:12345-192.168.201.23@tcp:101:chmod.0 00010000:00010000:3.0:1789477370.270351:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789477370.270420:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49eca000/0xafddb3c8f92817a7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa90d500d7b8f2a5e expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477370.270546:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49eca800/0xafddb3c8f92817ae lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477370.270566:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49eca800/0xafddb3c8f92817ae lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477370.270615:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49eca800/0xafddb3c8f92817ae lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789477370.270704:0:5846:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000004:00200000:3.0:1789477370.270709:0:5846:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:3.0:1789477370.273848:0:5846:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49eca800/0xafddb3c8f92817ae lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477370.273937:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49eca000/0xafddb3c8f92817a7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2a5e expref: 8 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477370.273968:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49eca800/0xafddb3c8f92817ae lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2a5e expref: 7 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477370.274012:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9d0d44568d00) 00010000:00010000:3.0:1789477370.274015:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789477370.274019:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d0d49eca800, rc 0) 00000100:00100000:3.0:1789477370.274141:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d7f703480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9bc33f26-0aab-4a14-832f-c58d566de1b0+7:9685:x1876402783666816:12345-192.168.201.23@tcp:101:chmod.0 Request processed in 5783us (5970us total) trans 0 rc 0/0 00000100:00100000:3.0:1789477370.274151:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 16 00000100:00100000:3.0:1789477370.280949:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:0.0:1789477370.281193:0:6999:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783667072 00000100:00100000:0.0:1789477370.281209:0:6999:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783667072 00000100:00100000:0.0:1789477370.281289:0:6999:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 17 00000100:00100000:0.0:1789477370.281301:0:6999:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d7f701f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9bc33f26-0aab-4a14-832f-c58d566de1b0+7:9685:x1876402783667072:12345-192.168.201.23@tcp:36:chmod.0 00010000:00010000:0.0:1789477370.281365:0:6999:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789477370.281394:0:6999:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49eca800/0xafddb3c8f92817ae lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2a5e expref: 7 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477370.281416:0:6999:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9d0d44568d00) 00010000:00010000:0.0:1789477370.281430:0:6999:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789477370.281458:0:6999:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d82151c00/0xafddb3c8f92817b5 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477370.281472:0:6999:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d82151c00/0xafddb3c8f92817b5 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477370.281482:0:6999:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d82151c00/0xafddb3c8f92817b5 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789477370.284570:0:6999:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000004c1f8c98 reply state 00000000e3b60700 transno 4294967298 ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d82151c00/0xafddb3c8f92817b5 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789477370.284607:0:6999:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:0.0:1789477370.284649:0:6999:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000100:00100000:0.0:1789477370.287405:0:6999:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d7f701f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9bc33f26-0aab-4a14-832f-c58d566de1b0+8:9685:x1876402783667072:12345-192.168.201.23@tcp:36:chmod.0 Request processed in 6094us (6465us total) trans 4294967298 rc 0/0 00000100:00100000:0.0:1789477370.287419:0:6999:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 17 00010000:00010000:0.0:1789477370.289875:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d82151c00/0xafddb3c8f92817b5 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477370.289898:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d82151c00/0xafddb3c8f92817b5 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477370.289918:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d82151c00/0xafddb3c8f92817b5 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477370.289925:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d0d82151c00 already unused, calling callback (ffffffffc1fd54f0) 00010000:00010000:0.0:1789477370.289930:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d82151c00/0xafddb3c8f92817b5 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477370.289938:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d82151c00/0xafddb3c8f92817b5 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477370.289957:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9d0d596aed00) 00010000:00010000:0.0:1789477370.289961:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1789477370.289965:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d82151c00/0xafddb3c8f92817b5 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477370.289972:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d82151c00/0xafddb3c8f92817b5 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789477370.320572:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:0.0:1789477370.324119:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783667200 00000100:00100000:0.0:1789477370.324139:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783667200 00000100:00100000:0.0:1789477370.324242:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 18 00000100:00100000:0.0:1789477370.324256:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d7f701500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9bc33f26-0aab-4a14-832f-c58d566de1b0+7:9686:x1876402783667200:12345-192.168.201.23@tcp:101:chown.0 00010000:00010000:0.0:1789477370.324308:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789477370.324333:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d82151c00/0xafddb3c8f92817bc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa90d500d7b8f2a65 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477370.324411:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d82150800/0xafddb3c8f92817c3 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477370.324427:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d82150800/0xafddb3c8f92817c3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477370.324439:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d82150800/0xafddb3c8f92817c3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789477370.324510:0:5846:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000004:00200000:0.0:1789477370.324515:0:5846:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:0.0:1789477370.324566:0:5846:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d82150800/0xafddb3c8f92817c3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477370.324648:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d82151c00/0xafddb3c8f92817bc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2a65 expref: 9 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477370.324668:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d82150800/0xafddb3c8f92817c3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2a65 expref: 8 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477370.324677:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9d0d596aed00) 00010000:00010000:0.0:1789477370.324680:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789477370.324684:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d0d82150800, rc 0) 00000100:00100000:0.0:1789477370.324754:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d7f701500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9bc33f26-0aab-4a14-832f-c58d566de1b0+8:9686:x1876402783667200:12345-192.168.201.23@tcp:101:chown.0 Request processed in 502us (4195us total) trans 0 rc 0/0 00000100:00100000:0.0:1789477370.324761:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 18 00000100:00100000:1.0:1789477370.328365:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:3.0:1789477370.328479:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783667328 00000100:00100000:3.0:1789477370.328491:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783667328 00000100:00100000:3.0:1789477370.328558:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 19 00000100:00100000:3.0:1789477370.328570:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d753e2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9bc33f26-0aab-4a14-832f-c58d566de1b0+8:9686:x1876402783667328:12345-192.168.201.23@tcp:101:chown.0 00010000:00010000:3.0:1789477370.328622:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789477370.328644:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49eca000/0xafddb3c8f92817ca lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa90d500d7b8f2a6c expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477370.328722:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49ecb400/0xafddb3c8f92817d1 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477370.328737:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49ecb400/0xafddb3c8f92817d1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477370.328750:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49ecb400/0xafddb3c8f92817d1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477370.328765:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49ecba00/0xafddb3c8f92817d8 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477370.328794:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49ecba00/0xafddb3c8f92817d8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477370.328801:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49ecba00/0xafddb3c8f92817d8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477370.328919:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49eca800/0xafddb3c8f92817df lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477370.328927:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49eca800/0xafddb3c8f92817df lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477370.328935:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49eca800/0xafddb3c8f92817df lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789477370.328979:0:5844:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 512 00000004:00200000:3.0:1789477370.328984:0:5844:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1789477370.329010:0:5844:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49eca800/0xafddb3c8f92817df lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477370.329023:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49ecb400/0xafddb3c8f92817d1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477370.329030:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49ecb400/0xafddb3c8f92817d1 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477370.329037:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49ecb400/0xafddb3c8f92817d1 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477370.329043:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d0d49ecb400 already unused, calling callback (ffffffffc1fd54f0) 00010000:00010000:3.0:1789477370.329048:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49ecb400/0xafddb3c8f92817d1 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477370.329061:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49ecb400/0xafddb3c8f92817d1 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477370.329073:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9d0d596aed00) 00010000:00010000:3.0:1789477370.329076:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789477370.329195:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49ecb400/0xafddb3c8f92817d1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477370.329203:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49ecb400/0xafddb3c8f92817d1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477370.329218:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49ecba00/0xafddb3c8f92817d8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477370.329225:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49ecba00/0xafddb3c8f92817d8 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477370.329231:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49ecba00/0xafddb3c8f92817d8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477370.329237:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d0d49ecba00 already unused, calling callback (ffffffffc1fd54f0) 00010000:00010000:3.0:1789477370.329240:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49ecba00/0xafddb3c8f92817d8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477370.329246:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49ecba00/0xafddb3c8f92817d8 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477370.329255:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff9d0d44568800) 00010000:00010000:3.0:1789477370.329258:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789477370.329261:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49ecba00/0xafddb3c8f92817d8 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477370.329279:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49ecba00/0xafddb3c8f92817d8 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477370.329320:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49eca000/0xafddb3c8f92817ca lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2a6c expref: 10 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477370.329334:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49eca800/0xafddb3c8f92817df lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2a6c expref: 9 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477370.329342:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9d0d44568e00) 00010000:00010000:3.0:1789477370.329345:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789477370.329348:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d0d49eca800, rc 0) 00000100:00100000:3.0:1789477370.329853:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d753e2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9bc33f26-0aab-4a14-832f-c58d566de1b0+9:9686:x1876402783667328:12345-192.168.201.23@tcp:101:chown.0 Request processed in 1282us (1497us total) trans 0 rc 0/0 00000100:00100000:3.0:1789477370.329862:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 19 00000100:00100000:1.0:1789477370.352801:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:3.0:1789477370.352897:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783667584 00000100:00100000:3.0:1789477370.352921:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783667584 00000100:00100000:3.0:1789477370.352990:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 20 00000100:00100000:3.0:1789477370.353001:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d753e0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9bc33f26-0aab-4a14-832f-c58d566de1b0+9:9686:x1876402783667584:12345-192.168.201.23@tcp:36:chown.0 00010000:00010000:3.0:1789477370.353067:0:5846:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789477370.353107:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49eca800/0xafddb3c8f92817df lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2a6c expref: 9 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477370.353128:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9d0d44568e00) 00010000:00010000:3.0:1789477370.353141:0:5846:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789477370.353168:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49ecb200/0xafddb3c8f92817e6 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477370.353196:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49ecb200/0xafddb3c8f92817e6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477370.353206:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49ecb200/0xafddb3c8f92817e6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789477370.431544:0:5846:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000036a583d7 reply state 00000000561f88b2 transno 4294967299 ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49ecb200/0xafddb3c8f92817e6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789477370.431565:0:5846:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1789477370.431756:0:5846:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00000001:00080000:1.0:1789477370.431863:0:5868:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967298 is committed 00000001:00080000:1.0:1789477370.431876:0:5868:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967299 is committed 00010000:00080000:3.0:1789477370.432026:0:5846:0:(ldlm_lib.c:3482:target_send_reply()) Schedule reply immediately 00000100:00100000:3.0:1789477370.432053:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d753e0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9bc33f26-0aab-4a14-832f-c58d566de1b0+7:9686:x1876402783667584:12345-192.168.201.23@tcp:36:chown.0 Request processed in 79049us (79258us total) trans 4294967299 rc 0/0 00000100:00100000:3.0:1789477370.432063:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 20 00010000:00010000:0.0:1789477370.432142:0:3296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49ecb200/0xafddb3c8f92817e6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477370.432154:0:3296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49ecb200/0xafddb3c8f92817e6 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477370.432163:0:3296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49ecb200/0xafddb3c8f92817e6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477370.432169:0:3296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d0d49ecb200 already unused, calling callback (ffffffffc1fd54f0) 00010000:00010000:0.0:1789477370.432174:0:3296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49ecb200/0xafddb3c8f92817e6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477370.432182:0:3296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49ecb200/0xafddb3c8f92817e6 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477370.432335:0:3296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9d0d44568300) 00010000:00010000:0.0:1789477370.432338:0:3296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1789477370.432344:0:3296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49ecb200/0xafddb3c8f92817e6 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477370.432351:0:3296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49ecb200/0xafddb3c8f92817e6 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789477370.471440:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:0.0:1789477370.471570:0:6999:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783667712 00000100:00100000:0.0:1789477370.471617:0:6999:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783667712 00000100:00100000:0.0:1789477370.471679:0:6999:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 21 00000100:00100000:0.0:1789477370.471691:0:6999:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d753e1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9bc33f26-0aab-4a14-832f-c58d566de1b0+6:9687:x1876402783667712:12345-192.168.201.23@tcp:101:touch.500 00010000:00010000:0.0:1789477370.471719:0:6999:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789477370.471740:0:6999:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d82151c00/0xafddb3c8f92817ed lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa90d500d7b8f2a73 expref: -99 pid: 6999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1789477370.477036:0:6999:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 500, time 5227us 00010000:00010000:0.0:1789477370.484161:0:6999:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d82151e00/0xafddb3c8f92817f4 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477370.484185:0:6999:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d82151e00/0xafddb3c8f92817f4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477370.484195:0:6999:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d82151e00/0xafddb3c8f92817f4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477370.484225:0:6999:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be5e00/0xafddb3c8f92817fb lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477370.484233:0:6999:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be5e00/0xafddb3c8f92817fb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477370.484240:0:6999:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be5e00/0xafddb3c8f92817fb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477370.484668:0:6999:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be4200/0xafddb3c8f9281802 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477370.484678:0:6999:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be4200/0xafddb3c8f9281802 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477370.484686:0:6999:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be4200/0xafddb3c8f9281802 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789477370.484760:0:6999:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00000004:00200000:0.0:1789477370.484764:0:6999:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1789477370.484866:0:6999:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be4200/0xafddb3c8f9281802 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477370.484880:0:6999:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d82151e00/0xafddb3c8f92817f4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477370.484887:0:6999:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d82151e00/0xafddb3c8f92817f4 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477370.484894:0:6999:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d82151e00/0xafddb3c8f92817f4 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477370.484911:0:6999:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d0d82151e00 already unused, calling callback (ffffffffc1fd54f0) 00010000:00010000:0.0:1789477370.484916:0:6999:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d82151e00/0xafddb3c8f92817f4 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477370.484923:0:6999:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d82151e00/0xafddb3c8f92817f4 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477370.484937:0:6999:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9d0d596aed00) 00010000:00010000:0.0:1789477370.484940:0:6999:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789477370.484944:0:6999:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d82151e00/0xafddb3c8f92817f4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477370.484951:0:6999:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d82151e00/0xafddb3c8f92817f4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477370.484962:0:6999:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be5e00/0xafddb3c8f92817fb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477370.484969:0:6999:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be5e00/0xafddb3c8f92817fb lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477370.484975:0:6999:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be5e00/0xafddb3c8f92817fb lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477370.484985:0:6999:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d0d50be5e00 already unused, calling callback (ffffffffc1fd54f0) 00010000:00010000:0.0:1789477370.484998:0:6999:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be5e00/0xafddb3c8f92817fb lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477370.485005:0:6999:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be5e00/0xafddb3c8f92817fb lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477370.485014:0:6999:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff9d0d596ae100) 00010000:00010000:0.0:1789477370.485016:0:6999:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789477370.485020:0:6999:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be5e00/0xafddb3c8f92817fb lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477370.485026:0:6999:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be5e00/0xafddb3c8f92817fb lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477370.485064:0:6999:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d82151c00/0xafddb3c8f92817ed lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2a73 expref: 8 pid: 6999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477370.485079:0:6999:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be4200/0xafddb3c8f9281802 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2a73 expref: 7 pid: 6999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477370.485087:0:6999:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9d0d596ae700) 00010000:00010000:0.0:1789477370.485089:0:6999:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1789477370.485091:0:6999:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d0d50be4200, rc 0) 00000100:00100000:0.0:1789477370.485174:0:6999:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d753e1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9bc33f26-0aab-4a14-832f-c58d566de1b0+7:9687:x1876402783667712:12345-192.168.201.23@tcp:101:touch.500 Request processed in 13485us (13743us total) trans 0 rc 0/0 00000100:00100000:0.0:1789477370.485183:0:6999:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 21 00000100:00100000:1.0:1789477370.491041:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:3.0:1789477370.491112:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783667968 00000100:00100000:3.0:1789477370.491124:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783667968 00000100:00100000:3.0:1789477370.491191:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 22 00000100:00100000:3.0:1789477370.491202:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d753e1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9bc33f26-0aab-4a14-832f-c58d566de1b0+7:9687:x1876402783667968:12345-192.168.201.23@tcp:101:touch.500 00010000:00010000:3.0:1789477370.491225:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789477370.491245:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49eca800/0xafddb3c8f9281809 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa90d500d7b8f2a7a expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477370.491568:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49eca000/0xafddb3c8f9281810 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477370.491622:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49eca000/0xafddb3c8f9281810 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477370.491646:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49eca000/0xafddb3c8f9281810 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477370.491681:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49ecba00/0xafddb3c8f9281817 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0x27b6432d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477370.491689:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49ecba00/0xafddb3c8f9281817 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x27b6432d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477370.491698:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49ecba00/0xafddb3c8f9281817 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x27b6432d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1789477370.492524:0:5845:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x2:0x0], index 1: 0 00010000:00010000:3.0:1789477370.492832:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49ecb400/0xafddb3c8f928181e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477370.492845:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49ecb400/0xafddb3c8f928181e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477370.492855:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49ecb400/0xafddb3c8f928181e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477370.492890:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49eca000/0xafddb3c8f9281810 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477370.492911:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49eca000/0xafddb3c8f9281810 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477370.492918:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49eca000/0xafddb3c8f9281810 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477370.492924:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d0d49eca000 already unused, calling callback (ffffffffc1fd54f0) 00010000:00010000:3.0:1789477370.492935:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49eca000/0xafddb3c8f9281810 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477370.492942:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49eca000/0xafddb3c8f9281810 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477370.492955:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9d0d596ae700) 00010000:00010000:3.0:1789477370.492958:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789477370.492963:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49eca000/0xafddb3c8f9281810 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477370.492969:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49eca000/0xafddb3c8f9281810 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789477370.492985:0:5845:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000b2d689de reply state 000000007ff85292 transno 4294967300 ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49ecba00/0xafddb3c8f9281817 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x27b6432d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789477370.492994:0:5845:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1789477370.493032:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49eca800/0xafddb3c8f9281809 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2a7a expref: 10 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477370.493048:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49ecb400/0xafddb3c8f928181e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2a7a expref: 9 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477370.493055:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9d0d44568800) 00010000:00010000:3.0:1789477370.493057:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789477370.493060:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d0d49ecb400, rc 0) 00000100:00100000:3.0:1789477370.493141:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d753e1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9bc33f26-0aab-4a14-832f-c58d566de1b0+10:9687:x1876402783667968:12345-192.168.201.23@tcp:101:touch.500 Request processed in 1940us (2110us total) trans 4294967300 rc 0/0 00000100:00100000:3.0:1789477370.493149:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 22 00010000:00010000:2.0:1789477370.496230:0:3296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49ecba00/0xafddb3c8f9281817 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x27b6432d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477370.496251:0:3296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49ecba00/0xafddb3c8f9281817 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x27b6432d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477370.496259:0:3296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49ecba00/0xafddb3c8f9281817 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x27b6432d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477370.496266:0:3296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d0d49ecba00 already unused, calling callback (ffffffffc1fd54f0) 00010000:00010000:2.0:1789477370.496272:0:3296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49ecba00/0xafddb3c8f9281817 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x27b6432d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477370.496281:0:3296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49ecba00/0xafddb3c8f9281817 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x27b6432d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477370.496319:0:3296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x27b6432d (ffff9d0d44568e00) 00010000:00010000:2.0:1789477370.496322:0:3296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789477370.496328:0:3296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49ecba00/0xafddb3c8f9281817 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x27b6432d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477370.496334:0:3296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49ecba00/0xafddb3c8f9281817 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x27b6432d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789477370.497751:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:3.0:1789477370.497943:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783668224 00000100:00100000:3.0:1789477370.497956:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783668224 00000100:00100000:3.0:1789477370.498108:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 23 00000100:00100000:3.0:1789477370.498118:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d753e0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9bc33f26-0aab-4a14-832f-c58d566de1b0+9:9687:x1876402783668224:12345-192.168.201.23@tcp:36:touch.500 00010000:00010000:3.0:1789477370.498181:0:5844:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789477370.498207:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49ecb400/0xafddb3c8f928181e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2a7a expref: 9 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477370.498326:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9d0d44568800) 00010000:00010000:3.0:1789477370.498338:0:5844:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789477370.498381:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49eca600/0xafddb3c8f928182c lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477370.498391:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49eca600/0xafddb3c8f928182c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477370.498398:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49eca600/0xafddb3c8f928182c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789477370.498515:0:5844:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000020e3eee4 reply state 000000001182d38b transno 4294967301 ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49eca600/0xafddb3c8f928182c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789477370.498526:0:5844:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789477370.498986:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d753e0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9bc33f26-0aab-4a14-832f-c58d566de1b0+10:9687:x1876402783668224:12345-192.168.201.23@tcp:36:touch.500 Request processed in 866us (1242us total) trans 4294967301 rc 0/0 00000100:00100000:3.0:1789477370.499066:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 23 00000100:00100000:3.0:1789477370.500819:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:0.0:1789477370.501154:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783668352 00000100:00100000:0.0:1789477370.501177:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783668352 00000100:00100000:0.0:1789477370.501235:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 24 00000100:00100000:0.0:1789477370.501245:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d74f86d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9bc33f26-0aab-4a14-832f-c58d566de1b0+10:9687:x1876402783668352:12345-192.168.201.23@tcp:101:touch.500 00010000:00010000:0.0:1789477370.501269:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789477370.501288:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be5e00/0xafddb3c8f9281833 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa90d500d7b8f2a81 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477370.501342:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be5e00/0xafddb3c8f9281833 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2a81 expref: 11 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477370.501353:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be5e00/0xafddb3c8f9281833 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2a81 expref: 11 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477370.501367:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9d0d44568b00) 00010000:00010000:0.0:1789477370.501369:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789477370.501372:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d0d50be5e00, rc 0) 00000100:00100000:0.0:1789477370.501464:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d74f86d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9bc33f26-0aab-4a14-832f-c58d566de1b0+11:9687:x1876402783668352:12345-192.168.201.23@tcp:101:touch.500 Request processed in 221us (655us total) trans 0 rc 0/0 00000100:00100000:0.0:1789477370.501470:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 24 00010000:00010000:1.0:1789477370.501702:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49eca600/0xafddb3c8f928182c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477370.501712:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49eca600/0xafddb3c8f928182c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477370.501719:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49eca600/0xafddb3c8f928182c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477370.501726:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d0d49eca600 already unused, calling callback (ffffffffc1fd54f0) 00010000:00010000:1.0:1789477370.501731:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49eca600/0xafddb3c8f928182c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477370.501743:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49eca600/0xafddb3c8f928182c lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477370.501757:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9d0d44568b00) 00010000:00010000:1.0:1789477370.501759:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789477370.501761:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49eca600/0xafddb3c8f928182c lrc: 2/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477370.501766:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49eca600/0xafddb3c8f928182c lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789477370.504207:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:2.0:1789477370.504268:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783668480 00000100:00100000:2.0:1789477370.504277:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783668480 00000100:00100000:2.0:1789477370.504315:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 17 00000100:00100000:2.0:1789477370.504323:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d74cd9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2351:x1876402783668480:12345-192.168.201.23@tcp:8:touch.500 00010000:00080000:2.0:1789477370.504353:0:6696:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 9bc33f26-0aab-4a14-832f-c58d566de1b0@192.168.201.23@tcp t0 exp 0000000000000000 cur 315 last 0 00000020:00000080:2.0:1789477370.504382:0:6696:0:(genops.c:1385:class_connect()) connect: client 9bc33f26-0aab-4a14-832f-c58d566de1b0, cookie 0xafddb3c8f928183a 00002000:00100000:2.0:1789477370.504392:0:6696:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 9bc33f26-0aab-4a14-832f-c58d566de1b0/ffff9d0d74a84800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113954 ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1789477370.504420:0:6696:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:2.0:1789477370.504954:0:6696:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1789477370.504981:0:6696:0:(import.c:65:import_set_state_nolock()) ffff9d0d74a84000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789477370.505057:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d74cd9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9bc33f26-0aab-4a14-832f-c58d566de1b0+6:2351:x1876402783668480:12345-192.168.201.23@tcp:8:touch.500 Request processed in 731us (857us total) trans 0 rc 0/0 00000100:00100000:2.0:1789477370.505066:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 17 00000100:00100000:2.0:1789477370.507153:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:1.0:1789477370.507216:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783668608 00000100:00100000:1.0:1789477370.507231:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783668608 00000100:00100000:1.0:1789477370.507288:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 18 00000100:00100000:1.0:1789477370.507297:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d7c3e6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9bc33f26-0aab-4a14-832f-c58d566de1b0+6:0:x1876402783668608:12345-192.168.201.23@tcp:2:touch.500 00000100:00080000:3.0:1789477370.507641:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1789477370.546029:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1789477370.600635:0:7678:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967299 is committed 00000001:00100000:0.0:1789477370.600651:0:7678:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 9bc33f26-0aab-4a14-832f-c58d566de1b0 00000100:00100000:3.0:1789477370.600864:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d7c3e6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9bc33f26-0aab-4a14-832f-c58d566de1b0+5:0:x1876402783668608:12345-192.168.201.23@tcp:2:touch.500 Request processed in 93561us (93708us total) trans 4294967299 rc 0/0 00000100:00100000:3.0:1789477370.600906:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 18 00000100:00100000:1.0:1789477370.606153:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:3.0:1789477370.606294:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783668864 00000100:00100000:3.0:1789477370.606305:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783668864 00000100:00100000:3.0:1789477370.606416:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 2 00000100:00100000:3.0:1789477370.606429:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d753e3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9bc33f26-0aab-4a14-832f-c58d566de1b0+10:9687:x1876402783668864:12345-192.168.201.23@tcp:35:touch.500 00000100:00100000:3.0:1789477370.606806:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d753e3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9bc33f26-0aab-4a14-832f-c58d566de1b0+11:9687:x1876402783668864:12345-192.168.201.23@tcp:35:touch.500 Request processed in 380us (665us total) trans 4294967302 rc 0/0 00000100:00100000:3.0:1789477370.606814:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 2 00000100:00100000:0.0:1789477370.622936:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:2.0:1789477370.623049:0:6999:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783668992 00000100:00100000:2.0:1789477370.623060:0:6999:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783668992 00000100:00100000:2.0:1789477370.623119:0:6999:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 25 00000100:00100000:2.0:1789477370.623129:0:6999:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d74cdad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9bc33f26-0aab-4a14-832f-c58d566de1b0+11:9688:x1876402783668992:12345-192.168.201.23@tcp:101:rm.0 00010000:00010000:2.0:1789477370.623176:0:6999:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789477370.623201:0:6999:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d59d6b400/0xafddb3c8f9281841 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa90d500d7b8f2a88 expref: -99 pid: 6999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477370.623283:0:6999:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d59d6be00/0xafddb3c8f9281848 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477370.623298:0:6999:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d59d6be00/0xafddb3c8f9281848 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477370.623310:0:6999:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d59d6be00/0xafddb3c8f9281848 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789477370.623375:0:6999:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00000004:00200000:2.0:1789477370.623379:0:6999:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:2.0:1789477370.623439:0:6999:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d59d6be00/0xafddb3c8f9281848 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477370.623468:0:6999:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d59d6b400/0xafddb3c8f9281841 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2a88 expref: 13 pid: 6999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477370.625860:0:6999:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d59d6be00/0xafddb3c8f9281848 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2a88 expref: 12 pid: 6999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477370.625886:0:6999:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9d0d596ae700) 00010000:00010000:2.0:1789477370.625890:0:6999:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789477370.625905:0:6999:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d0d59d6be00, rc 0) 00000100:00100000:2.0:1789477370.626155:0:6999:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d74cdad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9bc33f26-0aab-4a14-832f-c58d566de1b0+12:9688:x1876402783668992:12345-192.168.201.23@tcp:101:rm.0 Request processed in 3023us (3226us total) trans 0 rc 0/0 00000100:00100000:2.0:1789477370.626166:0:6999:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 25 00000100:00100000:1.0:1789477370.648862:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:0.0:1789477370.649191:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783669248 00000100:00100000:0.0:1789477370.649203:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783669248 00000100:00100000:0.0:1789477370.649365:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 26 00000100:00100000:0.0:1789477370.649374:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d6d466300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9bc33f26-0aab-4a14-832f-c58d566de1b0+12:9688:x1876402783669248:12345-192.168.201.23@tcp:101:rm.0 00010000:00010000:0.0:1789477370.649405:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789477370.649424:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be5a00/0xafddb3c8f928184f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa90d500d7b8f2a8f expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789477370.649758:0:5845:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00010000:00010000:1.0:1789477370.653721:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be5a00/0xafddb3c8f928184f lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2a8f expref: 14 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477370.653738:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9d0d596aed00) 00010000:00010000:1.0:1789477370.653740:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1789477370.653744:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be5a00/0xafddb3c8f928184f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2a8f expref: 14 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477370.653757:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d0d50be5a00, rc 0) 00000100:00100000:1.0:1789477370.653823:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d6d466300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9bc33f26-0aab-4a14-832f-c58d566de1b0+13:9688:x1876402783669248:12345-192.168.201.23@tcp:101:rm.0 Request processed in 4448us (4971us total) trans 4294967303 rc 301/301 00000100:00100000:1.0:1789477370.653842:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 26 00000100:00100000:0.0:1789477370.657854:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:2.0:1789477370.658979:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783669376 00000100:00100000:2.0:1789477370.659005:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783669376 00000100:00100000:2.0:1789477370.659150:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 3 00000100:00100000:2.0:1789477370.659161:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d74cdb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9bc33f26-0aab-4a14-832f-c58d566de1b0+13:9688:x1876402783669376:12345-192.168.201.23@tcp:37:rm.0 00000100:00100000:2.0:1789477370.675891:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d74cdb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9bc33f26-0aab-4a14-832f-c58d566de1b0+13:9688:x1876402783669376:12345-192.168.201.23@tcp:37:rm.0 Request processed in 16709us (18028us total) trans 0 rc 0/0 00000100:00100000:2.0:1789477370.675920:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 3 00000100:00100000:1.0:1789477370.699876:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:3.0:1789477370.700437:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783669632 00000100:00100000:3.0:1789477370.700451:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783669632 00000100:00100000:3.0:1789477370.700621:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 4 00000100:00100000:3.0:1789477370.700634:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d5845fc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9bc33f26-0aab-4a14-832f-c58d566de1b0+13:9688:x1876402783669632:12345-192.168.201.23@tcp:35:rm.0 00000100:00100000:3.0:1789477370.700945:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d5845fc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9bc33f26-0aab-4a14-832f-c58d566de1b0+14:9688:x1876402783669632:12345-192.168.201.23@tcp:35:rm.0 Request processed in 313us (1079us total) trans 4294967304 rc 0/0 00000100:00100000:3.0:1789477370.700954:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 4 00000100:00100000:0.0:1789477370.709780:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:3.0:1789477370.710382:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783669888 00000100:00100000:3.0:1789477370.710760:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783669888 00000100:00100000:3.0:1789477370.711230:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 27 00000100:00100000:3.0:1789477370.711246:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d74cdaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9bc33f26-0aab-4a14-832f-c58d566de1b0+14:9688:x1876402783669888:12345-192.168.201.23@tcp:101:rm.0 00010000:00010000:3.0:1789477370.711279:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789477370.711310:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49eca800/0xafddb3c8f928185d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa90d500d7b8f2a96 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477370.711467:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49ecb400/0xafddb3c8f9281864 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477370.711503:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49ecb400/0xafddb3c8f9281864 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477370.711515:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49ecb400/0xafddb3c8f9281864 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789477370.711527:0:5844:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00010000:00010000:3.0:1789477370.711745:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49eca800/0xafddb3c8f928185d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2a96 expref: 17 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477370.711766:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49ecb400/0xafddb3c8f9281864 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2a96 expref: 16 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477370.711775:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9d0d596ae700) 00010000:00010000:3.0:1789477370.711778:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1789477370.711782:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d0d49ecb400, rc 0) 00000100:00100000:3.0:1789477370.711875:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d74cdaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9bc33f26-0aab-4a14-832f-c58d566de1b0+16:9688:x1876402783669888:12345-192.168.201.23@tcp:101:rm.0 Request processed in 633us (2106us total) trans 4294967305 rc 0/0 00000100:00100000:3.0:1789477370.711883:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 27 00000100:00100000:0.0:1789477370.719070:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:3.0:1789477370.719230:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783670016 00000100:00100000:3.0:1789477370.719240:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783670016 00000100:00100000:3.0:1789477370.719317:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 28 00000100:00100000:3.0:1789477370.719329:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d74cd9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9bc33f26-0aab-4a14-832f-c58d566de1b0+16:9688:x1876402783670016:12345-192.168.201.23@tcp:41:rm.0 00000004:00000024:3.0:1789477370.719401:0:5846:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 7719616512 avail 7715422208 00000100:00100000:3.0:1789477370.719487:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d74cd9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9bc33f26-0aab-4a14-832f-c58d566de1b0+16:9688:x1876402783670016:12345-192.168.201.23@tcp:41:rm.0 Request processed in 160us (432us total) trans 0 rc 0/0 00000100:00100000:3.0:1789477370.719495:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 28 00000100:00100000:1.0:1789477370.727746:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:2.0:1789477370.729359:0:6999:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783670144 00000100:00100000:2.0:1789477370.729379:0:6999:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783670144 00000100:00100000:2.0:1789477370.729592:0:6999:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 29 00000100:00100000:2.0:1789477370.729604:0:6999:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d6d466d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9bc33f26-0aab-4a14-832f-c58d566de1b0+16:9688:x1876402783670144:12345-192.168.201.23@tcp:101:rm.0 00010000:00010000:2.0:1789477370.729629:0:6999:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789477370.729654:0:6999:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d59d6b400/0xafddb3c8f9281872 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa90d500d7b8f2a9d expref: -99 pid: 6999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477370.729731:0:6999:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d59d6a800/0xafddb3c8f9281879 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477370.729747:0:6999:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d59d6a800/0xafddb3c8f9281879 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477370.729760:0:6999:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d59d6a800/0xafddb3c8f9281879 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477370.729776:0:6999:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d59d6a400/0xafddb3c8f9281880 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x27b6432d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477370.729783:0:6999:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d59d6a400/0xafddb3c8f9281880 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x27b6432d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477370.729820:0:6999:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d59d6a400/0xafddb3c8f9281880 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x27b6432d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477370.729978:0:6999:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d59d6aa00/0xafddb3c8f9281887 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477370.729997:0:6999:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d59d6aa00/0xafddb3c8f9281887 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477370.730005:0:6999:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d59d6aa00/0xafddb3c8f9281887 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789477370.730508:0:6999:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x2:0x0]: returning size 0 00000004:00200000:2.0:1789477370.730514:0:6999:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1789477370.730537:0:6999:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d59d6aa00/0xafddb3c8f9281887 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477370.730551:0:6999:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d59d6aa00/0xafddb3c8f9281887 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477370.730559:0:6999:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d59d6a800/0xafddb3c8f9281879 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477370.730565:0:6999:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d59d6a800/0xafddb3c8f9281879 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477370.730573:0:6999:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d59d6a800/0xafddb3c8f9281879 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477370.730603:0:6999:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d0d59d6a800 already unused, calling callback (ffffffffc1fd54f0) 00010000:00010000:2.0:1789477370.730609:0:6999:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d59d6a800/0xafddb3c8f9281879 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477370.730626:0:6999:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d59d6a800/0xafddb3c8f9281879 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477370.730638:0:6999:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9d0d596ae700) 00010000:00010000:2.0:1789477370.730642:0:6999:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789477370.730646:0:6999:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d59d6a800/0xafddb3c8f9281879 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477370.730653:0:6999:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d59d6a800/0xafddb3c8f9281879 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477370.730670:0:6999:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d59d6a400/0xafddb3c8f9281880 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x27b6432d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477370.730674:0:6999:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d59d6a400/0xafddb3c8f9281880 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x27b6432d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477370.730680:0:6999:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d59d6a400/0xafddb3c8f9281880 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x27b6432d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477370.730684:0:6999:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d0d59d6a400 already unused, calling callback (ffffffffc1fd54f0) 00010000:00010000:2.0:1789477370.730687:0:6999:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d59d6a400/0xafddb3c8f9281880 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x27b6432d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477370.730693:0:6999:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d59d6a400/0xafddb3c8f9281880 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x27b6432d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477370.730700:0:6999:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x27b6432d (ffff9d0d50919000) 00010000:00010000:2.0:1789477370.730703:0:6999:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789477370.730705:0:6999:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d59d6a400/0xafddb3c8f9281880 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x27b6432d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477370.730721:0:6999:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d59d6a400/0xafddb3c8f9281880 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x27b6432d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477370.730758:0:6999:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d59d6b400/0xafddb3c8f9281872 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2a9d expref: 18 pid: 6999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477370.730774:0:6999:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d59d6aa00/0xafddb3c8f9281887 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2a9d expref: 17 pid: 6999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477370.730782:0:6999:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9d0d44568b00) 00010000:00010000:2.0:1789477370.730784:0:6999:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789477370.730787:0:6999:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d0d59d6aa00, rc 0) 00000100:00100000:2.0:1789477370.730886:0:6999:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d6d466d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9bc33f26-0aab-4a14-832f-c58d566de1b0+17:9688:x1876402783670144:12345-192.168.201.23@tcp:101:rm.0 Request processed in 1283us (3148us total) trans 0 rc 0/0 00000100:00100000:2.0:1789477370.730908:0:6999:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 29 00000100:00100000:0.0:1789477370.738827:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:3.0:1789477370.739103:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783670400 00000100:00100000:3.0:1789477370.739116:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783670400 00000100:00100000:3.0:1789477370.739186:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 30 00000100:00100000:3.0:1789477370.739197:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d74cdb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9bc33f26-0aab-4a14-832f-c58d566de1b0+17:9688:x1876402783670400:12345-192.168.201.23@tcp:36:rm.0 00010000:00010000:3.0:1789477370.739254:0:5846:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:3.0:1789477370.739285:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d59d6aa00/0xafddb3c8f9281887 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2a9d expref: 17 pid: 6999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477370.739309:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be5e00/0xafddb3c8f9281833 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2a81 expref: 16 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477370.739322:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9d0d44568b00) 00010000:00010000:3.0:1789477370.739337:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d59d6be00/0xafddb3c8f9281848 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2a88 expref: 15 pid: 6999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477370.739346:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9d0d596ae700) 00010000:00010000:3.0:1789477370.739350:0:5846:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789477370.739377:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49eca800/0xafddb3c8f928188e lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477370.739390:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49eca800/0xafddb3c8f928188e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477370.739400:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49eca800/0xafddb3c8f928188e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477370.739413:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49eca000/0xafddb3c8f9281895 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0x27b6432d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477370.739420:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49eca000/0xafddb3c8f9281895 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x27b6432d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477370.739443:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49eca000/0xafddb3c8f9281895 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x27b6432d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477370.739739:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49ecbc00/0xafddb3c8f928189c lrc: 3/0,1 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477370.739748:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49ecbc00/0xafddb3c8f928189c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477370.739755:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49ecbc00/0xafddb3c8f928189c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1789477370.746061:0:5846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].2, 64 off8320 00000004:00080000:3.0:1789477370.746097:0:5846:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 315817518177ns, next at 316817513231ns, rc = 0 00010000:00010000:3.0:1789477370.746189:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49eca600/0xafddb3c8f92818a3 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477370.746208:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49eca600/0xafddb3c8f92818a3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477370.746220:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49eca600/0xafddb3c8f92818a3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477370.746228:0:5846:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49eca600/0xafddb3c8f92818a3 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477370.746234:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49eca600/0xafddb3c8f92818a3 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477370.746240:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49eca600/0xafddb3c8f92818a3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477370.746290:0:5846:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789477370.746313:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49ecbc00/0xafddb3c8f928189c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477370.746320:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49ecbc00/0xafddb3c8f928189c lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477370.746327:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49ecbc00/0xafddb3c8f928189c lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477370.746332:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d0d49ecbc00 already unused, calling callback (ffffffffc1fd54f0) 00010000:00010000:3.0:1789477370.746336:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49ecbc00/0xafddb3c8f928189c lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477370.746344:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49ecbc00/0xafddb3c8f928189c lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477370.746357:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9d0d44568100) 00010000:00010000:3.0:1789477370.746360:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1789477370.746364:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49ecbc00/0xafddb3c8f928189c lrc: 2/0,0 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477370.746370:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49ecbc00/0xafddb3c8f928189c lrc: 0/0,0 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477370.746388:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49eca800/0xafddb3c8f928188e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477370.746405:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49eca800/0xafddb3c8f928188e lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477370.746411:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49eca800/0xafddb3c8f928188e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477370.746421:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d0d49eca800 already unused, calling callback (ffffffffc1fd54f0) 00010000:00010000:3.0:1789477370.746424:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49eca800/0xafddb3c8f928188e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477370.746430:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49eca800/0xafddb3c8f928188e lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477370.746438:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9d0d596ae700) 00010000:00010000:3.0:1789477370.746440:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789477370.746443:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49eca800/0xafddb3c8f928188e lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477370.746449:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49eca800/0xafddb3c8f928188e lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789477370.746459:0:5846:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000a14a5c62 reply state 00000000b414e70b transno 4294967306 ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49eca000/0xafddb3c8f9281895 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x27b6432d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789477370.746467:0:5846:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789477370.746599:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d74cdb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9bc33f26-0aab-4a14-832f-c58d566de1b0+16:9688:x1876402783670400:12345-192.168.201.23@tcp:36:rm.0 Request processed in 7379us (7759us total) trans 4294967306 rc 0/0 00000100:00100000:3.0:1789477370.746610:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 30 00010000:00010000:0.0:1789477370.746932:0:5833:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789477370.746940:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49eca600/0xafddb3c8f92818a3 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477370.746947:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d0d49eca600 already unused, calling callback (ffffffffc15972a0) 00010000:00010000:0.0:1789477370.746950:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49eca600/0xafddb3c8f92818a3 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477370.746957:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49eca600/0xafddb3c8f92818a3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477370.746967:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9d0d44568100) 00010000:00010000:0.0:1789477370.746969:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1789477370.746971:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49eca600/0xafddb3c8f92818a3 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477370.746976:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49eca600/0xafddb3c8f92818a3 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477370.746991:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789477370.746993:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789477370.747001:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789477370.753441:0:3296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49eca000/0xafddb3c8f9281895 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x27b6432d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477370.753462:0:3296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49eca000/0xafddb3c8f9281895 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x27b6432d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477370.753471:0:3296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49eca000/0xafddb3c8f9281895 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x27b6432d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477370.753478:0:3296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d0d49eca000 already unused, calling callback (ffffffffc1fd54f0) 00010000:00010000:2.0:1789477370.753483:0:3296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49eca000/0xafddb3c8f9281895 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x27b6432d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477370.753491:0:3296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49eca000/0xafddb3c8f9281895 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x27b6432d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477370.753525:0:3296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x27b6432d (ffff9d0d44568800) 00010000:00010000:2.0:1789477370.753528:0:3296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789477370.753533:0:3296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49eca000/0xafddb3c8f9281895 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x27b6432d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477370.753539:0:3296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49eca000/0xafddb3c8f9281895 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x27b6432d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789477370.768981:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:2.0:1789477370.769101:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783670656 00000100:00100000:2.0:1789477370.769114:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783670656 00000100:00100000:2.0:1789477370.769178:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 5 00000100:00100000:2.0:1789477370.769188:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d74cd9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9bc33f26-0aab-4a14-832f-c58d566de1b0+15:9688:x1876402783670656:12345-192.168.201.23@tcp:35:rm.0 00000100:00100000:2.0:1789477370.769472:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d74cd9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9bc33f26-0aab-4a14-832f-c58d566de1b0+16:9688:x1876402783670656:12345-192.168.201.23@tcp:35:rm.0 Request processed in 284us (499us total) trans 4294967307 rc 0/0 00000100:00100000:2.0:1789477370.769480:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 5 00000100:00100000:0.0:1789477370.786408:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:3.0:1789477370.787075:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783670912 00000100:00100000:3.0:1789477370.787086:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783670912 00000100:00100000:3.0:1789477370.787157:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 31 00000100:00100000:3.0:1789477370.787168:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d74cdb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9bc33f26-0aab-4a14-832f-c58d566de1b0+16:9688:x1876402783670912:12345-192.168.201.23@tcp:36:rm.0 00010000:00010000:3.0:1789477370.787361:0:5844:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:3.0:1789477370.787393:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49ecb400/0xafddb3c8f9281864 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2a96 expref: 16 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477370.788323:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be4200/0xafddb3c8f9281802 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2a73 expref: 15 pid: 6999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477370.788339:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9d0d596ae700) 00010000:00010000:3.0:1789477370.788359:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d82150800/0xafddb3c8f92817c3 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2a65 expref: 14 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477370.788368:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9d0d596aed00) 00010000:00010000:3.0:1789477370.788374:0:5844:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789477370.788402:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49eca800/0xafddb3c8f92818aa lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477370.788414:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49eca800/0xafddb3c8f92818aa lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477370.790117:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49eca800/0xafddb3c8f92818aa lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477370.791457:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49ecbc00/0xafddb3c8f92818b1 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477370.791480:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49ecbc00/0xafddb3c8f92818b1 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477370.791490:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49ecbc00/0xafddb3c8f92818b1 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477370.791879:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49ecba00/0xafddb3c8f92818b8 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477370.792371:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49ecba00/0xafddb3c8f92818b8 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477370.792382:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49ecba00/0xafddb3c8f92818b8 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789477370.802905:0:5844:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00010000:00010000:3.0:1789477370.802939:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49ecba00/0xafddb3c8f92818b8 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477370.802951:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49ecba00/0xafddb3c8f92818b8 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477370.802959:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49ecba00/0xafddb3c8f92818b8 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477370.802965:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d0d49ecba00 already unused, calling callback (ffffffffc1fd54f0) 00010000:00010000:3.0:1789477370.802969:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49ecba00/0xafddb3c8f92818b8 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477370.802977:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49ecba00/0xafddb3c8f92818b8 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477370.803005:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9d0d44568400) 00010000:00010000:3.0:1789477370.803008:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1789477370.803013:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49ecba00/0xafddb3c8f92818b8 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477370.803019:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49ecba00/0xafddb3c8f92818b8 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477370.803054:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49eca800/0xafddb3c8f92818aa lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477370.803080:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49eca800/0xafddb3c8f92818aa lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477370.803085:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49eca800/0xafddb3c8f92818aa lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477370.803090:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d0d49eca800 already unused, calling callback (ffffffffc1fd54f0) 00010000:00010000:3.0:1789477370.803092:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49eca800/0xafddb3c8f92818aa lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477370.803098:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49eca800/0xafddb3c8f92818aa lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477370.803106:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9d0d44568b00) 00010000:00010000:3.0:1789477370.803109:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789477370.803112:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49eca800/0xafddb3c8f92818aa lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477370.803118:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49eca800/0xafddb3c8f92818aa lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789477370.803132:0:5844:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000081e8c672 reply state 00000000bae798a9 transno 4294967308 ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49ecbc00/0xafddb3c8f92818b1 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789477370.803142:0:5844:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789477370.803258:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d74cdb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9bc33f26-0aab-4a14-832f-c58d566de1b0+15:9688:x1876402783670912:12345-192.168.201.23@tcp:36:rm.0 Request processed in 16088us (16860us total) trans 4294967308 rc 0/0 00000100:00100000:3.0:1789477370.803270:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 31 00010000:00010000:0.0:1789477370.812535:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49ecbc00/0xafddb3c8f92818b1 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477370.812569:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49ecbc00/0xafddb3c8f92818b1 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477370.812719:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49ecbc00/0xafddb3c8f92818b1 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477370.812725:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d0d49ecbc00 already unused, calling callback (ffffffffc1fd54f0) 00010000:00010000:0.0:1789477370.812730:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49ecbc00/0xafddb3c8f92818b1 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477370.812738:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49ecbc00/0xafddb3c8f92818b1 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477370.812758:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff9d0d44568600) 00010000:00010000:0.0:1789477370.812761:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789477370.812765:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49ecbc00/0xafddb3c8f92818b1 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477370.812770:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49ecbc00/0xafddb3c8f92818b1 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789477371.312198:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789477371.312233:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d6d464e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1876402802577280:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789477371.312330:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789477371.312455:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802577280 00000100:00100000:0.0:1789477371.312463:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802577280 00000100:00100000:0.0:1789477371.312541:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1789477371.312553:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d74f84700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1876402802577280:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789477371.312612:0:6698:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789477371.312670:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d74f84700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1876402802577280:12345-0@lo:13:osp-pre-0-0.0 Request processed in 119us (340us total) trans 0 rc 0/0 00000100:00100000:0.0:1789477371.312678:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00080000:3.0:1789477371.312839:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1789477371.312873:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d0d6d464e00 x1876402802577280/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789477387 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789477371.312906:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d6d464e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1876402802577280:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1789477371.572489:0:6710:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789477372.592677:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789477372.914956:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:0.0:1789477372.915001:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:0.0:1789477372.915040:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:0.0:1789477372.915071:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:2.0:1789477372.915159:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783671296 00000100:00100000:2.0:1789477372.915170:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783671296 00000100:00100000:2.0:1789477372.915243:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 48 00000100:00100000:2.0:1789477372.915254:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d74a88000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9bc33f26-0aab-4a14-832f-c58d566de1b0+5:2353:x1876402783671296:12345-192.168.201.23@tcp:400:kworker.0 00000100:00100000:2.0:1789477372.915326:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d74a88000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9bc33f26-0aab-4a14-832f-c58d566de1b0+5:2353:x1876402783671296:12345-192.168.201.23@tcp:400:kworker.0 Request processed in 74us (324us total) trans 0 rc 0/0 00000100:00100000:2.0:1789477372.915334:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 48 00000100:00100000:2.0:1789477372.915357:0:6999:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783671168 00000100:00100000:2.0:1789477372.915361:0:6999:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783671168 00000100:00100000:2.0:1789477372.915387:0:6999:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783671424 00000100:00100000:2.0:1789477372.915390:0:6999:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783671424 00000100:00100000:2.0:1789477372.915429:0:6999:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 99 00000100:00100000:2.0:1789477372.915435:0:6999:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d74a8b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9bc33f26-0aab-4a14-832f-c58d566de1b0+14:2353:x1876402783671168:12345-192.168.201.23@tcp:400:kworker.0 00000100:00100000:2.0:1789477372.915472:0:6999:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d74a8b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9bc33f26-0aab-4a14-832f-c58d566de1b0+14:2353:x1876402783671168:12345-192.168.201.23@tcp:400:kworker.0 Request processed in 38us (431us total) trans 0 rc 0/0 00000100:00100000:2.0:1789477372.915479:0:6999:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 99 00000100:00100000:2.0:1789477372.915503:0:6999:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 100 00000100:00100000:2.0:1789477372.915510:0:6999:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d74a8aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cf70c55a-e056-446b-8936-49e7cd31fc79+5:2353:x1876402783671424:12345-192.168.201.23@tcp:400:kworker.0 00000100:00100000:2.0:1789477372.915534:0:6999:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d74a8aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cf70c55a-e056-446b-8936-49e7cd31fc79+5:2353:x1876402783671424:12345-192.168.201.23@tcp:400:kworker.0 Request processed in 25us (463us total) trans 0 rc 0/0 00000100:00100000:2.0:1789477372.915540:0:6999:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 100 00000100:00100000:1.0:1789477372.915747:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783671040 00000100:00100000:1.0:1789477372.915752:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783671040 00000100:00100000:1.0:1789477372.915788:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 248 00000100:00100000:1.0:1789477372.915795:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d4e676850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5c82dded-6a10-4ce8-abd1-52bd956b9523+13:2353:x1876402783671040:12345-192.168.201.23@tcp:400:kworker.0 00000100:00100000:1.0:1789477372.915823:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d4e676850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5c82dded-6a10-4ce8-abd1-52bd956b9523+13:2353:x1876402783671040:12345-192.168.201.23@tcp:400:kworker.0 Request processed in 30us (888us total) trans 0 rc 0/0 00000100:00100000:1.0:1789477372.915829:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 248 00000100:00080000:0.0:1789477372.916320:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789477372.916325:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1789477373.615934:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789477373.872096:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d6d464700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:07d5e05c-913f-419f-adbc-d3cf15e9cd51:3312:1876402802577408:0@lo:400:kworker.0 00000100:00100000:1.0:1789477373.872183:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789477373.872232:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d4766b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3312:1876402802577920:0@lo:400:kworker.0 00000100:00100000:1.0:1789477373.872271:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789477373.872298:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1789477373.872304:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d6d464e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3312:1876402802577536:0@lo:400:kworker.0 00000100:00100000:1.0:1789477373.872325:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789477373.872346:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d47668700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1876402802578048:0@lo:400:kworker.0 00000100:00100000:1.0:1789477373.872370:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789477373.872398:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d6d464380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1876402802577664:0@lo:400:kworker.0 00000100:00100000:1.0:1789477373.872419:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789477373.872439:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789477373.872446:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d47668380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3310:1876402802577792:0@lo:400:kworker.0 00000100:00100000:1.0:1789477373.872464:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789477373.872508:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802577408 00000100:00100000:1.0:1789477373.872515:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802577408 00000100:00100000:1.0:1789477373.872561:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 249 00000100:00100000:1.0:1789477373.872570:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d4e674c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07d5e05c-913f-419f-adbc-d3cf15e9cd51+19:3312:x1876402802577408:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789477373.872650:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d4e674c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07d5e05c-913f-419f-adbc-d3cf15e9cd51+19:3312:x1876402802577408:12345-0@lo:400:kworker.0 Request processed in 81us (467us total) trans 0 rc 0/0 00000100:00100000:1.0:1789477373.872658:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 249 00000100:00100000:1.0:1789477373.872689:0:6999:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802577920 00000100:00100000:1.0:1789477373.872703:0:6999:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802577920 00000100:00100000:1.0:1789477373.872738:0:6999:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802577536 00000100:00100000:1.0:1789477373.872741:0:6999:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802577536 00000100:00100000:1.0:1789477373.872751:0:6999:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802577792 00000100:00100000:1.0:1789477373.872753:0:6999:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802577792 00000100:00100000:1.0:1789477373.872767:0:6999:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1789477373.872773:0:6999:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d47668000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1876402802577920:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789477373.872804:0:6999:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d47668000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1876402802577920:12345-0@lo:400:kworker.0 Request processed in 31us (532us total) trans 0 rc 0/0 00000100:00100000:1.0:1789477373.872810:0:6999:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1789477373.872824:0:6999:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1789477373.872830:0:6999:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d47669880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1876402802577536:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789477373.872868:0:6999:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d47669880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1876402802577536:12345-0@lo:400:kworker.0 Request processed in 38us (542us total) trans 0 rc 0/0 00000100:00100000:1.0:1789477373.872875:0:6999:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1789477373.872886:0:6999:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1789477373.872891:0:6999:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d47669f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1876402802577792:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789477373.872924:0:6999:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d47669f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1876402802577792:12345-0@lo:400:kworker.0 Request processed in 33us (458us total) trans 0 rc 0/0 00000100:00100000:1.0:1789477373.872938:0:6999:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1789477373.872959:0:8241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802578048 00000100:00100000:1.0:1789477373.872963:0:8241:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802578048 00000100:00100000:1.0:1789477373.872984:0:8241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802577664 00000100:00100000:1.0:1789477373.872987:0:8241:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802577664 00000100:00100000:1.0:1789477373.873003:0:8241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1789477373.873009:0:8241:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d4766b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3312:x1876402802578048:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789477373.873041:0:8241:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d4766b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3312:x1876402802578048:12345-0@lo:400:kworker.0 Request processed in 32us (669us total) trans 0 rc 0/0 00000100:00100000:1.0:1789477373.873047:0:8241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1789477373.873058:0:8241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1789477373.873064:0:8241:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d47668a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3310:x1876402802577664:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789477373.873089:0:8241:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d47668a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3310:x1876402802577664:12345-0@lo:400:kworker.0 Request processed in 25us (669us total) trans 0 rc 0/0 00000100:00100000:1.0:1789477373.873094:0:8241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00080000:1.0:1789477373.873127:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789477373.873131:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789477373.873133:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789477373.873159:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d47668380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3310:1876402802577792:0@lo:400:kworker.0 00010000:00080000:1.0:1789477373.873172:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d0d6d464380 x1876402802577664/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789477389 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789477373.873183:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d6d464380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1876402802577664:0@lo:400:kworker.0 00000100:00100000:1.0:1789477373.873214:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d6d464e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3312:1876402802577536:0@lo:400:kworker.0 00010000:00080000:1.0:1789477373.873224:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d0d47668700 x1876402802578048/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789477389 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789477373.873244:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d47668700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1876402802578048:0@lo:400:kworker.0 00000100:00100000:1.0:1789477373.873255:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d6d464700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:07d5e05c-913f-419f-adbc-d3cf15e9cd51:3312:1876402802577408:0@lo:400:kworker.0 00000100:00100000:1.0:1789477373.873263:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d4766b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3312:1876402802577920:0@lo:400:kworker.0 00000004:00080000:3.0:1789477373.873495:0:8044:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 318944916442ns, next at 319944914232ns, rc = 0 00000100:00100000:3.0:1789477373.873517:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789477373.873527:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d74f84e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1876402802578176:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789477373.873558:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789477373.873611:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802578176 00000100:00100000:3.0:1789477373.873615:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802578176 00000100:00100000:3.0:1789477373.873645:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1789477373.873652:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d753e3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1876402802578176:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789477373.873677:0:6698:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789477373.873722:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d753e3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1876402802578176:12345-0@lo:13:osp-pre-1-0.0 Request processed in 71us (163us total) trans 0 rc 0/0 00000100:00100000:3.0:1789477373.873729:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00010000:00080000:3.0:1789477373.873759:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d0d74f84e00 x1876402802578176/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789477389 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789477373.873774:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d74f84e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1876402802578176:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1789477374.641505:0:6710:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1789477375.489432:0:5868:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967303 is committed 00000001:00080000:1.0:1789477375.489464:0:5868:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967307 is committed 00000004:00080000:1.0:1789477375.489475:0:5868:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3 committed 00000001:00080000:1.0:1789477375.489500:0:5868:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967308 is committed 00000004:00080000:1.0:1789477375.489506:0:5868:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00000100:00100000:1.0:1789477375.491179:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789477375.506496:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d7c3e7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1876402802578304:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1789477375.506625:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789477375.506929:0:8241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802578304 00000100:00100000:0.0:1789477375.506941:0:8241:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802578304 00000100:00100000:0.0:1789477375.507039:0:8241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1789477375.507053:0:8241:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d7c3e5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3310:x1876402802578304:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1789477375.507100:0:8241:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:2 count 1 00000100:00080000:1.0:1789477375.507113:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00002000:00010000:0.0:1789477375.507167:0:8241:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x2:0x0] initial LVB size: 0, mtime: 0x6aa941f9, atime: 0x6aa941f9, ctime: 0x6aa941f9, blocks: 0x1 00010000:00010000:0.0:1789477375.507179:0:8241:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000985d5bfd/0xafddb3c8f92818bf lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477375.507203:0:8241:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=320s v=(0 0) 00010000:00010000:0.0:1789477375.507209:0:8241:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789477375.507217:0:8241:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000985d5bfd/0xafddb3c8f92818bf lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477375.507240:0:8241:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000985d5bfd/0xafddb3c8f92818bf lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477375.507252:0:8241:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000985d5bfd/0xafddb3c8f92818bf lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477375.507270:0:8241:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000985d5bfd/0xafddb3c8f92818bf lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477375.507296:0:8241:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789477375.507344:0:5832:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789477375.507351:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000985d5bfd/0xafddb3c8f92818bf lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477375.507359:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d0d50be4c00 already unused, calling callback (ffffffffc15972a0) 00010000:00010000:2.0:1789477375.507364:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000985d5bfd/0xafddb3c8f92818bf lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477375.507374:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000985d5bfd/0xafddb3c8f92818bf lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477375.507396:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000985d5bfd/0xafddb3c8f92818bf lrc: 1/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477375.507415:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000985d5bfd/0xafddb3c8f92818bf lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477375.507441:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789477375.507442:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789477375.507444:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789477375.508139:0:8241:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d7c3e5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3310:x1876402802578304:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1086us (1512us total) trans 4294967300 rc 0/0 00000100:00100000:0.0:1789477375.508149:0:8241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000004:00080000:2.0:1789477375.508391:0:3310:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9d0d7c3e7100/2, rc 0, transno 4294967300 00000100:00100000:2.0:1789477375.508400:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d7c3e7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1876402802578304:0@lo:6:osp-syn-1-0.0 00010000:00010000:0.0:1789477375.663744:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1789477375.914276:0:11648:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: excepting tests: 6 7a 7b 23 35 33 00000001:00080000:0.0:1789477376.074503:0:7678:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967300 is committed 00000100:00100000:0.0:1789477376.433226:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789477376.433258:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d4766b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1876402802578432:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789477376.433371:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789477376.433705:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802578432 00000100:00100000:1.0:1789477376.433717:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802578432 00000100:00100000:1.0:1789477376.433829:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1789477376.433841:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d74a8bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1876402802578432:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789477376.433887:0:6698:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789477376.433944:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d74a8bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1876402802578432:12345-0@lo:13:osp-pre-0-0.0 Request processed in 105us (574us total) trans 0 rc 0/0 00000100:00100000:1.0:1789477376.433952:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00080000:1.0:1789477376.433993:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1789477376.434217:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d0d4766b480 x1876402802578432/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789477392 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789477376.434243:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d4766b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1876402802578432:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1789477376.695048:0:6710:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1789477377.262113:0:11699:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fff1d03b220 20000000:00000080:2.0:1789477377.262133:0:11699:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9d0d6ce47c00 uarg=0000000000000000 20000000:01000000:2.0:1789477377.262171:0:11699:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='lustre' param='mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:2.0:1789477377.262177:0:11699:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:2.0:1789477377.262182:0:11699:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/lustre/mdt.lustre-MDT0000.hsm_control=enabled del=0 00000040:00080000:1.0:1789477377.264225:0:11700:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 20000000:02000000:2.0:1789477377.264828:0:11699:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre.mdt.lustre-MDT0000.hsm_control=enabled in log params 00000040:00080000:3.0:1789477377.273539:0:11699:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9536 00000040:00080000:3.0:1789477377.273739:0:11699:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].8, 128 off9664 00000040:00080000:3.0:1789477377.273821:0:11699:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].9, 224 off9888 10000000:01000000:3.0:1789477377.273839:0:11699:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1789477377.273859:0:11699:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9d0d49ecba00/0xafddb3c8f92818c6 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477377.273878:0:11699:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9d0d59d6b600/0xafddb3c8f9281768 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xafddb3c8f9281761 expref: 18 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477377.273886:0:11699:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9d0d41647a00/0xafddb3c8f9281776 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xafddb3c8f928176f expref: 18 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477377.273893:0:11699:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9d0d41647000/0xafddb3c8f9281784 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xafddb3c8f928177d expref: 18 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477377.273903:0:11699:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9d0d41647800/0xafddb3c8f928178b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2a50 expref: 12 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477377.273910:0:11699:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9d0d7f519000/0xafddb3c8f9281792 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2a57 expref: 12 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477377.273916:0:11699:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9d0d49ecba00/0xafddb3c8f92818c6 lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 11699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477377.273961:0:11699:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9d0d7f519000/0xafddb3c8f9281792 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2a57 expref: 12 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477377.273975:0:11699:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9d0d7f519000/0xafddb3c8f9281792 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2a57 expref: 12 pid: 5838 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789477377.273991:0:11699:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d74f84e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11699:1876402802578560:192.168.201.23@tcp:104: 00010000:00010000:3.0:1789477377.275021:0:11699:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9d0d41647800/0xafddb3c8f928178b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2a50 expref: 12 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477377.275042:0:11699:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9d0d41647800/0xafddb3c8f928178b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2a50 expref: 12 pid: 5838 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789477377.275056:0:11699:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d7f544a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11699:1876402802578688:192.168.201.23@tcp:104: 00010000:00010000:3.0:1789477377.275172:0:11699:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9d0d41647000/0xafddb3c8f9281784 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xafddb3c8f928177d expref: 18 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477377.275181:0:11699:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9d0d41647000/0xafddb3c8f9281784 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xafddb3c8f928177d expref: 18 pid: 5839 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789477377.275191:0:11699:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d7f545f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11699:1876402802578816:0@lo:104: 00000100:00100000:3.0:1789477377.275232:0:11699:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789477377.275274:0:11699:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9d0d41647a00/0xafddb3c8f9281776 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xafddb3c8f928176f expref: 18 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477377.275283:0:11699:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9d0d41647a00/0xafddb3c8f9281776 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xafddb3c8f928176f expref: 18 pid: 5838 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789477377.275290:0:11699:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d7f546300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11699:1876402802578944:0@lo:104: 00000100:00100000:3.0:1789477377.275315:0:11699:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789477377.275355:0:5828:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1789477377.275367:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802578816 00000100:00100000:3.0:1789477377.275374:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802578816 00000100:00100000:3.0:1789477377.275410:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802578944 00000100:00100000:3.0:1789477377.275413:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802578944 00000100:00100000:3.0:1789477377.275426:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1789477377.275435:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d7f547b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:07d5e05c-913f-419f-adbc-d3cf15e9cd51+4:11699:x1876402802578816:12345-0@lo:104: 00010000:00010000:3.0:1789477377.275447:0:5828:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.123@tcp lock: ffff9d0d41646a00/0xafddb3c8f928177d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xafddb3c8f9281784 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477377.275498:0:5828:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1789477377.275505:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d7f547b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:07d5e05c-913f-419f-adbc-d3cf15e9cd51+4:11699:x1876402802578816:12345-0@lo:104: Request processed in 71us (273us total) trans 0 rc 0/0 00000100:00100000:3.0:1789477377.275513:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1789477377.275531:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1789477377.275537:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d6d49c450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:07d5e05c-913f-419f-adbc-d3cf15e9cd51+3:11699:x1876402802578944:12345-0@lo:104: 00010000:00010000:3.0:1789477377.275544:0:5828:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.123@tcp lock: ffff9d0d82151200/0xafddb3c8f928176f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xafddb3c8f9281776 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477377.275607:0:5828:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1789477377.275613:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d6d49c450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:07d5e05c-913f-419f-adbc-d3cf15e9cd51+3:11699:x1876402802578944:12345-0@lo:104: Request processed in 76us (296us total) trans 0 rc 0/0 00000100:00100000:3.0:1789477377.275618:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00010000:3.0:1789477377.275667:0:11699:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9d0d59d6b600/0xafddb3c8f9281768 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xafddb3c8f9281761 expref: 18 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477377.275675:0:11699:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9d0d59d6b600/0xafddb3c8f9281768 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xafddb3c8f9281761 expref: 18 pid: 5837 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789477377.275682:0:11699:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d7f547b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11699:1876402802579072:0@lo:104: 00000100:00100000:3.0:1789477377.275705:0:11699:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789477377.275724:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802579072 00000100:00100000:3.0:1789477377.275727:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802579072 00000100:00100000:3.0:1789477377.275744:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1789477377.275750:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d7f545500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:07d5e05c-913f-419f-adbc-d3cf15e9cd51+3:11699:x1876402802579072:12345-0@lo:104: 00010000:00010000:3.0:1789477377.275758:0:5828:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.123@tcp lock: ffff9d0d82150600/0xafddb3c8f9281761 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xafddb3c8f9281768 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477377.275813:0:5828:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:3.0:1789477377.275818:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d7f545500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:07d5e05c-913f-419f-adbc-d3cf15e9cd51+3:11699:x1876402802579072:12345-0@lo:104: Request processed in 69us (112us total) trans 0 rc 0/0 00000100:00100000:3.0:1789477377.275823:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00010000:00010000:3.0:1789477377.275842:0:6710:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1789477377.275848:0:6710:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.123@tcp lock: ffff9d0d41646a00/0xafddb3c8f928177d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xafddb3c8f9281784 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477377.275855:0:6710:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d0d41646a00 already unused, calling callback (ffffffffc1bb3c20) 10000000:00010000:3.0:1789477377.275859:0:6710:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.123@tcp lock: ffff9d0d41646a00/0xafddb3c8f928177d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xafddb3c8f9281784 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477377.275867:0:6710:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.123@tcp lock: ffff9d0d41646a00/0xafddb3c8f928177d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xafddb3c8f9281784 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789477377.275875:0:6710:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.123@tcp lock: ffff9d0d41646a00/0xafddb3c8f928177d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xafddb3c8f9281784 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789477377.275881:0:6710:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1789477377.275910:0:6710:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.123@tcp lock: ffff9d0d41646a00/0xafddb3c8f928177d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xafddb3c8f9281784 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477377.275917:0:6710:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789477377.275937:0:6710:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.123@tcp lock: ffff9d0d41646a00/0xafddb3c8f928177d lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xafddb3c8f9281784 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477377.275944:0:6710:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.123@tcp lock: ffff9d0d41646a00/0xafddb3c8f928177d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xafddb3c8f9281784 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477377.275969:0:6710:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1789477377.275973:0:6710:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.123@tcp lock: ffff9d0d82151200/0xafddb3c8f928176f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xafddb3c8f9281776 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477377.275979:0:6710:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d0d82151200 already unused, calling callback (ffffffffc1bb3c20) 10000000:00010000:3.0:1789477377.275982:0:6710:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.123@tcp lock: ffff9d0d82151200/0xafddb3c8f928176f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xafddb3c8f9281776 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477377.275989:0:6710:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.123@tcp lock: ffff9d0d82151200/0xafddb3c8f928176f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xafddb3c8f9281776 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789477377.275995:0:6710:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.123@tcp lock: ffff9d0d82151200/0xafddb3c8f928176f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xafddb3c8f9281776 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789477377.276000:0:6710:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1789477377.276015:0:6710:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.123@tcp lock: ffff9d0d82151200/0xafddb3c8f928176f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xafddb3c8f9281776 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477377.276021:0:6710:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789477377.276033:0:6710:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.123@tcp lock: ffff9d0d82151200/0xafddb3c8f928176f lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xafddb3c8f9281776 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477377.276040:0:6710:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.123@tcp lock: ffff9d0d82151200/0xafddb3c8f928176f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xafddb3c8f9281776 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477377.276048:0:6710:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789477377.276051:0:6710:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.123@tcp lock: ffff9d0d82150600/0xafddb3c8f9281761 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xafddb3c8f9281768 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477377.276066:0:6710:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d0d82150600 already unused, calling callback (ffffffffc1bb3c20) 10000000:00010000:3.0:1789477377.276069:0:6710:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.123@tcp lock: ffff9d0d82150600/0xafddb3c8f9281761 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xafddb3c8f9281768 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477377.276075:0:6710:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.123@tcp lock: ffff9d0d82150600/0xafddb3c8f9281761 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xafddb3c8f9281768 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789477377.276081:0:6710:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.123@tcp lock: ffff9d0d82150600/0xafddb3c8f9281761 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xafddb3c8f9281768 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789477377.276086:0:6710:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1789477377.276458:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789477377.276475:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d7f546d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:07d5e05c-913f-419f-adbc-d3cf15e9cd51:3313:1876402802579200:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789477377.276513:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789477377.276560:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789477377.276567:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d7f544e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:07d5e05c-913f-419f-adbc-d3cf15e9cd51:3311:1876402802579328:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789477377.276614:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789477377.276642:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802579200 00000100:00100000:0.0:1789477377.276647:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802579200 00010000:00010000:0.0:1789477377.276670:0:5830:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9d0d41647000/0xafddb3c8f9281784 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xafddb3c8f928177d expref: 19 pid: 5839 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789477377.276704:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802579328 00000100:00100000:0.0:1789477377.276707:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802579328 00010000:00010000:0.0:1789477377.276719:0:5830:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9d0d41647a00/0xafddb3c8f9281776 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xafddb3c8f928176f expref: 20 pid: 5838 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789477377.276735:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1789477377.276741:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d74a89500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:07d5e05c-913f-419f-adbc-d3cf15e9cd51+20:3313:x1876402802579200:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789477377.276751:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789477377.276756:0:5830:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9d0d41647000/0xafddb3c8f9281784 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xafddb3c8f928177d expref: 20 pid: 5839 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477377.276764:0:5830:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9d0d41647000/0xafddb3c8f9281784 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xafddb3c8f928177d expref: 20 pid: 5839 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477377.276794:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789477377.276824:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d74a89500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:07d5e05c-913f-419f-adbc-d3cf15e9cd51+20:3313:x1876402802579200:12345-0@lo:103:ldlm_bl.0 Request processed in 83us (309us total) trans 0 rc 0/0 00000100:00100000:0.0:1789477377.276831:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1789477377.276845:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1789477377.276850:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d74a88e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:07d5e05c-913f-419f-adbc-d3cf15e9cd51+19:3311:x1876402802579328:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789477377.276857:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789477377.276861:0:5830:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9d0d41647a00/0xafddb3c8f9281776 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xafddb3c8f928176f expref: 19 pid: 5838 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477377.276869:0:5830:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9d0d41647a00/0xafddb3c8f9281776 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xafddb3c8f928176f expref: 19 pid: 5838 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477377.276879:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789477377.276910:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d74a88e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:07d5e05c-913f-419f-adbc-d3cf15e9cd51+19:3311:x1876402802579328:12345-0@lo:103:ldlm_bl.0 Request processed in 60us (296us total) trans 0 rc 0/0 00000100:00100000:0.0:1789477377.276917:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1789477377.276958:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d7f544e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:07d5e05c-913f-419f-adbc-d3cf15e9cd51:3311:1876402802579328:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789477377.276981:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d7f546d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:07d5e05c-913f-419f-adbc-d3cf15e9cd51:3313:1876402802579200:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789477377.277616:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789477377.277674:0:11699:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d0d46cd8480 going to sleep for 11 seconds 00010000:00010000:2.0:1789477377.277698:0:11699:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d0d41647000/0xafddb3c8f9281784 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xafddb3c8f928177d expref: 18 pid: 5839 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789477377.277710:0:11699:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d7f545f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11699:1876402802578816:0@lo:104: 00010000:00010000:2.0:1789477377.277721:0:11699:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d0d41647a00/0xafddb3c8f9281776 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xafddb3c8f928176f expref: 17 pid: 5838 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789477377.277730:0:11699:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d7f546300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11699:1876402802578944:0@lo:104: 00000100:00100000:2.0:1789477377.277740:0:11699:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d7f547b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11699:1876402802579072:0@lo:104: 00010000:00010000:3.0:1789477377.277888:0:6710:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.123@tcp lock: ffff9d0d82150600/0xafddb3c8f9281761 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xafddb3c8f9281768 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477377.277896:0:6710:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1789477377.277935:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00010000:00010000:3.0:1789477377.277967:0:6710:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.123@tcp lock: ffff9d0d82150600/0xafddb3c8f9281761 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xafddb3c8f9281768 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477377.277975:0:6710:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.123@tcp lock: ffff9d0d82150600/0xafddb3c8f9281761 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xafddb3c8f9281768 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477377.277991:0:6710:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789477377.277993:0:6710:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789477377.277995:0:6710:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789477377.286128:0:11699:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d74f84e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11699:1876402802578560:192.168.201.23@tcp:104: 00000100:00100000:1.0:1789477377.286148:0:11699:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d7f544a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11699:1876402802578688:192.168.201.23@tcp:104: 00010000:00010000:1.0:1789477377.286183:0:11699:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9d0d49ecba00/0xafddb3c8f92818c6 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789477377.287357:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:0.0:1789477377.287442:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:3.0:1789477377.287668:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783671680 00000100:00100000:3.0:1789477377.287677:0:6711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783671680 00010000:00010000:3.0:1789477377.287717:0:6711:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9d0d41647800/0xafddb3c8f928178b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2a50 expref: 13 pid: 5838 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789477377.287744:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783671552 00000100:00100000:3.0:1789477377.287761:0:6711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783671552 00010000:00010000:3.0:1789477377.287788:0:6711:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9d0d7f519000/0xafddb3c8f9281792 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2a57 expref: 14 pid: 5838 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789477377.287807:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 32 00000100:00100000:3.0:1789477377.287815:0:6711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d50a81850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5c82dded-6a10-4ce8-abd1-52bd956b9523+14:2355:x1876402783671680:12345-192.168.201.23@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789477377.287829:0:6711:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789477377.287834:0:6711:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9d0d41647800/0xafddb3c8f928178b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2a50 expref: 14 pid: 5838 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477377.287844:0:6711:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9d0d41647800/0xafddb3c8f928178b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2a50 expref: 14 pid: 5838 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477377.287863:0:6711:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d0d41647800/0xafddb3c8f928178b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2a50 expref: 14 pid: 5838 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477377.287880:0:6711:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789477377.287933:0:6711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d50a81850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5c82dded-6a10-4ce8-abd1-52bd956b9523+13:2355:x1876402783671680:12345-192.168.201.23@tcp:103:ldlm_bl.0 Request processed in 118us (583us total) trans 0 rc 0/0 00000100:00100000:3.0:1789477377.287941:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 32 00000100:00100000:3.0:1789477377.287985:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 33 00000100:00100000:3.0:1789477377.287992:0:6711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d74a8b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5c82dded-6a10-4ce8-abd1-52bd956b9523+12:2355:x1876402783671552:12345-192.168.201.23@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789477377.288000:0:6711:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789477377.288005:0:6711:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9d0d7f519000/0xafddb3c8f9281792 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2a57 expref: 12 pid: 5838 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477377.288016:0:6711:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9d0d7f519000/0xafddb3c8f9281792 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2a57 expref: 12 pid: 5838 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477377.288037:0:6711:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d0d7f519000/0xafddb3c8f9281792 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2a57 expref: 12 pid: 5838 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477377.288046:0:6711:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789477377.288063:0:6711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d74a8b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5c82dded-6a10-4ce8-abd1-52bd956b9523+11:2355:x1876402783671552:12345-192.168.201.23@tcp:103:ldlm_bl.0 Request processed in 71us (621us total) trans 0 rc 0/0 00000100:00100000:3.0:1789477377.288069:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 33 00000100:00100000:3.0:1789477377.289434:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d7f545180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:07d5e05c-913f-419f-adbc-d3cf15e9cd51:3310:1876402802579456:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789477377.289496:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789477377.289604:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802579456 00000100:00100000:1.0:1789477377.289621:0:6711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802579456 00010000:00010000:1.0:1789477377.289649:0:6711:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9d0d59d6b600/0xafddb3c8f9281768 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xafddb3c8f9281761 expref: 17 pid: 5837 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789477377.289678:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1789477377.289685:0:6711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d7f546680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:07d5e05c-913f-419f-adbc-d3cf15e9cd51+17:3310:x1876402802579456:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789477377.289695:0:6711:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789477377.289700:0:6711:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9d0d59d6b600/0xafddb3c8f9281768 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xafddb3c8f9281761 expref: 17 pid: 5837 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477377.289710:0:6711:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9d0d59d6b600/0xafddb3c8f9281768 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xafddb3c8f9281761 expref: 17 pid: 5837 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477377.289723:0:6711:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d0d59d6b600/0xafddb3c8f9281768 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xafddb3c8f9281761 expref: 17 pid: 5837 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477377.289736:0:6711:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9d0d49ecba00/0xafddb3c8f92818c6 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477377.289743:0:6711:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d0d49ecba00/0xafddb3c8f92818c6 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477377.289757:0:6711:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9d0d49ecba00/0xafddb3c8f92818c6 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477377.289762:0:6711:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9d0d49ecba00/0xafddb3c8f92818c6 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477377.289768:0:6711:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9d0d49ecba00/0xafddb3c8f92818c6 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477377.289784:0:6711:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9d0d49ecba00/0xafddb3c8f92818c6 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477377.289796:0:6711:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d0d49ecba00 already unused, calling callback (ffffffffc15972a0) 00010000:00010000:1.0:1789477377.289800:0:6711:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9d0d49ecba00/0xafddb3c8f92818c6 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477377.289808:0:6711:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9d0d49ecba00/0xafddb3c8f92818c6 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 11699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477377.289823:0:6711:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9d0d49ecba00/0xafddb3c8f92818c6 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477377.289834:0:6711:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789477377.289869:0:6711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d7f546680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:07d5e05c-913f-419f-adbc-d3cf15e9cd51+16:3310:x1876402802579456:12345-0@lo:103:ldlm_bl.0 Request processed in 184us (372us total) trans 0 rc 0/0 00000100:00100000:1.0:1789477377.289875:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1789477377.289957:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d7f545180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:07d5e05c-913f-419f-adbc-d3cf15e9cd51:3310:1876402802579456:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789477377.290202:0:11699:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9d0d49ecba00/0xafddb3c8f92818c6 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477377.290212:0:11699:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9d0d49ecba00/0xafddb3c8f92818c6 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477377.290217:0:11699:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d0d49ecba00/0xafddb3c8f92818c6 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477377.712833:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789477378.019900:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:1.0:1789477378.019944:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:1.0:1789477378.019976:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:1.0:1789477378.020002:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:1.0:1789477378.020028:0:6999:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783671936 00000100:00100000:1.0:1789477378.020038:0:6999:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783671936 00000100:00100000:3.0:1789477378.020238:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783671808 00000100:00100000:3.0:1789477378.020243:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783671808 00000100:00100000:3.0:1789477378.020292:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 250 00000100:00100000:3.0:1789477378.020302:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d4e674450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5c82dded-6a10-4ce8-abd1-52bd956b9523+11:2353:x1876402783671808:12345-192.168.201.23@tcp:400:kworker.0 00000100:00100000:3.0:1789477378.020370:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d4e674450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5c82dded-6a10-4ce8-abd1-52bd956b9523+11:2353:x1876402783671808:12345-192.168.201.23@tcp:400:kworker.0 Request processed in 69us (481us total) trans 0 rc 0/0 00000100:00100000:3.0:1789477378.020377:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 250 00000100:00080000:3.0:1789477378.020427:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789477378.020440:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783672192 00000100:00100000:3.0:1789477378.020444:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783672192 00000100:00100000:2.0:1789477378.020537:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783672064 00000100:00100000:2.0:1789477378.020542:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783672064 00000100:00100000:2.0:1789477378.020616:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 51 00000100:00100000:2.0:1789477378.020625:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d47668700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9bc33f26-0aab-4a14-832f-c58d566de1b0+5:2353:x1876402783672064:12345-192.168.201.23@tcp:400:kworker.0 00000100:00100000:2.0:1789477378.020659:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d47668700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9bc33f26-0aab-4a14-832f-c58d566de1b0+5:2353:x1876402783672064:12345-192.168.201.23@tcp:400:kworker.0 Request processed in 36us (714us total) trans 0 rc 0/0 00000100:00100000:2.0:1789477378.020666:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 51 00000100:00080000:2.0:1789477378.020713:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789477378.020716:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789477378.024286:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 104 00000100:00100000:3.0:1789477378.024305:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d47668380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9bc33f26-0aab-4a14-832f-c58d566de1b0+5:2352:x1876402783671936:12345-192.168.201.23@tcp:400:kworker.0 00000100:00100000:3.0:1789477378.024386:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d47668380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9bc33f26-0aab-4a14-832f-c58d566de1b0+5:2352:x1876402783671936:12345-192.168.201.23@tcp:400:kworker.0 Request processed in 88us (4408us total) trans 0 rc 0/0 00000100:00100000:3.0:1789477378.024411:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 104 00000100:00100000:3.0:1789477378.024445:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 105 00000100:00100000:3.0:1789477378.024453:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d4766bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cf70c55a-e056-446b-8936-49e7cd31fc79+5:2352:x1876402783672192:12345-192.168.201.23@tcp:400:kworker.0 00000100:00100000:3.0:1789477378.024496:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d4766bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cf70c55a-e056-446b-8936-49e7cd31fc79+5:2352:x1876402783672192:12345-192.168.201.23@tcp:400:kworker.0 Request processed in 44us (4492us total) trans 0 rc 0/0 00000100:00100000:3.0:1789477378.024503:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 105 00010000:00010000:2.0:1789477378.735867:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789477378.991987:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d74a88380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1876402802579584:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789477378.992061:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789477378.992204:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802579584 00000100:00100000:3.0:1789477378.992212:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802579584 00000100:00100000:3.0:1789477378.992276:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1789477378.992285:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d7c3e4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1876402802579584:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789477378.992318:0:6698:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789477378.992364:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d7c3e4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1876402802579584:12345-0@lo:13:osp-pre-1-0.0 Request processed in 80us (303us total) trans 0 rc 0/0 00000100:00100000:3.0:1789477378.992370:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1789477378.992403:0:3312:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967300 gen 2 00000004:00080000:3.0:1789477378.992408:0:3312:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9d0d7c3e7100, transno 4294967300 00000100:00100000:3.0:1789477378.992425:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d74a88380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1876402802579584:0@lo:13:osp-pre-1-0.0 00000100:00080000:2.0:1789477378.992820:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789477378.997250:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d7c3e5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3310:1876402802579840:0@lo:400:kworker.0 00000100:00100000:2.0:1789477378.997325:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789477378.997367:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789477378.997372:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d7c3e6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1876402802579968:0@lo:400:kworker.0 00000100:00100000:2.0:1789477378.997398:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789477378.997439:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802579968 00000100:00100000:2.0:1789477378.997446:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802579968 00000100:00100000:2.0:1789477378.997529:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1789477378.997549:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d6d3d5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3310:x1876402802579968:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789477378.997621:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d6d3d5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3310:x1876402802579968:12345-0@lo:400:kworker.0 Request processed in 83us (221us total) trans 0 rc 0/0 00000100:00100000:2.0:1789477378.997629:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00080000:2.0:1789477378.997649:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789477378.997659:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802579840 00000100:00100000:2.0:1789477378.997663:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802579840 00000100:00100000:2.0:1789477378.997689:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1789477378.997695:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d6d3d4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1876402802579840:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789477378.997726:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d6d3d4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1876402802579840:12345-0@lo:400:kworker.0 Request processed in 31us (402us total) trans 0 rc 0/0 00000100:00100000:2.0:1789477378.997732:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00010000:00080000:2.0:1789477378.997779:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d0d7c3e6d80 x1876402802579968/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789477394 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789477378.997793:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d7c3e6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1876402802579968:0@lo:400:kworker.0 00000100:00100000:2.0:1789477378.997804:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d7c3e5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3310:1876402802579840:0@lo:400:kworker.0 00000100:00100000:0.0:1789477378.998003:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d7c3e6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3312:1876402802580096:0@lo:400:kworker.0 00000100:00100000:0.0:1789477378.998037:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789477378.998073:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1789477378.998079:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d7c3e7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:07d5e05c-913f-419f-adbc-d3cf15e9cd51:3312:1876402802579712:0@lo:400:kworker.0 00000100:00100000:0.0:1789477378.998107:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789477378.998130:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d6d3d4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3312:1876402802580224:0@lo:400:kworker.0 00000100:00100000:0.0:1789477378.998151:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789477378.998173:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802580096 00000100:00100000:0.0:1789477378.998176:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802580096 00000100:00100000:0.0:1789477378.998201:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802580224 00000100:00100000:0.0:1789477378.998204:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802580224 00000100:00100000:0.0:1789477378.998220:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1789477378.998226:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d74a88a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1876402802580096:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789477378.998256:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d74a88a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1876402802580096:12345-0@lo:400:kworker.0 Request processed in 31us (219us total) trans 0 rc 0/0 00000100:00100000:0.0:1789477378.998262:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1789477378.998272:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1789477378.998277:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d74a8ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1876402802580224:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789477378.998307:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d74a8ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1876402802580224:12345-0@lo:400:kworker.0 Request processed in 30us (156us total) trans 0 rc 0/0 00000100:00100000:0.0:1789477378.998312:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00080000:0.0:1789477378.998329:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789477378.998345:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d6d3d4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3312:1876402802580224:0@lo:400:kworker.0 00000100:00100000:0.0:1789477378.998353:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d7c3e6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3312:1876402802580096:0@lo:400:kworker.0 00000100:00100000:1.0:1789477378.998447:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802579712 00000100:00100000:1.0:1789477378.998451:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802579712 00000100:00100000:1.0:1789477378.998479:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 251 00000100:00100000:1.0:1789477378.998484:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d48461050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:07d5e05c-913f-419f-adbc-d3cf15e9cd51+16:3312:x1876402802579712:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789477378.998519:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d48461050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:07d5e05c-913f-419f-adbc-d3cf15e9cd51+16:3312:x1876402802579712:12345-0@lo:400:kworker.0 Request processed in 34us (411us total) trans 0 rc 0/0 00000100:00100000:1.0:1789477378.998525:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 251 00000100:00100000:0.0:1789477378.998705:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d7c3e7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:07d5e05c-913f-419f-adbc-d3cf15e9cd51:3312:1876402802579712:0@lo:400:kworker.0 10000000:01000000:0.0:1789477379.248649:0:5841:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1789477379.248724:0:5841:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9d0d514ce000 from 7 10000000:01000000:0.0:1789477379.248730:0:5841:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1789477379.248796:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.123@tcp lock: ffff9d0d50be5400/0xafddb3c8f92818cd lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477379.248808:0:5841:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.123@tcp lock: ffff9d0d50be5400/0xafddb3c8f92818cd lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477379.248820:0:5841:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.123@tcp lock: ffff9d0d50be5400/0xafddb3c8f92818cd lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789477379.248858:0:5841:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d74a88380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07d5e05c-913f-419f-adbc-d3cf15e9cd51:5841:1876402802580352:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789477379.248931:0:5841:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789477379.250709:0:5841:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d0d51503240 going to sleep for 11 seconds 00000100:00100000:2.0:1789477379.256319:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802580352 00000100:00100000:2.0:1789477379.256336:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802580352 00000100:00100000:2.0:1789477379.256407:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 252 00000100:00100000:2.0:1789477379.256417:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d48460850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07d5e05c-913f-419f-adbc-d3cf15e9cd51+16:5841:x1876402802580352:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789477379.256434:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789477379.256453:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d0d59d6aa00/0xafddb3c8f92818d4 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xafddb3c8f92818cd expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477379.256479:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d0d59d6aa00/0xafddb3c8f92818d4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xafddb3c8f92818cd expref: 17 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477379.256825:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d0d59d6aa00/0xafddb3c8f92818d4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xafddb3c8f92818cd expref: 17 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477379.256834:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d0d59d6aa00, rc 0) 00000100:00100000:3.0:1789477379.257395:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d48460850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07d5e05c-913f-419f-adbc-d3cf15e9cd51+17:5841:x1876402802580352:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 976us (8460us total) trans 0 rc 0/0 00000100:00100000:3.0:1789477379.257403:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 252 00000100:00100000:0.0:1789477379.264058:0:5841:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d74a88380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07d5e05c-913f-419f-adbc-d3cf15e9cd51:5841:1876402802580352:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789477379.264095:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.123@tcp lock: ffff9d0d50be5400/0xafddb3c8f92818cd lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xafddb3c8f92818d4 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477379.264108:0:5841:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.123@tcp lock: ffff9d0d50be5400/0xafddb3c8f92818cd lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xafddb3c8f92818d4 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789477379.266910:0:5841:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d4766a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07d5e05c-913f-419f-adbc-d3cf15e9cd51:5841:1876402802580480:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789477379.267002:0:5841:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789477379.267058:0:5841:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d0d7c4010c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789477379.267211:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802580480 00000100:00100000:2.0:1789477379.267219:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802580480 00000100:00100000:2.0:1789477379.267268:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 253 00000100:00100000:2.0:1789477379.267277:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d48462850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:07d5e05c-913f-419f-adbc-d3cf15e9cd51+17:5841:x1876402802580480:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789477379.269964:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d48462850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:07d5e05c-913f-419f-adbc-d3cf15e9cd51+17:5841:x1876402802580480:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 2677us (2951us total) trans 0 rc 0/0 00000100:00100000:2.0:1789477379.269978:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 253 00000100:00100000:1.0:1789477379.281692:0:5841:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d4766a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07d5e05c-913f-419f-adbc-d3cf15e9cd51:5841:1876402802580480:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789477379.281784:0:5841:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d4766a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07d5e05c-913f-419f-adbc-d3cf15e9cd51:5841:1876402802580608:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789477379.281866:0:5841:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789477379.281919:0:5841:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d0d7c4010c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789477379.282288:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802580608 00000100:00100000:0.0:1789477379.282296:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802580608 00000100:00100000:0.0:1789477379.282363:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 254 00000100:00100000:0.0:1789477379.282374:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d48460c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07d5e05c-913f-419f-adbc-d3cf15e9cd51+17:5841:x1876402802580608:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789477379.282625:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d48460c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07d5e05c-913f-419f-adbc-d3cf15e9cd51+17:5841:x1876402802580608:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 253us (758us total) trans 0 rc 0/0 00000100:00100000:0.0:1789477379.282633:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 254 00000100:00100000:1.0:1789477379.282891:0:5841:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d4766a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07d5e05c-913f-419f-adbc-d3cf15e9cd51:5841:1876402802580608:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789477379.284081:0:11712:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d7f545180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:07d5e05c-913f-419f-adbc-d3cf15e9cd51:11712:1876402802580736:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789477379.284159:0:11712:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789477379.284196:0:11712:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d0d46cd8180 going to sleep for 11 seconds 00000100:00100000:2.0:1789477379.284315:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802580736 00000100:00100000:2.0:1789477379.284322:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802580736 00000100:00100000:2.0:1789477379.284363:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 255 00000100:00100000:2.0:1789477379.284371:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d48460450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:07d5e05c-913f-419f-adbc-d3cf15e9cd51+17:11712:x1876402802580736:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789477379.284569:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d48460450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:07d5e05c-913f-419f-adbc-d3cf15e9cd51+17:11712:x1876402802580736:12345-0@lo:502:llog_process_th.0 Request processed in 197us (409us total) trans 0 rc 0/0 00000100:00100000:2.0:1789477379.284607:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 255 00000100:00100000:3.0:1789477379.284824:0:11712:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d7f545180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:07d5e05c-913f-419f-adbc-d3cf15e9cd51:11712:1876402802580736:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1789477379.284855:0:11712:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789477379.284865:0:11712:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789477379.284867:0:11712:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1789477379.284874:0:11712:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9d0d514ce000 00000020:00000080:3.0:1789477379.284876:0:11712:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1789477379.284957:0:11712:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d7f545180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:07d5e05c-913f-419f-adbc-d3cf15e9cd51:11712:1876402802580864:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789477379.284990:0:11712:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789477379.285016:0:11712:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d0d46cd8180 going to sleep for 11 seconds 00000100:00100000:0.0:1789477379.285859:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802580864 00000100:00100000:0.0:1789477379.285866:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802580864 00000100:00100000:0.0:1789477379.285898:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 256 00000100:00100000:0.0:1789477379.285905:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d4ec6c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07d5e05c-913f-419f-adbc-d3cf15e9cd51+17:11712:x1876402802580864:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789477379.286085:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d4ec6c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07d5e05c-913f-419f-adbc-d3cf15e9cd51+17:11712:x1876402802580864:12345-0@lo:502:llog_process_th.0 Request processed in 180us (1094us total) trans 0 rc 0/0 00000100:00100000:0.0:1789477379.286091:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 256 00000100:00100000:3.0:1789477379.286429:0:11712:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d7f545180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:07d5e05c-913f-419f-adbc-d3cf15e9cd51:11712:1876402802580864:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1789477379.286453:0:11712:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789477379.286459:0:11712:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789477379.286461:0:11712:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:3.0:1789477379.286466:0:11712:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:0.0:1789477379.288938:0:5841:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:0.0:1789477379.288968:0:5841:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.123@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1789477379.288980:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.123@tcp lock: ffff9d0d50be5400/0xafddb3c8f92818cd lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xafddb3c8f92818d4 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477379.288992:0:5841:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.123@tcp lock: ffff9d0d50be5400/0xafddb3c8f92818cd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xafddb3c8f92818d4 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789477379.289003:0:5841:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1789477379.289005:0:5841:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9d0d585fc800 from 7 10000000:01000000:0.0:1789477379.289008:0:5841:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1789477379.289046:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.123@tcp lock: ffff9d0d50be4e00/0xafddb3c8f92818db lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477379.289071:0:5841:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.123@tcp lock: ffff9d0d50be4e00/0xafddb3c8f92818db lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477379.289081:0:5841:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.123@tcp lock: ffff9d0d50be4e00/0xafddb3c8f92818db lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789477379.289107:0:5841:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d74a88380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07d5e05c-913f-419f-adbc-d3cf15e9cd51:5841:1876402802580992:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789477379.289182:0:5841:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789477379.289221:0:5841:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d0d51503a80 going to sleep for 11 seconds 00000100:00100000:3.0:1789477379.289442:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802580992 00000100:00100000:3.0:1789477379.289451:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802580992 00000100:00100000:3.0:1789477379.289505:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 257 00000100:00100000:3.0:1789477379.289515:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d4ec6f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07d5e05c-913f-419f-adbc-d3cf15e9cd51+17:5841:x1876402802580992:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789477379.289529:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789477379.289543:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d0d49eca800/0xafddb3c8f92818e2 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xafddb3c8f92818db expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477379.289566:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d0d49eca800/0xafddb3c8f92818e2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xafddb3c8f92818db expref: 18 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477379.289603:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d0d49eca800/0xafddb3c8f92818e2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xafddb3c8f92818db expref: 18 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477379.289613:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d0d49eca800, rc 0) 00000100:00100000:3.0:1789477379.289684:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d4ec6f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07d5e05c-913f-419f-adbc-d3cf15e9cd51+18:5841:x1876402802580992:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 171us (501us total) trans 0 rc 0/0 00000100:00100000:3.0:1789477379.289690:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 257 00000100:00100000:1.0:1789477379.289987:0:5841:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d74a88380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07d5e05c-913f-419f-adbc-d3cf15e9cd51:5841:1876402802580992:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789477379.290002:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.123@tcp lock: ffff9d0d50be4e00/0xafddb3c8f92818db lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xafddb3c8f92818e2 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477379.290011:0:5841:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.123@tcp lock: ffff9d0d50be4e00/0xafddb3c8f92818db lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xafddb3c8f92818e2 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789477379.290069:0:5841:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d4766a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07d5e05c-913f-419f-adbc-d3cf15e9cd51:5841:1876402802581120:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789477379.290099:0:5841:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789477379.290131:0:5841:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d0d7c4010c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789477379.290307:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802581120 00000100:00100000:0.0:1789477379.290312:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802581120 00000100:00100000:0.0:1789477379.290351:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 258 00000100:00100000:0.0:1789477379.290359:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d4ec6e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07d5e05c-913f-419f-adbc-d3cf15e9cd51+18:5841:x1876402802581120:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789477379.291181:0:5841:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d4766a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07d5e05c-913f-419f-adbc-d3cf15e9cd51:5841:1876402802581120:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789477379.291222:0:5841:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d4766a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07d5e05c-913f-419f-adbc-d3cf15e9cd51:5841:1876402802581248:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789477379.299825:0:5841:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789477379.299880:0:5841:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d0d7c4010c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789477379.299912:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802581248 00000100:00100000:1.0:1789477379.299920:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802581248 00000100:00100000:1.0:1789477379.300222:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 259 00000100:00100000:1.0:1789477379.300234:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d4ec6c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07d5e05c-913f-419f-adbc-d3cf15e9cd51+19:5841:x1876402802581248:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789477379.300601:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d4ec6e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07d5e05c-913f-419f-adbc-d3cf15e9cd51+19:5841:x1876402802581120:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 10240us (10498us total) trans 0 rc 0/0 00000100:00100000:0.0:1789477379.300610:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 258 00000100:00100000:0.0:1789477379.310699:0:5841:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d4766a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07d5e05c-913f-419f-adbc-d3cf15e9cd51:5841:1876402802581248:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789477379.310950:0:11715:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d74a89500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:07d5e05c-913f-419f-adbc-d3cf15e9cd51:11715:1876402802581376:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789477379.311027:0:11715:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789477379.311063:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802581376 00000100:00100000:0.0:1789477379.311069:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802581376 00000100:00100000:0.0:1789477379.311104:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 260 00000100:00100000:0.0:1789477379.311114:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d4ec6f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07d5e05c-913f-419f-adbc-d3cf15e9cd51+19:11715:x1876402802581376:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789477379.311340:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d4ec6f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07d5e05c-913f-419f-adbc-d3cf15e9cd51+19:11715:x1876402802581376:12345-0@lo:502:llog_process_th.0 Request processed in 226us (312us total) trans 0 rc 0/0 00000100:00100000:0.0:1789477379.311358:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 260 00000100:00100000:0.0:1789477379.311402:0:11715:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d0d51503480 going to sleep for 11 seconds 00000100:00100000:0.0:1789477379.311415:0:11715:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d74a89500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:07d5e05c-913f-419f-adbc-d3cf15e9cd51:11715:1876402802581376:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1789477379.311439:0:11715:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789477379.311450:0:11715:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789477379.311453:0:11715:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1789477379.311461:0:11715:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9d0d585fc800 00000020:00000080:0.0:1789477379.311463:0:11715:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1789477379.311988:0:11715:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d74a89500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:07d5e05c-913f-419f-adbc-d3cf15e9cd51:11715:1876402802581504:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789477379.312028:0:11715:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789477379.312052:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802581504 00000100:00100000:0.0:1789477379.312056:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802581504 00000100:00100000:0.0:1789477379.312077:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 261 00000100:00100000:0.0:1789477379.312083:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d4ec6ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07d5e05c-913f-419f-adbc-d3cf15e9cd51+19:11715:x1876402802581504:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789477379.312205:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d4ec6ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07d5e05c-913f-419f-adbc-d3cf15e9cd51+19:11715:x1876402802581504:12345-0@lo:502:llog_process_th.0 Request processed in 121us (175us total) trans 0 rc 0/0 00000100:00100000:0.0:1789477379.312211:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 261 00000100:00100000:0.0:1789477379.312238:0:11715:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d0d51503480 going to sleep for 11 seconds 00000100:00100000:0.0:1789477379.312251:0:11715:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d74a89500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:07d5e05c-913f-419f-adbc-d3cf15e9cd51:11715:1876402802581504:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1789477379.312268:0:11715:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789477379.312272:0:11715:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789477379.312274:0:11715:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:0.0:1789477379.312277:0:11715:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:0.0:1789477379.312335:0:5841:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:0.0:1789477379.312351:0:5841:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.123@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1789477379.312361:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.123@tcp lock: ffff9d0d50be4e00/0xafddb3c8f92818db lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xafddb3c8f92818e2 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477379.312380:0:5841:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.123@tcp lock: ffff9d0d50be4e00/0xafddb3c8f92818db lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xafddb3c8f92818e2 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789477379.312391:0:5841:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1789477379.312394:0:5841:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9d0d4444e800 from 7 10000000:01000000:0.0:1789477379.312398:0:5841:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1789477379.312421:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.123@tcp lock: ffff9d0d50be4000/0xafddb3c8f92818e9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477379.312428:0:5841:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.123@tcp lock: ffff9d0d50be4000/0xafddb3c8f92818e9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477379.312437:0:5841:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.123@tcp lock: ffff9d0d50be4000/0xafddb3c8f92818e9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789477379.312449:0:5841:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d74a89500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07d5e05c-913f-419f-adbc-d3cf15e9cd51:5841:1876402802581632:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789477379.312474:0:5841:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789477379.312487:0:5841:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d0d51503480 going to sleep for 11 seconds 00000100:00100000:0.0:1789477379.312498:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802581632 00000100:00100000:0.0:1789477379.312502:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802581632 00000100:00100000:0.0:1789477379.312516:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 262 00000100:00100000:0.0:1789477379.312522:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d4ec6d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07d5e05c-913f-419f-adbc-d3cf15e9cd51+19:5841:x1876402802581632:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789477379.312530:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789477379.312541:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d0d50be4400/0xafddb3c8f92818f0 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xafddb3c8f92818e9 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477379.312560:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d0d50be4400/0xafddb3c8f92818f0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xafddb3c8f92818e9 expref: 20 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477379.312610:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d0d50be4400/0xafddb3c8f92818f0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xafddb3c8f92818e9 expref: 20 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477379.312619:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d0d50be4400, rc 0) 00000100:00100000:0.0:1789477379.312649:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d4ec6d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07d5e05c-913f-419f-adbc-d3cf15e9cd51+20:5841:x1876402802581632:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 126us (174us total) trans 0 rc 0/0 00000100:00100000:0.0:1789477379.312655:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 262 00000100:00100000:0.0:1789477379.312684:0:5841:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d74a89500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07d5e05c-913f-419f-adbc-d3cf15e9cd51:5841:1876402802581632:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789477379.312695:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.123@tcp lock: ffff9d0d50be4000/0xafddb3c8f92818e9 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xafddb3c8f92818f0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477379.312704:0:5841:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.123@tcp lock: ffff9d0d50be4000/0xafddb3c8f92818e9 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xafddb3c8f92818f0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789477379.312755:0:5841:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d74a89500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07d5e05c-913f-419f-adbc-d3cf15e9cd51:5841:1876402802581760:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789477379.312779:0:5841:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789477379.312791:0:5841:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d0d51503480 going to sleep for 11 seconds 00000100:00100000:0.0:1789477379.312802:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802581760 00000100:00100000:0.0:1789477379.312805:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802581760 00000100:00100000:0.0:1789477379.312820:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 263 00000100:00100000:0.0:1789477379.312826:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d4ec6e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07d5e05c-913f-419f-adbc-d3cf15e9cd51+20:5841:x1876402802581760:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789477379.313027:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d4ec6e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07d5e05c-913f-419f-adbc-d3cf15e9cd51+20:5841:x1876402802581760:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 201us (247us total) trans 0 rc 0/0 00000100:00100000:0.0:1789477379.313034:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 263 00000100:00100000:0.0:1789477379.313063:0:5841:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d74a89500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07d5e05c-913f-419f-adbc-d3cf15e9cd51:5841:1876402802581760:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789477379.313095:0:5841:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d74a89500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07d5e05c-913f-419f-adbc-d3cf15e9cd51:5841:1876402802581888:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789477379.313127:0:5841:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789477379.313140:0:5841:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d0d51503480 going to sleep for 11 seconds 00000100:00100000:0.0:1789477379.313151:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802581888 00000100:00100000:0.0:1789477379.313154:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802581888 00000100:00100000:0.0:1789477379.313170:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 264 00000100:00100000:0.0:1789477379.313176:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d4ec6dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07d5e05c-913f-419f-adbc-d3cf15e9cd51+20:5841:x1876402802581888:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789477379.313280:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d4ec6dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07d5e05c-913f-419f-adbc-d3cf15e9cd51+20:5841:x1876402802581888:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 104us (152us total) trans 0 rc 0/0 00000100:00100000:0.0:1789477379.313287:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 264 00000100:00100000:0.0:1789477379.313320:0:5841:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d74a89500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:07d5e05c-913f-419f-adbc-d3cf15e9cd51:5841:1876402802581888:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789477379.313629:0:11716:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d74a89500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:07d5e05c-913f-419f-adbc-d3cf15e9cd51:11716:1876402802582016:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789477379.313663:0:11716:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789477379.313682:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802582016 00000100:00100000:0.0:1789477379.313685:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802582016 00000100:00100000:0.0:1789477379.313699:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 265 00000100:00100000:0.0:1789477379.313704:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d4ec6fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07d5e05c-913f-419f-adbc-d3cf15e9cd51+20:11716:x1876402802582016:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789477379.325397:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d4ec6c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07d5e05c-913f-419f-adbc-d3cf15e9cd51+20:5841:x1876402802581248:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 25155us (25728us total) trans 0 rc 0/0 00000100:00100000:1.0:1789477379.325413:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 259 00000100:00100000:1.0:1789477379.325543:0:11716:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d0d51503f00 going to sleep for 11 seconds 00000100:00100000:0.0:1789477379.326501:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d4ec6fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07d5e05c-913f-419f-adbc-d3cf15e9cd51+19:11716:x1876402802582016:12345-0@lo:502:llog_process_th.0 Request processed in 12781us (12822us total) trans 0 rc 0/0 00000100:00100000:0.0:1789477379.326512:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 265 00000100:00100000:1.0:1789477379.327869:0:11716:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d74a89500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:07d5e05c-913f-419f-adbc-d3cf15e9cd51:11716:1876402802582016:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1789477379.327922:0:11716:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789477379.327937:0:11716:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789477379.327941:0:11716:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1789477379.327949:0:11716:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9d0d4444e800 00000020:00000080:1.0:1789477379.327952:0:11716:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1789477379.328071:0:11716:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d47669500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:07d5e05c-913f-419f-adbc-d3cf15e9cd51:11716:1876402802582144:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789477379.328222:0:11716:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789477379.328265:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802582144 00000100:00100000:1.0:1789477379.328274:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802582144 00000100:00100000:1.0:1789477379.328332:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 266 00000100:00100000:1.0:1789477379.328344:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d4ec6f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:07d5e05c-913f-419f-adbc-d3cf15e9cd51+19:11716:x1876402802582144:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789477379.330233:0:11716:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d0d7c401480 going to sleep for 11 seconds 00000100:00100000:3.0:1789477379.330460:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:1.0:1789477379.330595:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783672320 00000100:00100000:1.0:1789477379.330604:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783672320 00000100:00100000:1.0:1789477379.331967:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 267 00000100:00100000:1.0:1789477379.331984:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d595f4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5c82dded-6a10-4ce8-abd1-52bd956b9523+11:5607:x1876402783672320:12345-192.168.201.23@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789477379.332000:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789477379.332018:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d0d7f519600/0xafddb3c8f92818f7 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xa90d500d7b8f2aa4 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477379.332047:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d0d7f519600/0xafddb3c8f92818f7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2aa4 expref: 12 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477379.332074:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d0d7f519600/0xafddb3c8f92818f7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2aa4 expref: 12 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477379.332083:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d0d7f519600, rc 0) 00000100:00100000:1.0:1789477379.332816:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d595f4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5c82dded-6a10-4ce8-abd1-52bd956b9523+12:5607:x1876402783672320:12345-192.168.201.23@tcp:101:ll_cfg_requeue.0 Request processed in 835us (2355us total) trans 0 rc 0/0 00000100:00100000:1.0:1789477379.332823:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 267 00000100:00100000:0.0:1789477379.333962:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d4ec6f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:07d5e05c-913f-419f-adbc-d3cf15e9cd51+19:11716:x1876402802582144:12345-0@lo:502:llog_process_th.0 Request processed in 5614us (5734us total) trans 0 rc 0/0 00000100:00100000:0.0:1789477379.333973:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 266 00000100:00100000:3.0:1789477379.342223:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:3.0:1789477379.342252:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783672448 00000100:00100000:3.0:1789477379.342260:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783672448 00000100:00100000:3.0:1789477379.342300:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 268 00000100:00100000:3.0:1789477379.342309:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d595f6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5c82dded-6a10-4ce8-abd1-52bd956b9523+12:5607:x1876402783672448:12345-192.168.201.23@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789477379.343804:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d595f6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5c82dded-6a10-4ce8-abd1-52bd956b9523+12:5607:x1876402783672448:12345-192.168.201.23@tcp:501:ll_cfg_requeue.0 Request processed in 1488us (1584us total) trans 0 rc 0/0 00000100:00100000:3.0:1789477379.343816:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 268 00000100:00100000:3.0:1789477379.348456:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:3.0:1789477379.348502:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783672576 00000100:00100000:3.0:1789477379.348512:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783672576 00000100:00100000:3.0:1789477379.348552:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 269 00000100:00100000:3.0:1789477379.348561:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d595f7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5c82dded-6a10-4ce8-abd1-52bd956b9523+12:5607:x1876402783672576:12345-192.168.201.23@tcp:503:ll_cfg_requeue.0 00000040:00080000:2.0:1789477379.348854:0:11717:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1789477379.349081:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d595f7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5c82dded-6a10-4ce8-abd1-52bd956b9523+12:5607:x1876402783672576:12345-192.168.201.23@tcp:503:ll_cfg_requeue.0 Request processed in 518us (631us total) trans 0 rc 0/0 00000100:00100000:3.0:1789477379.349089:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 269 00000100:00100000:1.0:1789477379.349959:0:11716:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d47669500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:07d5e05c-913f-419f-adbc-d3cf15e9cd51:11716:1876402802582144:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1789477379.350002:0:11716:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789477379.350011:0:11716:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789477379.350014:0:11716:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:1.0:1789477379.350019:0:11716:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:2.0:1789477379.350227:0:5841:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:2.0:1789477379.350245:0:5841:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.123@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1789477379.350255:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.123@tcp lock: ffff9d0d50be4000/0xafddb3c8f92818e9 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xafddb3c8f92818f0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477379.350266:0:5841:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.123@tcp lock: ffff9d0d50be4000/0xafddb3c8f92818e9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xafddb3c8f92818f0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789477379.368914:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:2.0:1789477379.369900:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783672704 00000100:00100000:2.0:1789477379.369912:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783672704 00000100:00100000:2.0:1789477379.369968:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 270 00000100:00100000:2.0:1789477379.370275:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d595f4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5c82dded-6a10-4ce8-abd1-52bd956b9523+12:9958:x1876402783672704:12345-192.168.201.23@tcp:502:llog_process_th.0 00000100:00100000:2.0:1789477379.370511:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d595f4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5c82dded-6a10-4ce8-abd1-52bd956b9523+12:9958:x1876402783672704:12345-192.168.201.23@tcp:502:llog_process_th.0 Request processed in 241us (1607us total) trans 0 rc 0/0 00000100:00100000:2.0:1789477379.370519:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 270 00000100:00100000:2.0:1789477379.379249:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:3.0:1789477379.379385:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783672832 00000100:00100000:3.0:1789477379.379396:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783672832 00000100:00100000:3.0:1789477379.379458:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 271 00000100:00100000:3.0:1789477379.379468:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d595f6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5c82dded-6a10-4ce8-abd1-52bd956b9523+12:9958:x1876402783672832:12345-192.168.201.23@tcp:502:llog_process_th.0 00000100:00100000:3.0:1789477379.379770:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d595f6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5c82dded-6a10-4ce8-abd1-52bd956b9523+12:9958:x1876402783672832:12345-192.168.201.23@tcp:502:llog_process_th.0 Request processed in 303us (542us total) trans 0 rc 0/0 00000100:00100000:3.0:1789477379.379785:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 271 00000100:00100000:2.0:1789477379.389451:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:3.0:1789477379.389613:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783672960 00000100:00100000:3.0:1789477379.389624:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783672960 00000100:00100000:3.0:1789477379.389692:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 272 00000100:00100000:3.0:1789477379.389703:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d595f7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5c82dded-6a10-4ce8-abd1-52bd956b9523+12:5607:x1876402783672960:12345-192.168.201.23@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789477379.389720:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789477379.389748:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d0d49ecb400/0xafddb3c8f92818fe lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xa90d500d7b8f2aab expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477379.389776:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d0d49ecb400/0xafddb3c8f92818fe lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2aab expref: 13 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477379.389786:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d0d49ecb400/0xafddb3c8f92818fe lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2aab expref: 13 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477379.389795:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d0d49ecb400, rc 0) 00000100:00100000:3.0:1789477379.389851:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d595f7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5c82dded-6a10-4ce8-abd1-52bd956b9523+13:5607:x1876402783672960:12345-192.168.201.23@tcp:101:ll_cfg_requeue.0 Request processed in 149us (417us total) trans 0 rc 0/0 00000100:00100000:3.0:1789477379.389858:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 272 00000100:00100000:3.0:1789477379.397670:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:0.0:1789477379.397784:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783673088 00000100:00100000:0.0:1789477379.397795:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783673088 00000100:00100000:0.0:1789477379.397858:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 273 00000100:00100000:0.0:1789477379.397869:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d595f5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5c82dded-6a10-4ce8-abd1-52bd956b9523+13:5607:x1876402783673088:12345-192.168.201.23@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789477379.398190:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d595f5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5c82dded-6a10-4ce8-abd1-52bd956b9523+13:5607:x1876402783673088:12345-192.168.201.23@tcp:501:ll_cfg_requeue.0 Request processed in 322us (540us total) trans 0 rc 0/0 00000100:00100000:0.0:1789477379.398200:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 273 00000100:00100000:3.0:1789477379.415312:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:3.0:1789477379.415350:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783673216 00000100:00100000:3.0:1789477379.415360:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783673216 00000100:00100000:3.0:1789477379.415413:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 274 00000100:00100000:3.0:1789477379.415422:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d595f6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5c82dded-6a10-4ce8-abd1-52bd956b9523+13:5607:x1876402783673216:12345-192.168.201.23@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789477379.415648:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d595f6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5c82dded-6a10-4ce8-abd1-52bd956b9523+13:5607:x1876402783673216:12345-192.168.201.23@tcp:503:ll_cfg_requeue.0 Request processed in 226us (346us total) trans 0 rc 0/0 00000100:00100000:3.0:1789477379.415661:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 274 00000100:00100000:1.0:1789477379.427342:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:3.0:1789477379.427455:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783673344 00000100:00100000:3.0:1789477379.427465:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783673344 00000100:00100000:3.0:1789477379.427525:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 275 00000100:00100000:3.0:1789477379.427536:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d595f5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5c82dded-6a10-4ce8-abd1-52bd956b9523+13:9961:x1876402783673344:12345-192.168.201.23@tcp:502:llog_process_th.0 00000100:00100000:3.0:1789477379.427834:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d595f5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5c82dded-6a10-4ce8-abd1-52bd956b9523+13:9961:x1876402783673344:12345-192.168.201.23@tcp:502:llog_process_th.0 Request processed in 299us (500us total) trans 0 rc 0/0 00000100:00100000:3.0:1789477379.427842:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 275 00000100:00100000:3.0:1789477379.432509:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:1.0:1789477379.432609:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783673472 00000100:00100000:1.0:1789477379.432619:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783673472 00000100:00100000:1.0:1789477379.432681:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 276 00000100:00100000:1.0:1789477379.432691:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d595f7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5c82dded-6a10-4ce8-abd1-52bd956b9523+13:9961:x1876402783673472:12345-192.168.201.23@tcp:502:llog_process_th.0 00000100:00100000:1.0:1789477379.432957:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d595f7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5c82dded-6a10-4ce8-abd1-52bd956b9523+13:9961:x1876402783673472:12345-192.168.201.23@tcp:502:llog_process_th.0 Request processed in 266us (458us total) trans 0 rc 0/0 00000100:00100000:1.0:1789477379.432965:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 276 00010000:00010000:3.0:1789477379.759839:0:6710:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1789477380.336536:0:11717:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1789477380.784573:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789477381.552214:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789477381.552249:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d47669500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1876402802582272:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789477381.552348:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789477381.552441:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802582272 00000100:00100000:3.0:1789477381.552455:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802582272 00000100:00080000:0.0:1789477381.552633:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789477381.552770:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1789477381.552782:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d74a88e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1876402802582272:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789477381.552824:0:6698:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789477381.552920:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d74a88e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1876402802582272:12345-0@lo:13:osp-pre-0-0.0 Request processed in 140us (571us total) trans 0 rc 0/0 00000100:00100000:3.0:1789477381.552927:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00010000:00080000:1.0:1789477381.553032:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d0d47669500 x1876402802582272/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789477397 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789477381.553059:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d47669500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1876402802582272:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1789477381.809022:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789477382.832338:0:6710:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789477383.136816:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:2.0:1789477383.136877:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:2.0:1789477383.136904:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:2.0:1789477383.136943:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:0.0:1789477383.137047:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783673728 00000100:00100000:0.0:1789477383.137059:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783673728 00000100:00100000:0.0:1789477383.137126:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783673984 00000100:00100000:0.0:1789477383.137130:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783673984 00000100:00100000:0.0:1789477383.137156:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 109 00000100:00100000:0.0:1789477383.137167:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d6d3d7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9bc33f26-0aab-4a14-832f-c58d566de1b0+5:2352:x1876402783673728:12345-192.168.201.23@tcp:400:kworker.0 00000100:00100000:0.0:1789477383.137251:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d6d3d7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9bc33f26-0aab-4a14-832f-c58d566de1b0+5:2352:x1876402783673728:12345-192.168.201.23@tcp:400:kworker.0 Request processed in 85us (446us total) trans 0 rc 0/0 00000100:00100000:0.0:1789477383.137260:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 109 00000100:00100000:0.0:1789477383.137280:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 110 00000100:00100000:0.0:1789477383.137287:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d6d3d6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cf70c55a-e056-446b-8936-49e7cd31fc79+5:2352:x1876402783673984:12345-192.168.201.23@tcp:400:kworker.0 00000100:00100000:0.0:1789477383.137313:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d6d3d6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cf70c55a-e056-446b-8936-49e7cd31fc79+5:2352:x1876402783673984:12345-192.168.201.23@tcp:400:kworker.0 Request processed in 28us (370us total) trans 0 rc 0/0 00000100:00100000:0.0:1789477383.137319:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 110 00000100:00100000:1.0:1789477383.137605:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783673856 00000100:00100000:1.0:1789477383.137615:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783673856 00000100:00100000:1.0:1789477383.137655:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 53 00000100:00100000:1.0:1789477383.137662:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d6d3d5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9bc33f26-0aab-4a14-832f-c58d566de1b0+5:2353:x1876402783673856:12345-192.168.201.23@tcp:400:kworker.0 00000100:00100000:1.0:1789477383.137711:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d6d3d5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9bc33f26-0aab-4a14-832f-c58d566de1b0+5:2353:x1876402783673856:12345-192.168.201.23@tcp:400:kworker.0 Request processed in 50us (806us total) trans 0 rc 0/0 00000100:00100000:1.0:1789477383.137717:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 53 00000100:00080000:2.0:1789477383.137840:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789477383.137845:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789477383.138150:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783673600 00000100:00100000:3.0:1789477383.138156:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783673600 00000100:00100000:3.0:1789477383.138228:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 277 00000100:00100000:3.0:1789477383.138237:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d595f7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5c82dded-6a10-4ce8-abd1-52bd956b9523+13:2353:x1876402783673600:12345-192.168.201.23@tcp:400:kworker.0 00000100:00100000:3.0:1789477383.138280:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d595f7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5c82dded-6a10-4ce8-abd1-52bd956b9523+13:2353:x1876402783673600:12345-192.168.201.23@tcp:400:kworker.0 Request processed in 44us (1402us total) trans 0 rc 0/0 00000100:00100000:3.0:1789477383.138297:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 277 00010000:00010000:0.0:1789477383.856952:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789477384.112106:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d74a89500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1876402802582400:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789477384.112194:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789477384.112373:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802582400 00000100:00100000:0.0:1789477384.112383:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802582400 00000100:00100000:0.0:1789477384.112457:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1789477384.112469:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d47669500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1876402802582400:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789477384.112515:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789477384.112568:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d47669500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1876402802582400:12345-0@lo:13:osp-pre-1-0.0 Request processed in 102us (374us total) trans 0 rc 0/0 00000100:00100000:0.0:1789477384.112607:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1789477384.112667:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d74a89500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1876402802582400:0@lo:13:osp-pre-1-0.0 00000100:00080000:1.0:1789477384.114841:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789477384.116767:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d74e88e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3311:1876402802582912:0@lo:400:kworker.0 00000100:00100000:0.0:1789477384.116840:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789477384.116903:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789477384.116919:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d74e89500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1876402802582784:0@lo:400:kworker.0 00000100:00100000:0.0:1789477384.116944:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789477384.116973:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802582912 00000100:00100000:0.0:1789477384.116981:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802582912 00000100:00100000:0.0:1789477384.117033:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1789477384.117042:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d74e8a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1876402802582912:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789477384.117150:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d74a88380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3313:1876402802582656:0@lo:400:kworker.0 00000100:00100000:3.0:1789477384.117181:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789477384.117202:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1789477384.117207:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d74a89500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:07d5e05c-913f-419f-adbc-d3cf15e9cd51:3313:1876402802582528:0@lo:400:kworker.0 00000100:00100000:3.0:1789477384.117234:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789477384.117254:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d74e88700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3313:1876402802583040:0@lo:400:kworker.0 00000100:00100000:3.0:1789477384.117277:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789477384.117337:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802582656 00000100:00100000:3.0:1789477384.117341:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802582656 00000100:00100000:3.0:1789477384.117369:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802583040 00000100:00100000:3.0:1789477384.117372:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802583040 00000100:00100000:3.0:1789477384.117394:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1789477384.117400:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d7f545180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1876402802582656:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789477384.117446:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d7f545180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1876402802582656:12345-0@lo:400:kworker.0 Request processed in 45us (263us total) trans 0 rc 0/0 00000100:00100000:3.0:1789477384.117453:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1789477384.117472:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:3.0:1789477384.117478:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d7f547100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1876402802583040:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789477384.117505:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d7f547100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1876402802583040:12345-0@lo:400:kworker.0 Request processed in 28us (227us total) trans 0 rc 0/0 00000100:00100000:3.0:1789477384.117511:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:3.0:1789477384.117550:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d74e88700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3313:1876402802583040:0@lo:400:kworker.0 00000100:00100000:3.0:1789477384.117560:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d74a88380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3313:1876402802582656:0@lo:400:kworker.0 00000100:00080000:1.0:1789477384.117777:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789477384.117791:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802582528 00000100:00100000:1.0:1789477384.117795:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802582528 00000100:00100000:1.0:1789477384.117833:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 278 00000100:00100000:1.0:1789477384.117840:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d595f5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07d5e05c-913f-419f-adbc-d3cf15e9cd51+19:3313:x1876402802582528:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789477384.117891:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d595f5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07d5e05c-913f-419f-adbc-d3cf15e9cd51+19:3313:x1876402802582528:12345-0@lo:400:kworker.0 Request processed in 51us (655us total) trans 0 rc 0/0 00000100:00100000:1.0:1789477384.117897:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 278 00000100:00100000:1.0:1789477384.117923:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d74a89500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:07d5e05c-913f-419f-adbc-d3cf15e9cd51:3313:1876402802582528:0@lo:400:kworker.0 00000100:00100000:2.0:1789477384.118281:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802582784 00000100:00100000:2.0:1789477384.118286:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802582784 00000100:00100000:2.0:1789477384.118323:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1789477384.118331:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d74e8b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3311:x1876402802582784:12345-0@lo:400:kworker.0 00000100:00080000:3.0:1789477384.118409:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789477384.118618:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d74e8a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1876402802582912:12345-0@lo:400:kworker.0 Request processed in 1575us (1776us total) trans 0 rc 0/0 00000100:00100000:0.0:1789477384.118626:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1789477384.118766:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d74e8b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3311:x1876402802582784:12345-0@lo:400:kworker.0 Request processed in 434us (1819us total) trans 0 rc 0/0 00000100:00100000:2.0:1789477384.118773:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1789477384.118828:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d74e88e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3311:1876402802582912:0@lo:400:kworker.0 00010000:00080000:1.0:1789477384.118992:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d0d74e89500 x1876402802582784/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789477400 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789477384.119003:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d74e89500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1876402802582784:0@lo:400:kworker.0 00010000:00010000:2.0:1789477384.879792:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789477385.903991:0:6710:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789477386.672308:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789477386.672333:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d4766ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1876402802583168:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789477386.672412:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789477386.672659:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802583168 00000100:00100000:2.0:1789477386.672682:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802583168 00000100:00100000:2.0:1789477386.672755:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1789477386.672764:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d74e89880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1876402802583168:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789477386.672799:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789477386.672854:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d74e89880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1876402802583168:12345-0@lo:13:osp-pre-0-0.0 Request processed in 91us (442us total) trans 0 rc 0/0 00000100:00100000:2.0:1789477386.672861:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00080000:3.0:1789477386.672924:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1789477386.673296:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d0d4766ad80 x1876402802583168/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789477402 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789477386.673327:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d4766ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1876402802583168:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1789477386.927954:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789477387.951816:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789477388.255844:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:3.0:1789477388.255896:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:3.0:1789477388.255938:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:3.0:1789477388.255968:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:3.0:1789477388.255998:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783674240 00000100:00100000:3.0:1789477388.256007:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783674240 00000100:00100000:3.0:1789477388.256064:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783674496 00000100:00100000:3.0:1789477388.256068:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783674496 00000100:00100000:3.0:1789477388.256093:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 114 00000100:00100000:3.0:1789477388.256102:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d7f546a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9bc33f26-0aab-4a14-832f-c58d566de1b0+5:2354:x1876402783674240:12345-192.168.201.23@tcp:400:kworker.0 00000100:00100000:3.0:1789477388.256182:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d7f546a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9bc33f26-0aab-4a14-832f-c58d566de1b0+5:2354:x1876402783674240:12345-192.168.201.23@tcp:400:kworker.0 Request processed in 80us (243us total) trans 0 rc 0/0 00000100:00100000:3.0:1789477388.256191:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 114 00000100:00100000:3.0:1789477388.256212:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 115 00000100:00100000:3.0:1789477388.256219:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d7f544380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cf70c55a-e056-446b-8936-49e7cd31fc79+5:2354:x1876402783674496:12345-192.168.201.23@tcp:400:kworker.0 00000100:00100000:3.0:1789477388.256243:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d7f544380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cf70c55a-e056-446b-8936-49e7cd31fc79+5:2354:x1876402783674496:12345-192.168.201.23@tcp:400:kworker.0 Request processed in 25us (275us total) trans 0 rc 0/0 00000100:00100000:3.0:1789477388.256250:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 115 00000100:00080000:3.0:1789477388.256271:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789477388.257012:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783674368 00000100:00100000:2.0:1789477388.257020:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783674368 00000100:00100000:2.0:1789477388.257069:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 55 00000100:00100000:2.0:1789477388.257078:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d7f545c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9bc33f26-0aab-4a14-832f-c58d566de1b0+5:2354:x1876402783674368:12345-192.168.201.23@tcp:400:kworker.0 00000100:00100000:2.0:1789477388.257125:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d7f545c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9bc33f26-0aab-4a14-832f-c58d566de1b0+5:2354:x1876402783674368:12345-192.168.201.23@tcp:400:kworker.0 Request processed in 50us (1228us total) trans 0 rc 0/0 00000100:00100000:2.0:1789477388.257132:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 55 00000100:00100000:1.0:1789477388.257674:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783674112 00000100:00100000:1.0:1789477388.257680:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783674112 00000100:00100000:1.0:1789477388.257729:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 279 00000100:00100000:1.0:1789477388.257752:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d595f5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5c82dded-6a10-4ce8-abd1-52bd956b9523+13:2354:x1876402783674112:12345-192.168.201.23@tcp:400:kworker.0 00000100:00100000:1.0:1789477388.257795:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d595f5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5c82dded-6a10-4ce8-abd1-52bd956b9523+13:2354:x1876402783674112:12345-192.168.201.23@tcp:400:kworker.0 Request processed in 43us (1964us total) trans 0 rc 0/0 00000100:00100000:1.0:1789477388.257802:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 279 00000100:00080000:3.0:1789477388.258545:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1789477388.976200:0:6710:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789477389.232179:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d4766a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1876402802583552:0@lo:400:kworker.0 00000100:00100000:1.0:1789477389.232261:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789477389.232331:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789477389.232338:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d4766b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3312:1876402802583680:0@lo:400:kworker.0 00000100:00100000:1.0:1789477389.232364:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789477389.232414:0:8241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802583552 00000100:00100000:1.0:1789477389.232422:0:8241:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802583552 00000100:00100000:1.0:1789477389.232481:0:8241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1789477389.232491:0:8241:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d4766ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3312:x1876402802583552:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789477389.232542:0:8241:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d4766ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3312:x1876402802583552:12345-0@lo:400:kworker.0 Request processed in 53us (282us total) trans 0 rc 0/0 00000100:00100000:1.0:1789477389.232550:0:8241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00080000:1.0:1789477389.232610:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1789477389.232642:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d0d4766a680 x1876402802583552/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789477405 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789477389.232658:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d4766a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1876402802583552:0@lo:400:kworker.0 00000100:00100000:1.0:1789477389.232684:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802583680 00000100:00100000:1.0:1789477389.232688:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802583680 00000100:00100000:1.0:1789477389.232720:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:1.0:1789477389.232727:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d4766a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1876402802583680:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789477389.232776:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d4766a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1876402802583680:12345-0@lo:400:kworker.0 Request processed in 50us (411us total) trans 0 rc 0/0 00000100:00100000:1.0:1789477389.232797:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00080000:1.0:1789477389.232815:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789477389.232832:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d4766b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3312:1876402802583680:0@lo:400:kworker.0 00000100:00100000:0.0:1789477389.234068:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d47669180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3311:1876402802583424:0@lo:400:kworker.0 00000100:00100000:0.0:1789477389.234131:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789477389.234174:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d4766aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1876402802583936:0@lo:400:kworker.0 00000100:00100000:0.0:1789477389.234198:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789477389.234234:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1789477389.234241:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d47668e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:07d5e05c-913f-419f-adbc-d3cf15e9cd51:3311:1876402802583296:0@lo:400:kworker.0 00000100:00100000:0.0:1789477389.234267:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789477389.234292:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d47669c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3311:1876402802583808:0@lo:400:kworker.0 00000100:00100000:0.0:1789477389.234314:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789477389.234347:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802583296 00000100:00100000:0.0:1789477389.234355:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802583296 00000100:00100000:3.0:1789477389.234468:0:6999:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802583424 00000100:00100000:3.0:1789477389.234472:0:6999:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802583424 00000100:00100000:3.0:1789477389.234503:0:6999:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802583808 00000100:00100000:3.0:1789477389.234520:0:6999:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802583808 00000100:00100000:3.0:1789477389.234551:0:6999:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:3.0:1789477389.234571:0:6999:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d74e89f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1876402802583424:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789477389.234650:0:6999:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d74e89f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1876402802583424:12345-0@lo:400:kworker.0 Request processed in 91us (517us total) trans 0 rc 0/0 00000100:00100000:3.0:1789477389.234657:0:6999:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:3.0:1789477389.234674:0:6999:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:3.0:1789477389.234681:0:6999:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d74e89500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1876402802583808:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789477389.234707:0:6999:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d74e89500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1876402802583808:12345-0@lo:400:kworker.0 Request processed in 27us (393us total) trans 0 rc 0/0 00000100:00100000:3.0:1789477389.234713:0:6999:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:0.0:1789477389.234883:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 280 00000100:00100000:0.0:1789477389.234891:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d595f4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07d5e05c-913f-419f-adbc-d3cf15e9cd51+19:3311:x1876402802583296:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789477389.234921:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d595f4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07d5e05c-913f-419f-adbc-d3cf15e9cd51+19:3311:x1876402802583296:12345-0@lo:400:kworker.0 Request processed in 32us (653us total) trans 0 rc 0/0 00000100:00100000:0.0:1789477389.234927:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 280 00000100:00100000:0.0:1789477389.234965:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d47668e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:07d5e05c-913f-419f-adbc-d3cf15e9cd51:3311:1876402802583296:0@lo:400:kworker.0 00000100:00100000:0.0:1789477389.234976:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d47669c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3311:1876402802583808:0@lo:400:kworker.0 00000100:00100000:0.0:1789477389.234986:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d47669180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3311:1876402802583424:0@lo:400:kworker.0 00000100:00100000:2.0:1789477389.235073:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802583936 00000100:00100000:2.0:1789477389.235078:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802583936 00000100:00100000:2.0:1789477389.235116:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1789477389.235123:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d74e88a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3311:x1876402802583936:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789477389.235164:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d74e88a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3311:x1876402802583936:12345-0@lo:400:kworker.0 Request processed in 42us (964us total) trans 0 rc 0/0 00000100:00100000:2.0:1789477389.235170:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1789477389.235201:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d4766aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1876402802583936:0@lo:400:kworker.0 00000100:00100000:1.0:1789477389.235758:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789477389.235772:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d7f547480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1876402802584064:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789477389.235809:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1789477389.235860:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789477389.235865:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789477389.236428:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802584064 00000100:00100000:2.0:1789477389.236437:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802584064 00000100:00100000:2.0:1789477389.236485:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1789477389.236494:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d4766b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1876402802584064:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789477389.236539:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789477389.236667:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d4766b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1876402802584064:12345-0@lo:13:osp-pre-1-0.0 Request processed in 174us (856us total) trans 0 rc 0/0 00000100:00100000:2.0:1789477389.236674:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1789477389.237321:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d7f547480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1876402802584064:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1789477390.006617:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1789477390.580312:0:11717:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1789477391.024325:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789477391.793928:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d4766a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1876402802584192:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789477391.794005:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789477391.794221:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802584192 00000100:00100000:1.0:1789477391.794231:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802584192 00000100:00100000:1.0:1789477391.794304:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1789477391.794313:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d74e88e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1876402802584192:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789477391.794350:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789477391.798411:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d74e88e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1876402802584192:12345-0@lo:13:osp-pre-0-0.0 Request processed in 4090us (4397us total) trans 0 rc 0/0 00000100:00100000:1.0:1789477391.798427:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00010000:00080000:1.0:1789477391.798511:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d0d4766a680 x1876402802584192/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789477407 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789477391.798546:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d4766a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1876402802584192:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1789477391.801090:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1789477392.053184:0:6710:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789477393.071933:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789477393.384455:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:3.0:1789477393.386780:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:1.0:1789477393.387083:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783674624 00000100:00100000:1.0:1789477393.387096:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783674624 00000100:00100000:1.0:1789477393.387198:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 281 00000100:00100000:1.0:1789477393.387209:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d595f6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5c82dded-6a10-4ce8-abd1-52bd956b9523+13:2353:x1876402783674624:12345-192.168.201.23@tcp:400:kworker.0 00000100:00100000:0.0:1789477393.387255:0:6999:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783674752 00000100:00100000:0.0:1789477393.387259:0:6999:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783674752 00000100:00100000:1.0:1789477393.387285:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d595f6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5c82dded-6a10-4ce8-abd1-52bd956b9523+13:2353:x1876402783674624:12345-192.168.201.23@tcp:400:kworker.0 Request processed in 78us (2841us total) trans 0 rc 0/0 00000100:00100000:0.0:1789477393.387301:0:6999:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 119 00000100:00100000:1.0:1789477393.387308:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 281 00000100:00100000:0.0:1789477393.387308:0:6999:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d7f544700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9bc33f26-0aab-4a14-832f-c58d566de1b0+5:2353:x1876402783674752:12345-192.168.201.23@tcp:400:kworker.0 00000100:00080000:3.0:1789477393.387381:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789477393.387503:0:6999:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d7f544700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9bc33f26-0aab-4a14-832f-c58d566de1b0+5:2353:x1876402783674752:12345-192.168.201.23@tcp:400:kworker.0 Request processed in 33us (569us total) trans 0 rc 0/0 00000100:00100000:0.0:1789477393.387511:0:6999:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 119 00000100:00100000:1.0:1789477393.403938:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:1.0:1789477393.403984:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:0.0:1789477393.404101:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783675008 00000100:00100000:0.0:1789477393.404111:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783675008 00000100:00100000:0.0:1789477393.404180:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 120 00000100:00100000:0.0:1789477393.404190:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d4766b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cf70c55a-e056-446b-8936-49e7cd31fc79+5:2352:x1876402783675008:12345-192.168.201.23@tcp:400:kworker.0 00000100:00100000:0.0:1789477393.404257:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d4766b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cf70c55a-e056-446b-8936-49e7cd31fc79+5:2352:x1876402783675008:12345-192.168.201.23@tcp:400:kworker.0 Request processed in 69us (272us total) trans 0 rc 0/0 00000100:00100000:0.0:1789477393.404264:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 120 00000100:00080000:1.0:1789477393.404978:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789477393.405085:0:8241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783674880 00000100:00100000:2.0:1789477393.405092:0:8241:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783674880 00000100:00100000:2.0:1789477393.405153:0:8241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 20 00000100:00100000:2.0:1789477393.405161:0:8241:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d4766a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9bc33f26-0aab-4a14-832f-c58d566de1b0+5:2351:x1876402783674880:12345-192.168.201.23@tcp:9:kworker.0 00000020:00000080:2.0:1789477393.405184:0:8241:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xafddb3c8f928183a 00000100:00080000:2.0:1789477393.405194:0:8241:0:(import.c:65:import_set_state_nolock()) ffff9d0d74a84000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1789477393.405236:0:8241:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967300 00000100:00100000:2.0:1789477393.405479:0:8241:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d4766a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9bc33f26-0aab-4a14-832f-c58d566de1b0+2:2351:x1876402783674880:12345-192.168.201.23@tcp:9:kworker.0 Request processed in 318us (1550us total) trans 0 rc 0/0 00000100:00100000:2.0:1789477393.405500:0:8241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 20 00010000:00010000:0.0:1789477393.405659:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1789477393.406492:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1789477394.095813:0:6710:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789477394.352156:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789477394.352182:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d7f544000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1876402802584320:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789477394.352256:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789477394.352720:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802584320 00000100:00100000:1.0:1789477394.352733:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802584320 00000100:00080000:2.0:1789477394.352777:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789477394.352797:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1789477394.352809:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d74e88700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1876402802584320:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789477394.352848:0:6698:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789477394.352913:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d74e88700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1876402802584320:12345-0@lo:13:osp-pre-1-0.0 Request processed in 106us (657us total) trans 0 rc 0/0 00000100:00100000:2.0:1789477394.352920:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1789477394.352939:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789477394.352948:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d7f545880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:07d5e05c-913f-419f-adbc-d3cf15e9cd51:3310:1876402802584448:0@lo:400:kworker.0 00000100:00100000:3.0:1789477394.352993:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d7f547800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3312:1876402802584576:0@lo:400:kworker.0 00000100:00100000:2.0:1789477394.352996:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789477394.353020:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789477394.353022:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d7f544a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3310:1876402802584832:0@lo:400:kworker.0 00000100:00100000:3.0:1789477394.353039:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789477394.353042:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789477394.353044:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d7f547480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1876402802584704:0@lo:400:kworker.0 00000100:00100000:2.0:1789477394.353057:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789477394.353062:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d7f547b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3310:1876402802584960:0@lo:400:kworker.0 00000100:00100000:3.0:1789477394.353063:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789477394.353080:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789477394.353148:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802584704 00000100:00100000:0.0:1789477394.353153:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802584704 00000100:00100000:0.0:1789477394.353187:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1789477394.353194:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d7f545f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3312:x1876402802584704:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789477394.353288:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d7f544000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1876402802584320:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789477394.353332:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802584448 00000100:00100000:1.0:1789477394.353336:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802584448 00000100:00100000:1.0:1789477394.353366:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 282 00000100:00100000:1.0:1789477394.353372:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d44523050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:07d5e05c-913f-419f-adbc-d3cf15e9cd51+19:3310:x1876402802584448:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789477394.353763:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d7f545f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3312:x1876402802584704:12345-0@lo:400:kworker.0 Request processed in 568us (697us total) trans 0 rc 0/0 00000100:00100000:0.0:1789477394.353770:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1789477394.354769:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802584576 00000100:00100000:3.0:1789477394.354779:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802584576 00000100:00100000:3.0:1789477394.354904:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802584832 00000100:00100000:3.0:1789477394.354909:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802584832 00000100:00100000:3.0:1789477394.355215:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802584960 00000100:00100000:3.0:1789477394.355219:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802584960 00000100:00100000:3.0:1789477394.355244:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:3.0:1789477394.355265:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d7f546300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1876402802584576:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789477394.355339:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d7f546300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1876402802584576:12345-0@lo:400:kworker.0 Request processed in 76us (2317us total) trans 0 rc 0/0 00000100:00100000:3.0:1789477394.355346:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:3.0:1789477394.355364:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:3.0:1789477394.355370:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d6d3d4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1876402802584832:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789477394.355405:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d6d3d4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1876402802584832:12345-0@lo:400:kworker.0 Request processed in 35us (2362us total) trans 0 rc 0/0 00000100:00100000:3.0:1789477394.355410:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:3.0:1789477394.355420:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:3.0:1789477394.355426:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d6d3d4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1876402802584960:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789477394.355448:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d6d3d4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1876402802584960:12345-0@lo:400:kworker.0 Request processed in 23us (2368us total) trans 0 rc 0/0 00000100:00100000:3.0:1789477394.355453:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00010000:00080000:3.0:1789477394.356786:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d0d7f547480 x1876402802584704/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789477410 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789477394.356869:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d7f547480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1876402802584704:0@lo:400:kworker.0 00000100:00100000:3.0:1789477394.356887:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d7f547800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3312:1876402802584576:0@lo:400:kworker.0 00000100:00080000:3.0:1789477394.357076:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789477394.357082:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789477394.357235:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d7f547b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3310:1876402802584960:0@lo:400:kworker.0 00000100:00100000:3.0:1789477394.357248:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d7f544a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3310:1876402802584832:0@lo:400:kworker.0 00000100:00100000:1.0:1789477394.357393:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d44523050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:07d5e05c-913f-419f-adbc-d3cf15e9cd51+19:3310:x1876402802584448:12345-0@lo:400:kworker.0 Request processed in 4019us (4393us total) trans 0 rc 0/0 00000100:00100000:1.0:1789477394.357403:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 282 00000100:00100000:3.0:1789477394.358091:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d7f545880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:07d5e05c-913f-419f-adbc-d3cf15e9cd51:3310:1876402802584448:0@lo:400:kworker.0 00010000:00010000:0.0:1789477395.119907:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789477396.144046:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1789477396.492722:0:7678:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 9bc33f26-0aab-4a14-832f-c58d566de1b0 00000020:00000080:1.0:1789477396.492733:0:7678:0:(genops.c:885:class_export_put()) final put ffff9d0d74a84800/9bc33f26-0aab-4a14-832f-c58d566de1b0 00000020:00000080:2.0:1789477396.492881:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9d0d74a84800/9bc33f26-0aab-4a14-832f-c58d566de1b0 for lustre-OST0001 00000020:00000080:2.0:1789477396.492947:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9d0d74a84000 for lustre-OST0001 00000100:00100000:2.0:1789477396.913830:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789477396.913857:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d4766aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1876402802585088:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789477396.913934:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789477396.914656:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802585088 00000100:00100000:1.0:1789477396.914666:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802585088 00000100:00100000:1.0:1789477396.914746:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1789477396.914757:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d7c3e7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1876402802585088:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789477396.914797:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789477396.914867:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d7c3e7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1876402802585088:12345-0@lo:13:osp-pre-0-0.0 Request processed in 112us (933us total) trans 0 rc 0/0 00000100:00100000:1.0:1789477396.914875:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00010000:00080000:3.0:1789477396.915813:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d0d4766aa00 x1876402802585088/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789477412 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789477396.915837:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d4766aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1876402802585088:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1789477396.917694:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1789477397.167862:0:6710:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789477398.191676:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789477398.499789:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:1.0:1789477398.499849:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:1.0:1789477398.499882:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:1.0:1789477398.499913:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783675136 00000100:00100000:1.0:1789477398.499923:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783675136 00000100:00100000:1.0:1789477398.499969:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 283 00000100:00100000:1.0:1789477398.499979:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d44522c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5c82dded-6a10-4ce8-abd1-52bd956b9523+13:2352:x1876402783675136:12345-192.168.201.23@tcp:400:kworker.0 00000100:00100000:1.0:1789477398.500049:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d44522c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5c82dded-6a10-4ce8-abd1-52bd956b9523+13:2352:x1876402783675136:12345-192.168.201.23@tcp:400:kworker.0 Request processed in 71us (268us total) trans 0 rc 0/0 00000100:00100000:1.0:1789477398.500059:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 283 00000100:00100000:1.0:1789477398.500097:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783675392 00000100:00100000:1.0:1789477398.500101:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783675392 00000100:00100000:1.0:1789477398.500139:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783675264 00000100:00100000:1.0:1789477398.500143:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783675264 00000100:00100000:1.0:1789477398.500169:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 124 00000100:00100000:1.0:1789477398.500176:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d47669180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cf70c55a-e056-446b-8936-49e7cd31fc79+5:2352:x1876402783675392:12345-192.168.201.23@tcp:400:kworker.0 00000100:00100000:1.0:1789477398.500206:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d47669180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cf70c55a-e056-446b-8936-49e7cd31fc79+5:2352:x1876402783675392:12345-192.168.201.23@tcp:400:kworker.0 Request processed in 31us (358us total) trans 0 rc 0/0 00000100:00100000:1.0:1789477398.500212:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 124 00000100:00100000:1.0:1789477398.500227:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 125 00000100:00100000:1.0:1789477398.500234:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d47669c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9bc33f26-0aab-4a14-832f-c58d566de1b0+5:2352:x1876402783675264:12345-192.168.201.23@tcp:400:kworker.0 00000100:00100000:1.0:1789477398.500257:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d47669c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9bc33f26-0aab-4a14-832f-c58d566de1b0+5:2352:x1876402783675264:12345-192.168.201.23@tcp:400:kworker.0 Request processed in 24us (376us total) trans 0 rc 0/0 00000100:00100000:1.0:1789477398.500264:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 125 00000100:00080000:1.0:1789477398.500619:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1789477399.218897:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789477399.471951:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d74f85c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1876402802585472:0@lo:400:kworker.0 00000100:00100000:1.0:1789477399.472020:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789477399.472096:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1789477399.472103:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d4766aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3311:1876402802585344:0@lo:400:kworker.0 00000100:00100000:1.0:1789477399.472129:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789477399.472147:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d6d464700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1876402802585856:0@lo:400:kworker.0 00000100:00100000:1.0:1789477399.472183:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789477399.472219:0:8241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802585472 00000100:00100000:1.0:1789477399.472226:0:8241:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802585472 00000100:00100000:1.0:1789477399.472276:0:8241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802585856 00000100:00100000:1.0:1789477399.472279:0:8241:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802585856 00000100:00100000:1.0:1789477399.472301:0:8241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1789477399.472310:0:8241:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d6d464e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3311:x1876402802585472:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789477399.472360:0:8241:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d6d464e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3311:x1876402802585472:12345-0@lo:400:kworker.0 Request processed in 51us (340us total) trans 0 rc 0/0 00000100:00100000:1.0:1789477399.472367:0:8241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1789477399.472400:0:8241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1789477399.472407:0:8241:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d50b04a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3311:x1876402802585856:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789477399.472434:0:8241:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d50b04a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3311:x1876402802585856:12345-0@lo:400:kworker.0 Request processed in 29us (251us total) trans 0 rc 0/0 00000100:00100000:1.0:1789477399.472440:0:8241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1789477399.472459:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802585344 00000100:00100000:1.0:1789477399.472462:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802585344 00000100:00100000:1.0:1789477399.472487:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:1.0:1789477399.472492:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d6d464380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1876402802585344:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789477399.472520:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d6d464380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1876402802585344:12345-0@lo:400:kworker.0 Request processed in 27us (390us total) trans 0 rc 0/0 00000100:00100000:1.0:1789477399.472526:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00080000:1.0:1789477399.472540:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789477399.472549:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789477399.472606:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d4766aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3311:1876402802585344:0@lo:400:kworker.0 00000100:00100000:1.0:1789477399.472617:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d6d464700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1876402802585856:0@lo:400:kworker.0 00010000:00080000:1.0:1789477399.472627:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d0d74f85c00 x1876402802585472/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789477415 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789477399.472636:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d74f85c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1876402802585472:0@lo:400:kworker.0 00000100:00100000:3.0:1789477399.472745:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789477399.472755:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d7f545880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1876402802585984:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789477399.472784:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789477399.472814:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802585984 00000100:00100000:3.0:1789477399.472818:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802585984 00000100:00100000:3.0:1789477399.472843:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1789477399.472850:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d7f544a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1876402802585984:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789477399.472877:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789477399.472910:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d7f544a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1876402802585984:12345-0@lo:13:osp-pre-1-0.0 Request processed in 60us (125us total) trans 0 rc 0/0 00000100:00100000:3.0:1789477399.472916:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1789477399.472948:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d7f545880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1876402802585984:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789477399.473112:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d74f86a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3312:1876402802585600:0@lo:400:kworker.0 00000100:00100000:0.0:1789477399.473149:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789477399.473174:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1789477399.473180:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d47668e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:07d5e05c-913f-419f-adbc-d3cf15e9cd51:3312:1876402802585216:0@lo:400:kworker.0 00000100:00100000:0.0:1789477399.473205:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789477399.473224:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d74f84e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3312:1876402802585728:0@lo:400:kworker.0 00000100:00100000:0.0:1789477399.473243:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789477399.473564:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802585600 00000100:00100000:1.0:1789477399.473569:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802585600 00000100:00100000:0.0:1789477399.473650:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802585216 00000100:00100000:0.0:1789477399.473654:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802585216 00000100:00100000:0.0:1789477399.473691:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 284 00000100:00100000:0.0:1789477399.473706:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d44521450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:07d5e05c-913f-419f-adbc-d3cf15e9cd51+19:3312:x1876402802585216:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789477399.473750:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d44521450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:07d5e05c-913f-419f-adbc-d3cf15e9cd51+19:3312:x1876402802585216:12345-0@lo:400:kworker.0 Request processed in 46us (544us total) trans 0 rc 0/0 00000100:00100000:0.0:1789477399.473757:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 284 00000100:00100000:0.0:1789477399.473794:0:6999:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802585728 00000100:00100000:0.0:1789477399.473797:0:6999:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802585728 00000100:00100000:1.0:1789477399.473891:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:3.0:1789477399.473990:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d47668e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:07d5e05c-913f-419f-adbc-d3cf15e9cd51:3312:1876402802585216:0@lo:400:kworker.0 00000100:00100000:0.0:1789477399.477077:0:6999:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:0.0:1789477399.477091:0:6999:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d75369f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1876402802585728:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789477399.477188:0:6999:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d75369f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1876402802585728:12345-0@lo:400:kworker.0 Request processed in 100us (3942us total) trans 0 rc 0/0 00000100:00100000:0.0:1789477399.477194:0:6999:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00080000:0.0:1789477399.477248:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789477399.478834:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d74f84e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3312:1876402802585728:0@lo:400:kworker.0 00000100:00100000:1.0:1789477399.482125:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d75369880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1876402802585600:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789477399.482250:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d75369880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1876402802585600:12345-0@lo:400:kworker.0 Request processed in 8353us (9100us total) trans 0 rc 0/0 00000100:00100000:1.0:1789477399.482262:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:3.0:1789477399.482340:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d74f86a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3312:1876402802585600:0@lo:400:kworker.0 00010000:00010000:3.0:1789477400.239973:0:6710:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1789477400.831181:0:11717:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1789477401.269977:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1789477401.727930:0:11880:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1a: Test manual lfs pcc attach with manual HSM restore ========================================================== 09:03:19 (1789477399) 00000100:00100000:0.0:1789477402.032937:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d7f545880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1876402802586112:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789477402.033040:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789477402.033141:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802586112 00000100:00100000:0.0:1789477402.033152:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802586112 00000100:00100000:0.0:1789477402.033221:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1789477402.033232:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d7536bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1876402802586112:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789477402.033284:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789477402.033350:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d7536bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1876402802586112:12345-0@lo:13:osp-pre-0-0.0 Request processed in 120us (310us total) trans 0 rc 0/0 00000100:00100000:0.0:1789477402.033359:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00080000:0.0:1789477402.033383:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1789477402.033418:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d0d7f545880 x1876402802586112/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789477418 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789477402.033440:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d7f545880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1876402802586112:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1789477402.289505:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789477403.311883:0:6710:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789477403.615984:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:2.0:1789477403.616032:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:2.0:1789477403.616068:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:1.0:1789477403.616152:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783675776 00000100:00100000:1.0:1789477403.616168:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783675776 00000100:00100000:1.0:1789477403.616254:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783675648 00000100:00100000:1.0:1789477403.616258:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783675648 00000100:00100000:1.0:1789477403.616290:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 129 00000100:00100000:1.0:1789477403.616317:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d7c3e6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cf70c55a-e056-446b-8936-49e7cd31fc79+5:2353:x1876402783675776:12345-192.168.201.23@tcp:400:kworker.0 00000100:00100000:3.0:1789477403.616356:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783675520 00000100:00100000:3.0:1789477403.616361:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783675520 00000100:00100000:3.0:1789477403.616397:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 285 00000100:00100000:3.0:1789477403.616404:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d44522050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5c82dded-6a10-4ce8-abd1-52bd956b9523+13:2353:x1876402783675520:12345-192.168.201.23@tcp:400:kworker.0 00000100:00100000:1.0:1789477403.616423:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d7c3e6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cf70c55a-e056-446b-8936-49e7cd31fc79+5:2353:x1876402783675776:12345-192.168.201.23@tcp:400:kworker.0 Request processed in 124us (390us total) trans 0 rc 0/0 00000100:00100000:3.0:1789477403.616430:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d44522050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5c82dded-6a10-4ce8-abd1-52bd956b9523+13:2353:x1876402783675520:12345-192.168.201.23@tcp:400:kworker.0 Request processed in 27us (464us total) trans 0 rc 0/0 00000100:00100000:1.0:1789477403.616432:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 129 00000100:00100000:3.0:1789477403.616437:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 285 00000100:00100000:1.0:1789477403.616451:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 130 00000100:00100000:1.0:1789477403.616457:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d7c3e5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9bc33f26-0aab-4a14-832f-c58d566de1b0+5:2353:x1876402783675648:12345-192.168.201.23@tcp:400:kworker.0 00000100:00100000:1.0:1789477403.616484:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d7c3e5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9bc33f26-0aab-4a14-832f-c58d566de1b0+5:2353:x1876402783675648:12345-192.168.201.23@tcp:400:kworker.0 Request processed in 28us (416us total) trans 0 rc 0/0 00000100:00100000:1.0:1789477403.616512:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 130 00000100:00080000:2.0:1789477403.616713:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789477403.945290:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:3.0:1789477403.945426:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783675904 00000100:00100000:3.0:1789477403.945439:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783675904 00000100:00100000:3.0:1789477403.945519:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 32 00000100:00100000:3.0:1789477403.945533:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d50b05f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9bc33f26-0aab-4a14-832f-c58d566de1b0+5:10233:x1876402783675904:12345-192.168.201.23@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789477403.945563:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789477403.945619:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49ecba00/0xafddb3c8f9281905 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa90d500d7b8f2ab2 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477403.945713:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49ecb200/0xafddb3c8f928190c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477403.945731:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49ecb200/0xafddb3c8f928190c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477403.945749:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49ecb200/0xafddb3c8f928190c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789477403.946101:0:5845:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:3.0:1789477403.946106:0:5845:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:3.0:1789477403.946217:0:5845:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49ecb200/0xafddb3c8f928190c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477403.946259:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49ecba00/0xafddb3c8f9281905 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2ab2 expref: 7 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477403.946279:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49ecb200/0xafddb3c8f928190c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2ab2 expref: 6 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477403.946288:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9d0d44568600) 00010000:00010000:3.0:1789477403.946291:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789477403.947132:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d0d49ecb200, rc 0) 00000100:00100000:3.0:1789477403.947315:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d50b05f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9bc33f26-0aab-4a14-832f-c58d566de1b0+6:10233:x1876402783675904:12345-192.168.201.23@tcp:101:lhsmtool_posix.0 Request processed in 1781us (2035us total) trans 0 rc 0/0 00000100:00100000:3.0:1789477403.947325:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 32 00000100:00100000:3.0:1789477403.957553:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:0.0:1789477403.962965:0:6999:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783676032 00000100:00100000:0.0:1789477403.962988:0:6999:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783676032 00000100:00100000:0.0:1789477403.963126:0:6999:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 33 00000100:00100000:0.0:1789477403.963140:0:6999:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d7f547b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9bc33f26-0aab-4a14-832f-c58d566de1b0+6:10234:x1876402783676032:12345-192.168.201.23@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789477403.963168:0:6999:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789477403.963198:0:6999:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be5200/0xafddb3c8f9281913 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa90d500d7b8f2ab9 expref: -99 pid: 6999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477403.963292:0:6999:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be5600/0xafddb3c8f928191a lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477403.963345:0:6999:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be5600/0xafddb3c8f928191a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477403.963359:0:6999:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be5600/0xafddb3c8f928191a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477403.963378:0:6999:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be4600/0xafddb3c8f9281921 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477403.963384:0:6999:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be4600/0xafddb3c8f9281921 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477403.963390:0:6999:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be4600/0xafddb3c8f9281921 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477403.966509:0:6999:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be5c00/0xafddb3c8f9281928 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477403.966542:0:6999:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be5c00/0xafddb3c8f9281928 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477403.966556:0:6999:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be5c00/0xafddb3c8f9281928 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789477403.966710:0:6999:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 6656 00000004:00200000:0.0:1789477403.966716:0:6999:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:0.0:1789477403.966826:0:6999:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be5c00/0xafddb3c8f9281928 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477403.966843:0:6999:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be5600/0xafddb3c8f928191a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477403.966863:0:6999:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be5600/0xafddb3c8f928191a lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477403.966870:0:6999:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be5600/0xafddb3c8f928191a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477403.966877:0:6999:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d0d50be5600 already unused, calling callback (ffffffffc1fd54f0) 00010000:00010000:0.0:1789477403.966883:0:6999:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be5600/0xafddb3c8f928191a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477403.966891:0:6999:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be5600/0xafddb3c8f928191a lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477403.966908:0:6999:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9d0d44568600) 00010000:00010000:0.0:1789477403.966912:0:6999:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789477403.966918:0:6999:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be5600/0xafddb3c8f928191a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477403.966924:0:6999:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be5600/0xafddb3c8f928191a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477403.966942:0:6999:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be4600/0xafddb3c8f9281921 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477403.966948:0:6999:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be4600/0xafddb3c8f9281921 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477403.966954:0:6999:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be4600/0xafddb3c8f9281921 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477403.966960:0:6999:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d0d50be4600 already unused, calling callback (ffffffffc1fd54f0) 00010000:00010000:0.0:1789477403.966968:0:6999:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be4600/0xafddb3c8f9281921 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477403.966975:0:6999:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be4600/0xafddb3c8f9281921 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477403.966983:0:6999:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff9d0d596ae000) 00010000:00010000:0.0:1789477403.966986:0:6999:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789477403.966989:0:6999:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be4600/0xafddb3c8f9281921 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477403.967066:0:6999:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be4600/0xafddb3c8f9281921 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477403.967118:0:6999:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be5200/0xafddb3c8f9281913 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2ab9 expref: 8 pid: 6999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477403.967134:0:6999:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be5c00/0xafddb3c8f9281928 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2ab9 expref: 7 pid: 6999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477403.967142:0:6999:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9d0d596ae300) 00010000:00010000:0.0:1789477403.967144:0:6999:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789477403.967147:0:6999:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d0d50be5c00, rc 0) 00000100:00100000:0.0:1789477403.967256:0:6999:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d7f547b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9bc33f26-0aab-4a14-832f-c58d566de1b0+7:10234:x1876402783676032:12345-192.168.201.23@tcp:101:lhsmtool_posix.0 Request processed in 4117us (9719us total) trans 0 rc 0/0 00000100:00100000:0.0:1789477403.967266:0:6999:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 33 00000100:00100000:0.0:1789477403.971167:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:1.0:1789477403.971415:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783676288 00000100:00100000:1.0:1789477403.971432:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783676288 00000100:00100000:1.0:1789477403.971522:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 34 00000100:00100000:1.0:1789477403.971536:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d75368a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9bc33f26-0aab-4a14-832f-c58d566de1b0+7:10234:x1876402783676288:12345-192.168.201.23@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789477403.971566:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789477403.972143:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f518c00/0xafddb3c8f928192f lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa90d500d7b8f2ac0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477403.972254:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f518a00/0xafddb3c8f9281936 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477403.972273:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f518a00/0xafddb3c8f9281936 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477403.972287:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f518a00/0xafddb3c8f9281936 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477403.972537:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f518400/0xafddb3c8f928193d lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477403.972562:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f518400/0xafddb3c8f928193d lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477403.972575:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f518400/0xafddb3c8f928193d lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477403.976958:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f519a00/0xafddb3c8f9281944 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477403.976995:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f519a00/0xafddb3c8f9281944 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477403.977008:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f519a00/0xafddb3c8f9281944 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789477403.977026:0:5846:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 6656 00010000:00010000:1.0:1789477403.977387:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f518a00/0xafddb3c8f9281936 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477403.977395:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f518a00/0xafddb3c8f9281936 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477403.977402:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f518a00/0xafddb3c8f9281936 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477403.977408:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d0d7f518a00 already unused, calling callback (ffffffffc1fd54f0) 00010000:00010000:1.0:1789477403.977412:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f518a00/0xafddb3c8f9281936 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477403.977426:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f518a00/0xafddb3c8f9281936 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477403.977447:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9d0d596ae300) 00010000:00010000:1.0:1789477403.977450:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789477403.977454:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f518a00/0xafddb3c8f9281936 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477403.977460:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f518a00/0xafddb3c8f9281936 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477403.977474:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f518400/0xafddb3c8f928193d lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477403.977485:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f518400/0xafddb3c8f928193d lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477403.977490:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f518400/0xafddb3c8f928193d lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477403.977495:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d0d7f518400 already unused, calling callback (ffffffffc1fd54f0) 00010000:00010000:1.0:1789477403.977497:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f518400/0xafddb3c8f928193d lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477403.977503:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f518400/0xafddb3c8f928193d lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477403.977511:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff9d0d48f9bf00) 00010000:00010000:1.0:1789477403.977514:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789477403.977516:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f518400/0xafddb3c8f928193d lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477403.977521:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f518400/0xafddb3c8f928193d lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477403.977956:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f518c00/0xafddb3c8f928192f lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2ac0 expref: 10 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477403.977972:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f519a00/0xafddb3c8f9281944 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2ac0 expref: 9 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477403.977980:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9d0d48f9be00) 00010000:00010000:1.0:1789477403.977982:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789477403.977991:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d0d7f519a00, rc 0) 00000100:00100000:1.0:1789477403.978056:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d75368a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9bc33f26-0aab-4a14-832f-c58d566de1b0+9:10234:x1876402783676288:12345-192.168.201.23@tcp:101:lhsmtool_posix.0 Request processed in 6521us (6906us total) trans 4294967309 rc 0/0 00000100:00100000:1.0:1789477403.978066:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 34 00000100:00100000:1.0:1789477404.002391:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:2.0:1789477404.002959:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783676416 00000100:00100000:2.0:1789477404.002976:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783676416 00000100:00100000:2.0:1789477404.003073:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 35 00000100:00100000:2.0:1789477404.003086:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d50b07b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9bc33f26-0aab-4a14-832f-c58d566de1b0+9:10234:x1876402783676416:12345-192.168.201.23@tcp:59:lhsmtool_posix.0 00000100:00100000:2.0:1789477404.003262:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d50b07b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9bc33f26-0aab-4a14-832f-c58d566de1b0+9:10234:x1876402783676416:12345-192.168.201.23@tcp:59:lhsmtool_posix.0 Request processed in 178us (886us total) trans 0 rc 0/0 00000100:00100000:2.0:1789477404.003270:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 35 00010000:00010000:3.0:1789477404.336091:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789477404.592186:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789477404.592219:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d7f547800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1876402802586240:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789477404.592326:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789477404.592418:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802586240 00000100:00100000:3.0:1789477404.592430:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802586240 00000100:00100000:3.0:1789477404.592500:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1789477404.592512:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d7f547480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1876402802586240:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789477404.592560:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789477404.592646:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d7f547480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1876402802586240:12345-0@lo:13:osp-pre-1-0.0 Request processed in 137us (320us total) trans 0 rc 0/0 00000100:00100000:3.0:1789477404.592655:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1789477404.592717:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d7f547800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1876402802586240:0@lo:13:osp-pre-1-0.0 00000100:00080000:2.0:1789477404.594078:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789477404.598119:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d7f547800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:07d5e05c-913f-419f-adbc-d3cf15e9cd51:3310:1876402802586368:0@lo:400:kworker.0 00000100:00100000:3.0:1789477404.598215:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789477404.598265:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d7f544000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3310:1876402802586880:0@lo:400:kworker.0 00000100:00100000:3.0:1789477404.598310:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789477404.598341:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789477404.598347:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d7f546d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3310:1876402802586496:0@lo:400:kworker.0 00000100:00100000:3.0:1789477404.598369:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789477404.598406:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802586880 00000100:00100000:3.0:1789477404.598416:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802586880 00000100:00100000:3.0:1789477404.598477:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802586496 00000100:00100000:3.0:1789477404.598480:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802586496 00000100:00100000:3.0:1789477404.598506:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:3.0:1789477404.598516:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d74a89500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1876402802586880:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789477404.598571:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d74a89500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1876402802586880:12345-0@lo:400:kworker.0 Request processed in 57us (261us total) trans 0 rc 0/0 00000100:00100000:3.0:1789477404.598601:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:3.0:1789477404.598624:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:3.0:1789477404.598629:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d74a88380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1876402802586496:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789477404.598652:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d74a88380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1876402802586496:12345-0@lo:400:kworker.0 Request processed in 24us (283us total) trans 0 rc 0/0 00000100:00100000:3.0:1789477404.598657:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:3.0:1789477404.598701:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d7f546d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3310:1876402802586496:0@lo:400:kworker.0 00000100:00100000:3.0:1789477404.598711:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d7f544000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3310:1876402802586880:0@lo:400:kworker.0 00000100:00100000:3.0:1789477404.598738:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d7f544e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1876402802586624:0@lo:400:kworker.0 00000100:00100000:3.0:1789477404.598788:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789477404.598809:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789477404.598815:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d7f545880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3312:1876402802586752:0@lo:400:kworker.0 00000100:00100000:3.0:1789477404.598835:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789477404.598857:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802586752 00000100:00100000:3.0:1789477404.598861:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802586752 00000100:00100000:3.0:1789477404.598880:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:3.0:1789477404.598886:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d7f546d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1876402802586752:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789477404.598916:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d7f546d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1876402802586752:12345-0@lo:400:kworker.0 Request processed in 30us (79us total) trans 0 rc 0/0 00000100:00100000:3.0:1789477404.598922:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:3.0:1789477404.598943:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d7f545880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3312:1876402802586752:0@lo:400:kworker.0 00000100:00100000:0.0:1789477404.599422:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802586368 00000100:00100000:0.0:1789477404.599429:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802586368 00000100:00100000:0.0:1789477404.599468:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 286 00000100:00100000:0.0:1789477404.599487:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d44521c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07d5e05c-913f-419f-adbc-d3cf15e9cd51+19:3310:x1876402802586368:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789477404.599539:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d44521c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07d5e05c-913f-419f-adbc-d3cf15e9cd51+19:3310:x1876402802586368:12345-0@lo:400:kworker.0 Request processed in 55us (1324us total) trans 0 rc 0/0 00000100:00100000:0.0:1789477404.599546:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 286 00000100:00100000:0.0:1789477404.599614:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d7f547800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:07d5e05c-913f-419f-adbc-d3cf15e9cd51:3310:1876402802586368:0@lo:400:kworker.0 00000100:00100000:1.0:1789477404.599731:0:8241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802586624 00000100:00100000:1.0:1789477404.599737:0:8241:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802586624 00000100:00100000:1.0:1789477404.599780:0:8241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1789477404.599797:0:8241:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d7f544000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3312:x1876402802586624:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789477404.599843:0:8241:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d7f544000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3312:x1876402802586624:12345-0@lo:400:kworker.0 Request processed in 47us (1054us total) trans 0 rc 0/0 00000100:00100000:1.0:1789477404.599849:0:8241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00010000:00080000:1.0:1789477404.599881:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d0d7f544e00 x1876402802586624/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789477420 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789477404.599892:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d7f544e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1876402802586624:0@lo:400:kworker.0 00000100:00080000:2.0:1789477404.601987:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789477404.602001:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000040:00080000:2.0:1789477404.923318:0:11717:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1789477405.360219:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1789477406.197850:0:5868:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967309 is committed 00010000:00010000:0.0:1789477406.388224:0:6710:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789477406.546609:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:3.0:1789477406.546657:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783676544 00000100:00100000:3.0:1789477406.546672:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783676544 00000100:00100000:3.0:1789477406.546757:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 36 00000100:00100000:3.0:1789477406.546771:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d7f545880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9bc33f26-0aab-4a14-832f-c58d566de1b0+8:10277:x1876402783676544:12345-192.168.201.23@tcp:101:lfs.0 00010000:00010000:3.0:1789477406.546800:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789477406.546826:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49ecba00/0xafddb3c8f9281952 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa90d500d7b8f2ac7 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477406.546909:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49ecbc00/0xafddb3c8f9281959 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477406.546925:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49ecbc00/0xafddb3c8f9281959 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477406.546961:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49ecbc00/0xafddb3c8f9281959 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477406.546979:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49eca000/0xafddb3c8f9281960 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477406.546986:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49eca000/0xafddb3c8f9281960 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477406.546993:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49eca000/0xafddb3c8f9281960 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477406.547342:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49ecbc00/0xafddb3c8f9281959 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477406.547352:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49ecbc00/0xafddb3c8f9281959 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477406.547359:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49ecbc00/0xafddb3c8f9281959 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477406.547367:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d0d49ecbc00 already unused, calling callback (ffffffffc1fd54f0) 00010000:00010000:3.0:1789477406.547372:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49ecbc00/0xafddb3c8f9281959 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477406.547382:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49ecbc00/0xafddb3c8f9281959 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477406.547396:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9d0d44568600) 00010000:00010000:3.0:1789477406.547399:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789477406.547407:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49ecbc00/0xafddb3c8f9281959 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477406.547420:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49ecbc00/0xafddb3c8f9281959 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477406.547441:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49eca000/0xafddb3c8f9281960 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477406.547448:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49eca000/0xafddb3c8f9281960 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477406.547453:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49eca000/0xafddb3c8f9281960 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477406.547458:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d0d49eca000 already unused, calling callback (ffffffffc1fd54f0) 00010000:00010000:3.0:1789477406.547461:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49eca000/0xafddb3c8f9281960 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477406.547467:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49eca000/0xafddb3c8f9281960 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477406.547475:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff9d0d44568400) 00010000:00010000:3.0:1789477406.547477:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789477406.547480:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49eca000/0xafddb3c8f9281960 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477406.547486:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49eca000/0xafddb3c8f9281960 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477406.547523:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49ecba00/0xafddb3c8f9281952 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2ac7 expref: 9 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477406.547543:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9d0d44568600) 00010000:00010000:3.0:1789477406.547546:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789477406.547550:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49ecba00/0xafddb3c8f9281952 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2ac7 expref: 9 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477406.547559:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d0d49ecba00, rc 0) 00000100:00100000:3.0:1789477406.547666:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d7f545880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9bc33f26-0aab-4a14-832f-c58d566de1b0+8:10277:x1876402783676544:12345-192.168.201.23@tcp:101:lfs.0 Request processed in 899us (1093us total) trans 0 rc 301/301 00000100:00100000:3.0:1789477406.547674:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 36 00000100:00080000:3.0:1789477406.547705:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789477406.555882:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:2.0:1789477406.556005:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783676800 00000100:00100000:2.0:1789477406.556020:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783676800 00000100:00100000:2.0:1789477406.556093:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 37 00000100:00100000:2.0:1789477406.556105:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d7f544e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9bc33f26-0aab-4a14-832f-c58d566de1b0+8:10277:x1876402783676800:12345-192.168.201.23@tcp:36:lfs.0 00010000:00010000:2.0:1789477406.556190:0:5844:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789477406.556225:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49ecb200/0xafddb3c8f928190c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2ab2 expref: 8 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477406.556259:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9d0d44568600) 00010000:00010000:2.0:1789477406.556275:0:5844:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789477406.558278:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d59d6be00/0xafddb3c8f9281967 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477406.558306:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d59d6be00/0xafddb3c8f9281967 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477406.558320:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d59d6be00/0xafddb3c8f9281967 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477406.558334:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d59d6b600/0xafddb3c8f928196e lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477406.558342:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d59d6b600/0xafddb3c8f928196e lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477406.558348:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d59d6b600/0xafddb3c8f928196e lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789477406.559971:0:5844:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00010000:00010000:2.0:1789477406.559994:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d59d6be00/0xafddb3c8f9281967 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477406.560018:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d59d6be00/0xafddb3c8f9281967 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477406.560026:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d59d6be00/0xafddb3c8f9281967 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477406.560033:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d0d59d6be00 already unused, calling callback (ffffffffc1fd54f0) 00010000:00010000:2.0:1789477406.560039:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d59d6be00/0xafddb3c8f9281967 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477406.560047:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d59d6be00/0xafddb3c8f9281967 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477406.560066:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9d0d50919c00) 00010000:00010000:2.0:1789477406.560070:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789477406.560076:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d59d6be00/0xafddb3c8f9281967 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477406.560082:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d59d6be00/0xafddb3c8f9281967 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789477406.560107:0:5844:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000f09ca481 reply state 0000000069bbe1dd transno 4294967310 ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d59d6b600/0xafddb3c8f928196e lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789477406.560117:0:5844:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789477406.560928:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d7f544e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9bc33f26-0aab-4a14-832f-c58d566de1b0+9:10277:x1876402783676800:12345-192.168.201.23@tcp:36:lfs.0 Request processed in 4814us (5050us total) trans 4294967310 rc 0/0 00000100:00100000:2.0:1789477406.560941:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 37 00010000:00010000:2.0:1789477406.572620:0:3296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d59d6b600/0xafddb3c8f928196e lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477406.572671:0:3296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d59d6b600/0xafddb3c8f928196e lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477406.572679:0:3296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d59d6b600/0xafddb3c8f928196e lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477406.572686:0:3296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d0d59d6b600 already unused, calling callback (ffffffffc1fd54f0) 00010000:00010000:2.0:1789477406.572692:0:3296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d59d6b600/0xafddb3c8f928196e lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477406.572700:0:3296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d59d6b600/0xafddb3c8f928196e lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477406.572722:0:3296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff9d0d50919300) 00010000:00010000:2.0:1789477406.572726:0:3296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789477406.572731:0:3296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d59d6b600/0xafddb3c8f928196e lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477406.572737:0:3296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d59d6b600/0xafddb3c8f928196e lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789477406.705108:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:0.0:1789477406.705207:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783676928 00000100:00100000:0.0:1789477406.705221:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783676928 00000100:00100000:0.0:1789477406.705307:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 38 00000100:00100000:0.0:1789477406.705320:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d7f547800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9bc33f26-0aab-4a14-832f-c58d566de1b0+8:10285:x1876402783676928:12345-192.168.201.23@tcp:101:lctl.0 00010000:00010000:0.0:1789477406.705362:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789477406.705396:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be5000/0xafddb3c8f9281975 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa90d500d7b8f2ace expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477406.705484:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be5e00/0xafddb3c8f928197c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477406.705503:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be5e00/0xafddb3c8f928197c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477406.705518:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be5e00/0xafddb3c8f928197c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789477406.705650:0:5845:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:0.0:1789477406.705655:0:5845:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:0.0:1789477406.705708:0:5845:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be5e00/0xafddb3c8f928197c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477406.705757:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be5000/0xafddb3c8f9281975 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2ace expref: 10 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477406.705779:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be5e00/0xafddb3c8f928197c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2ace expref: 9 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477406.705790:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9d0d596ae000) 00010000:00010000:0.0:1789477406.705793:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789477406.705797:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d0d50be5e00, rc 0) 00000100:00100000:0.0:1789477406.705868:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d7f547800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9bc33f26-0aab-4a14-832f-c58d566de1b0+9:10285:x1876402783676928:12345-192.168.201.23@tcp:101:lctl.0 Request processed in 551us (775us total) trans 0 rc 0/0 00000100:00100000:0.0:1789477406.705877:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 38 00000100:00100000:2.0:1789477406.782148:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:1.0:1789477406.782381:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783677056 00000100:00100000:1.0:1789477406.782395:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783677056 00000100:00100000:1.0:1789477406.782471:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 39 00000100:00100000:1.0:1789477406.782484:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d7c3e6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9bc33f26-0aab-4a14-832f-c58d566de1b0+9:10291:x1876402783677056:12345-192.168.201.23@tcp:101:bash.0 00010000:00010000:1.0:1789477406.782511:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789477406.782539:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f519200/0xafddb3c8f9281983 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa90d500d7b8f2ad5 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477406.782686:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f519000/0xafddb3c8f928198a lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477406.782704:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f519000/0xafddb3c8f928198a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477406.782736:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f519000/0xafddb3c8f928198a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477406.782754:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f518600/0xafddb3c8f9281991 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477406.782762:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f518600/0xafddb3c8f9281991 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477406.782768:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f518600/0xafddb3c8f9281991 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477406.783801:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f519c00/0xafddb3c8f9281998 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477406.783820:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f519c00/0xafddb3c8f9281998 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477406.783831:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f519c00/0xafddb3c8f9281998 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789477406.783949:0:5846:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00000004:00200000:1.0:1789477406.783953:0:5846:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1789477406.784007:0:5846:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f519c00/0xafddb3c8f9281998 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477406.784023:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f519000/0xafddb3c8f928198a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477406.784031:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f519000/0xafddb3c8f928198a lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477406.784056:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f519000/0xafddb3c8f928198a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477406.784064:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d0d7f519000 already unused, calling callback (ffffffffc1fd54f0) 00010000:00010000:1.0:1789477406.784069:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f519000/0xafddb3c8f928198a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477406.784078:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f519000/0xafddb3c8f928198a lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477406.784094:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9d0d596ae000) 00010000:00010000:1.0:1789477406.784098:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789477406.784102:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f519000/0xafddb3c8f928198a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477406.784110:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f519000/0xafddb3c8f928198a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477406.784127:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f518600/0xafddb3c8f9281991 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477406.784133:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f518600/0xafddb3c8f9281991 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477406.784140:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f518600/0xafddb3c8f9281991 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477406.784145:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d0d7f518600 already unused, calling callback (ffffffffc1fd54f0) 00010000:00010000:1.0:1789477406.784148:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f518600/0xafddb3c8f9281991 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477406.784162:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f518600/0xafddb3c8f9281991 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477406.784171:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff9d0d5b9f4e00) 00010000:00010000:1.0:1789477406.784174:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789477406.784177:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f518600/0xafddb3c8f9281991 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477406.784184:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f518600/0xafddb3c8f9281991 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477406.784226:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f519200/0xafddb3c8f9281983 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2ad5 expref: 11 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477406.784241:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f519c00/0xafddb3c8f9281998 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2ad5 expref: 10 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477406.784261:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9d0d5b9f4000) 00010000:00010000:1.0:1789477406.784264:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1789477406.784267:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d0d7f519c00, rc 0) 00000100:00100000:1.0:1789477406.784499:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d7c3e6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9bc33f26-0aab-4a14-832f-c58d566de1b0+10:10291:x1876402783677056:12345-192.168.201.23@tcp:101:bash.0 Request processed in 2015us (2363us total) trans 0 rc 0/0 00000100:00100000:1.0:1789477406.784509:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 39 00000100:00100000:1.0:1789477406.799934:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:0.0:1789477406.800213:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783677312 00000100:00100000:0.0:1789477406.800228:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783677312 00000100:00100000:0.0:1789477406.800320:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 40 00000100:00100000:0.0:1789477406.800333:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d50b06300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9bc33f26-0aab-4a14-832f-c58d566de1b0+10:10291:x1876402783677312:12345-192.168.201.23@tcp:101:bash.0 00010000:00010000:0.0:1789477406.800371:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789477406.800402:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be4c00/0xafddb3c8f928199f lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa90d500d7b8f2adc expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477406.800650:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be5800/0xafddb3c8f92819a6 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477406.800668:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be5800/0xafddb3c8f92819a6 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477406.800681:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be5800/0xafddb3c8f92819a6 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477406.801382:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be4800/0xafddb3c8f92819ad lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477406.801411:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be4800/0xafddb3c8f92819ad lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477406.801424:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be4800/0xafddb3c8f92819ad lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1789477406.803598:0:5845:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x2:0x0], index 0: 0 00010000:00010000:0.0:1789477406.803844:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be4a00/0xafddb3c8f92819b4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477406.803861:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be4a00/0xafddb3c8f92819b4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477406.803872:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be4a00/0xafddb3c8f92819b4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477406.803912:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be5800/0xafddb3c8f92819a6 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477406.803920:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be5800/0xafddb3c8f92819a6 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477406.803927:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be5800/0xafddb3c8f92819a6 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477406.803933:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d0d50be5800 already unused, calling callback (ffffffffc1fd54f0) 00010000:00010000:0.0:1789477406.803938:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be5800/0xafddb3c8f92819a6 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477406.803960:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be5800/0xafddb3c8f92819a6 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477406.803974:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9d0d5b9f4000) 00010000:00010000:0.0:1789477406.803977:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789477406.803981:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be5800/0xafddb3c8f92819a6 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477406.803988:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be5800/0xafddb3c8f92819a6 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789477406.804003:0:5845:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000003170c3db reply state 00000000f0b7ad1e transno 4294967311 ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be4800/0xafddb3c8f92819ad lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789477406.804012:0:5845:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1789477406.805274:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be4c00/0xafddb3c8f928199f lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2adc expref: 13 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477406.805302:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be4a00/0xafddb3c8f92819b4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2adc expref: 12 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477406.805312:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9d0d596aed00) 00010000:00010000:0.0:1789477406.805315:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789477406.805318:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d0d50be4a00, rc 0) 00000100:00100000:0.0:1789477406.805407:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d50b06300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9bc33f26-0aab-4a14-832f-c58d566de1b0+13:10291:x1876402783677312:12345-192.168.201.23@tcp:101:bash.0 Request processed in 5075us (5489us total) trans 4294967311 rc 0/0 00000100:00100000:0.0:1789477406.805417:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 40 00010000:00010000:0.0:1789477406.810218:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be4800/0xafddb3c8f92819ad lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477406.810255:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be4800/0xafddb3c8f92819ad lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477406.810264:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be4800/0xafddb3c8f92819ad lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477406.810271:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d0d50be4800 already unused, calling callback (ffffffffc1fd54f0) 00010000:00010000:0.0:1789477406.810277:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be4800/0xafddb3c8f92819ad lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477406.810285:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be4800/0xafddb3c8f92819ad lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477406.810302:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9d0d596ae100) 00010000:00010000:0.0:1789477406.810305:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789477406.810310:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be4800/0xafddb3c8f92819ad lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477406.810317:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be4800/0xafddb3c8f92819ad lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789477406.817009:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:1.0:1789477406.817316:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783677440 00000100:00100000:1.0:1789477406.817327:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783677440 00000100:00100000:1.0:1789477406.817381:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 21 00000100:00100000:1.0:1789477406.817390:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d7f702a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2351:x1876402783677440:12345-192.168.201.23@tcp:8:bash.0 00010000:00080000:1.0:1789477406.817453:0:6696:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 9bc33f26-0aab-4a14-832f-c58d566de1b0@192.168.201.23@tcp t0 exp 0000000000000000 cur 351 last 0 00000020:00000080:1.0:1789477406.817494:0:6696:0:(genops.c:1385:class_connect()) connect: client 9bc33f26-0aab-4a14-832f-c58d566de1b0, cookie 0xafddb3c8f92819c2 00002000:00100000:1.0:1789477406.817508:0:6696:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 9bc33f26-0aab-4a14-832f-c58d566de1b0/ffff9d0d7f55f800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113954 ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1789477406.817536:0:6696:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:1.0:1789477406.817936:0:6696:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1789477406.817971:0:6696:0:(import.c:65:import_set_state_nolock()) ffff9d0d7f558000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789477406.818236:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d7f702a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9bc33f26-0aab-4a14-832f-c58d566de1b0+6:2351:x1876402783677440:12345-192.168.201.23@tcp:8:bash.0 Request processed in 844us (1236us total) trans 0 rc 0/0 00000100:00100000:1.0:1789477406.818256:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 21 00000100:00100000:1.0:1789477406.829951:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:2.0:1789477406.835175:0:8241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783677568 00000100:00100000:2.0:1789477406.835195:0:8241:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783677568 00000100:00100000:2.0:1789477406.836755:0:8241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 22 00000100:00100000:2.0:1789477406.836773:0:8241:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d50b05500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9bc33f26-0aab-4a14-832f-c58d566de1b0+6:0:x1876402783677568:12345-192.168.201.23@tcp:101:bash.0 00010000:00010000:2.0:1789477406.836793:0:8241:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789477406.836825:0:8241:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000062480330/0xafddb3c8f92819c9 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa90d500d7b8f2ae3 expref: -99 pid: 8241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789477406.836882:0:8241:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789477406.836902:0:8241:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=351s v=(0 0) 00010000:00010000:2.0:1789477406.836907:0:8241:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789477406.836918:0:8241:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000062480330/0xafddb3c8f92819c9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2ae3 expref: 7 pid: 8241 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477406.836939:0:8241:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000062480330/0xafddb3c8f92819c9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2ae3 expref: 7 pid: 8241 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477406.836953:0:8241:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d0d59d6b400, rc 0) 00000100:00100000:2.0:1789477406.837038:0:8241:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d50b05500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9bc33f26-0aab-4a14-832f-c58d566de1b0+7:0:x1876402783677568:12345-192.168.201.23@tcp:101:bash.0 Request processed in 271us (7097us total) trans 0 rc 0/0 00000100:00100000:2.0:1789477406.837046:0:8241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 22 00000100:00080000:3.0:1789477406.844312:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789477406.844467:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:3.0:1789477406.844609:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783677696 00000100:00100000:3.0:1789477406.844620:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783677696 00000100:00100000:3.0:1789477406.844676:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 23 00000100:00100000:3.0:1789477406.844686:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d50b06d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9bc33f26-0aab-4a14-832f-c58d566de1b0+7:10291:x1876402783677696:12345-192.168.201.23@tcp:101:bash.0 00010000:00010000:3.0:1789477406.844704:0:6694:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789477406.844726:0:6694:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009a42fe57/0xafddb3c8f92819d0 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa90d500d7b8f2aea expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477406.844910:0:6694:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000062480330/0xafddb3c8f92819c9 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2ae3 expref: 8 pid: 8241 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477406.844920:0:6694:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789477406.844937:0:6694:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789477406.844942:0:6694:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009a42fe57/0xafddb3c8f92819d0 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2aea expref: 8 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477406.844981:0:6694:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000062480330/0xafddb3c8f92819c9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2ae3 expref: 8 pid: 8241 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477406.844996:0:6694:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000062480330/0xafddb3c8f92819c9 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2ae3 expref: 8 pid: 8241 timeout: 451 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789477406.845011:0:6694:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d7f700380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6694:1876402802587008:192.168.201.23@tcp:104: 00000100:00100000:3.0:1789477406.845190:0:6694:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d0d44480d80 going to sleep for 11 seconds 00000100:00100000:3.0:1789477406.851645:0:6694:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d7f700380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6694:1876402802587008:192.168.201.23@tcp:104: 00010000:00010000:3.0:1789477406.851685:0:6694:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000009a42fe57/0xafddb3c8f92819d0 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2aea expref: 8 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477406.851709:0:6694:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d0d49ecba00, rc 0) 00000100:00100000:3.0:1789477406.851792:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d50b06d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9bc33f26-0aab-4a14-832f-c58d566de1b0+8:10291:x1876402783677696:12345-192.168.201.23@tcp:101:bash.0 Request processed in 7105us (7329us total) trans 0 rc 0/0 00000100:00100000:3.0:1789477406.851801:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 23 00000100:00100000:1.0:1789477406.857854:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:0.0:1789477406.858007:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783677824 00000100:00100000:0.0:1789477406.858028:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783677824 00010000:00010000:0.0:1789477406.858072:0:5830:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000062480330/0xafddb3c8f92819c9 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2ae3 expref: 8 pid: 8241 timeout: 451 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789477406.858115:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 35 00000100:00100000:0.0:1789477406.858126:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d50b04e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9bc33f26-0aab-4a14-832f-c58d566de1b0+8:2355:x1876402783677824:12345-192.168.201.23@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789477406.858141:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789477406.858178:0:5830:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000062480330/0xafddb3c8f92819c9 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2ae3 expref: 8 pid: 8241 timeout: 451 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477406.858192:0:5830:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000062480330/0xafddb3c8f92819c9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2ae3 expref: 8 pid: 8241 timeout: 451 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477406.858221:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000062480330/0xafddb3c8f92819c9 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2ae3 expref: 8 pid: 8241 timeout: 451 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477406.858268:0:5830:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789477406.858273:0:5830:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789477406.858281:0:5830:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000009a42fe57/0xafddb3c8f92819d0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2aea expref: 7 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477406.858291:0:5830:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009a42fe57/0xafddb3c8f92819d0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2aea expref: 7 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477406.858330:0:5830:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000009a42fe57/0xafddb3c8f92819d0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2aea expref: 7 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789477406.858347:0:5830:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d75369c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:5830:1876402802587136:192.168.201.23@tcp:105: 00000100:00100000:0.0:1789477406.858431:0:5830:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d0d47768240 going to sleep for 11 seconds 00000100:00100000:1.0:1789477406.866803:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:0.0:1789477406.866917:0:5830:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d75369c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:5830:1876402802587136:192.168.201.23@tcp:105: 00010000:00010000:0.0:1789477406.866942:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789477406.866999:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d50b04e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9bc33f26-0aab-4a14-832f-c58d566de1b0+7:2355:x1876402783677824:12345-192.168.201.23@tcp:103:ldlm_bl.0 Request processed in 8874us (9156us total) trans 0 rc 0/0 00000100:00100000:0.0:1789477406.867034:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 35 00000100:00100000:3.0:1789477406.867419:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783678080 00000100:00100000:3.0:1789477406.867427:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783678080 00000100:00100000:3.0:1789477406.867478:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 6 00000100:00100000:3.0:1789477406.867486:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d50b05180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9bc33f26-0aab-4a14-832f-c58d566de1b0+12:10291:x1876402783678080:12345-192.168.201.23@tcp:35:bash.0 00000100:00100000:3.0:1789477406.867851:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d50b05180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9bc33f26-0aab-4a14-832f-c58d566de1b0+13:10291:x1876402783678080:12345-192.168.201.23@tcp:35:bash.0 Request processed in 364us (1058us total) trans 4294967312 rc 0/0 00000100:00100000:3.0:1789477406.867865:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 6 00000100:00100000:1.0:1789477407.060203:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:2.0:1789477407.060342:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783678336 00000100:00100000:2.0:1789477407.060354:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783678336 00000100:00100000:2.0:1789477407.060421:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 41 00000100:00100000:2.0:1789477407.060444:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d50b06680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9bc33f26-0aab-4a14-832f-c58d566de1b0+13:10301:x1876402783678336:12345-192.168.201.23@tcp:101:lfs.0 00010000:00010000:2.0:1789477407.060470:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789477407.060504:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d59d6a400/0xafddb3c8f92819d7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa90d500d7b8f2af1 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789477407.061105:0:5844:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00010000:00010000:2.0:1789477407.061255:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d59d6a400/0xafddb3c8f92819d7 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2af1 expref: 15 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477407.061291:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9d0d596ae000) 00010000:00010000:2.0:1789477407.061294:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789477407.061299:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d59d6a400/0xafddb3c8f92819d7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2af1 expref: 15 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477407.061315:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d0d59d6a400, rc 0) 00000100:00100000:2.0:1789477407.061896:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d50b06680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9bc33f26-0aab-4a14-832f-c58d566de1b0+14:10301:x1876402783678336:12345-192.168.201.23@tcp:101:lfs.0 Request processed in 1454us (1700us total) trans 4294967313 rc 301/301 00000100:00100000:2.0:1789477407.061906:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 41 00000100:00100000:1.0:1789477407.075044:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:3.0:1789477407.075169:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783678592 00000100:00100000:3.0:1789477407.075183:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783678592 00000100:00100000:3.0:1789477407.075255:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 7 00000100:00100000:3.0:1789477407.075266:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d50b07100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9bc33f26-0aab-4a14-832f-c58d566de1b0+14:10301:x1876402783678592:12345-192.168.201.23@tcp:35:lfs.0 00000100:00100000:3.0:1789477407.076000:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d50b07100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9bc33f26-0aab-4a14-832f-c58d566de1b0+15:10301:x1876402783678592:12345-192.168.201.23@tcp:35:lfs.0 Request processed in 733us (966us total) trans 4294967314 rc 0/0 00000100:00100000:3.0:1789477407.076009:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 7 00000100:00100000:1.0:1789477407.156722:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789477407.156750:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d7f700380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1876402802587264:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789477407.156824:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789477407.157560:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802587264 00000100:00100000:3.0:1789477407.157570:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802587264 00000100:00100000:3.0:1789477407.157669:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1789477407.157679:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d50b05c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1876402802587264:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789477407.157703:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789477407.157756:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d50b05c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1876402802587264:12345-0@lo:13:osp-pre-0-0.0 Request processed in 78us (931us total) trans 0 rc 0/0 00000100:00100000:3.0:1789477407.157763:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00080000:2.0:1789477407.158841:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789477407.159291:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d7f700380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1876402802587264:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789477407.236195:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:3.0:1789477407.236301:0:6999:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783678720 00000100:00100000:3.0:1789477407.236311:0:6999:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783678720 00000100:00100000:3.0:1789477407.236378:0:6999:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 42 00000100:00100000:3.0:1789477407.236389:0:6999:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d50b06a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9bc33f26-0aab-4a14-832f-c58d566de1b0+15:10307:x1876402783678720:12345-192.168.201.23@tcp:101:lfs.0 00010000:00010000:3.0:1789477407.236417:0:6999:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789477407.236438:0:6999:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49eca000/0xafddb3c8f92819e5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa90d500d7b8f2af8 expref: -99 pid: 6999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477407.236523:0:6999:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49ecbc00/0xafddb3c8f92819ec lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477407.236550:0:6999:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49ecbc00/0xafddb3c8f92819ec lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477407.236565:0:6999:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49ecbc00/0xafddb3c8f92819ec lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789477407.236671:0:6999:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00000004:00200000:3.0:1789477407.236676:0:6999:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:3.0:1789477407.237299:0:6999:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49ecbc00/0xafddb3c8f92819ec lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477407.237333:0:6999:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49eca000/0xafddb3c8f92819e5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2af8 expref: 17 pid: 6999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477407.237359:0:6999:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49ecbc00/0xafddb3c8f92819ec lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2af8 expref: 16 pid: 6999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477407.237368:0:6999:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9d0d5b9f4000) 00010000:00010000:3.0:1789477407.237372:0:6999:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789477407.237376:0:6999:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d0d49ecbc00, rc 0) 00000100:00100000:3.0:1789477407.237440:0:6999:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d50b06a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9bc33f26-0aab-4a14-832f-c58d566de1b0+16:10307:x1876402783678720:12345-192.168.201.23@tcp:101:lfs.0 Request processed in 1053us (1257us total) trans 0 rc 0/0 00000100:00100000:3.0:1789477407.237448:0:6999:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 42 00000100:00100000:1.0:1789477407.240795:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:2.0:1789477407.240891:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783678976 00000100:00100000:2.0:1789477407.240901:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783678976 00000100:00100000:2.0:1789477407.240963:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 43 00000100:00100000:2.0:1789477407.240975:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d50b04380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9bc33f26-0aab-4a14-832f-c58d566de1b0+16:10307:x1876402783678976:12345-192.168.201.23@tcp:101:lfs.0 00010000:00010000:2.0:1789477407.240998:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789477407.241020:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d59d6a400/0xafddb3c8f92819f3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa90d500d7b8f2aff expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477407.241126:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d59d6a800/0xafddb3c8f92819fa lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477407.241141:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d59d6a800/0xafddb3c8f92819fa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477407.241152:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d59d6a800/0xafddb3c8f92819fa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789477407.241182:0:5846:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:2.0:1789477407.241342:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d59d6a400/0xafddb3c8f92819f3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2aff expref: 19 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477407.241365:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d59d6a800/0xafddb3c8f92819fa lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2aff expref: 18 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477407.241375:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9d0d596aed00) 00010000:00010000:2.0:1789477407.241378:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789477407.241382:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d0d59d6a800, rc 0) 00000100:00100000:2.0:1789477407.241444:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d50b04380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9bc33f26-0aab-4a14-832f-c58d566de1b0+18:10307:x1876402783678976:12345-192.168.201.23@tcp:101:lfs.0 Request processed in 472us (660us total) trans 4294967315 rc 0/0 00000100:00100000:2.0:1789477407.241452:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 43 00000100:00100000:1.0:1789477407.246050:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:0.0:1789477407.246156:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783679232 00000100:00100000:0.0:1789477407.246168:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783679232 00000100:00100000:0.0:1789477407.246247:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 44 00000100:00100000:0.0:1789477407.246258:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d50b07480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9bc33f26-0aab-4a14-832f-c58d566de1b0+18:10307:x1876402783679232:12345-192.168.201.23@tcp:101:lfs.0 00010000:00010000:0.0:1789477407.246284:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789477407.246308:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be4800/0xafddb3c8f9281a08 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa90d500d7b8f2b06 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477407.246417:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be4c00/0xafddb3c8f9281a0f lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477407.246433:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be4c00/0xafddb3c8f9281a0f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477407.246444:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be4c00/0xafddb3c8f9281a0f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789477407.246457:0:5845:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:0.0:1789477407.246633:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be4800/0xafddb3c8f9281a08 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2b06 expref: 21 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477407.246660:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be4c00/0xafddb3c8f9281a0f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2b06 expref: 20 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477407.246669:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9d0d596aed00) 00010000:00010000:0.0:1789477407.246672:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1789477407.246675:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d0d50be4c00, rc 0) 00000100:00100000:0.0:1789477407.246743:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d50b07480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9bc33f26-0aab-4a14-832f-c58d566de1b0+20:10307:x1876402783679232:12345-192.168.201.23@tcp:101:lfs.0 Request processed in 485us (705us total) trans 4294967316 rc 0/0 00000100:00100000:0.0:1789477407.246750:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 44 00000100:00100000:1.0:1789477407.249943:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:3.0:1789477407.250069:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783679360 00000100:00100000:3.0:1789477407.250080:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783679360 00000100:00100000:3.0:1789477407.250141:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 2 00000100:00100000:3.0:1789477407.250152:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d50b04700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9bc33f26-0aab-4a14-832f-c58d566de1b0+20:2354:x1876402783679360:12345-192.168.201.23@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789477407.250168:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789477407.250205:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d59d6a800/0xafddb3c8f92819fa lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2aff expref: 20 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477407.250225:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9d0d596aed00) 00010000:00010000:3.0:1789477407.250231:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789477407.250342:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d50b04700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9bc33f26-0aab-4a14-832f-c58d566de1b0+19:2354:x1876402783679360:12345-192.168.201.23@tcp:103:ldlm_bl.0 Request processed in 191us (408us total) trans 0 rc 0/0 00000100:00100000:3.0:1789477407.250351:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 2 00000100:00100000:1.0:1789477407.270947:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:3.0:1789477407.273730:0:8241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783679488 00000100:00100000:3.0:1789477407.274670:0:8241:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783679488 00000100:00100000:2.0:1789477407.274973:0:8241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 24 00000100:00100000:2.0:1789477407.274986:0:8241:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d50b04000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9bc33f26-0aab-4a14-832f-c58d566de1b0+7:2355:x1876402783679488:12345-192.168.201.23@tcp:1:lfs.0 00010000:00010000:2.0:1789477407.275040:0:8241:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d6e7a3d9/0xafddb3c8f9281a1d lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477407.275063:0:8241:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000009a42fe57/0xafddb3c8f92819d0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2aea expref: 7 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477407.275072:0:8241:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x2:0x0].0x0 since=1s v=(0 0) 00010000:00010000:2.0:1789477407.275077:0:8241:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789477407.275082:0:8241:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d6e7a3d9/0xafddb3c8f9281a1d lrc: 4/0,1 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477407.275157:0:8241:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000009a42fe57/0xafddb3c8f92819d0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2aea expref: 7 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477407.275172:0:8241:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000009a42fe57/0xafddb3c8f92819d0 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2aea expref: 7 pid: 6694 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789477407.275189:0:8241:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d50413480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8241:1876402802587392:192.168.201.23@tcp:104: 00000100:00100000:2.0:1789477407.275333:0:8241:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d0d7fad2f00 going to sleep for 11 seconds 00000100:00100000:2.0:1789477407.280393:0:8241:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d50413480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8241:1876402802587392:192.168.201.23@tcp:104: 00010000:00010000:2.0:1789477407.280429:0:8241:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000d6e7a3d9/0xafddb3c8f9281a1d lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789477407.280800:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:3.0:1789477407.281683:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783679616 00000100:00100000:3.0:1789477407.281693:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783679616 00002000:00100000:3.0:1789477407.281753:0:6700:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x2:0x0] (0->12) req@ffff9d0d50b05880 x1876402783679616/t0(0) o4->9bc33f26-0aab-4a14-832f-c58d566de1b0@192.168.201.23@tcp:578/0 lens 504/0 e 0 to 0 dl 1789477418 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789477407.281763:0:6700:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9d0d50b05880 with x1876402783679616 ext(0->12) 00010000:00010000:3.0:1789477407.281772:0:6700:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 000000009a42fe57/0xafddb3c8f92819d0 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2aea expref: 8 pid: 6694 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477407.281788:0:6700:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 000000009a42fe57/0xafddb3c8f92819d0 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2aea expref: 8 pid: 6694 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789477407.281796:0:6700:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff9d0d50b05880 00000100:00100000:3.0:1789477407.281833:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 0 00000100:00100000:3.0:1789477407.281843:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d50b05880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:9bc33f26-0aab-4a14-832f-c58d566de1b0+8:2355:x1876402783679616:12345-192.168.201.23@tcp:4:lfs.0 00000001:00100000:1.0:1789477407.319270:0:6730:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 9bc33f26-0aab-4a14-832f-c58d566de1b0 00000100:00100000:0.0:1789477407.320888:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d50b05880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:9bc33f26-0aab-4a14-832f-c58d566de1b0+9:2355:x1876402783679616:12345-192.168.201.23@tcp:4:lfs.0 Request processed in 39037us (40081us total) trans 4294967299 rc 0/0 00000100:00100000:0.0:1789477407.320906:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 0 00002000:00100000:0.0:1789477407.320919:0:6700:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x2:0x0] (0->12) req@ffff9d0d50b05880 x1876402783679616/t4294967299(0) o4->9bc33f26-0aab-4a14-832f-c58d566de1b0@192.168.201.23@tcp:578/0 lens 504/448 e 0 to 0 dl 1789477418 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789477407.320929:0:6700:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9d0d50b05880 with x1876402783679616 ext(0->12) 00010000:00010000:0.0:1789477407.320940:0:6700:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 000000009a42fe57/0xafddb3c8f92819d0 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2aea expref: 9 pid: 6694 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477407.320959:0:6700:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 000000009a42fe57/0xafddb3c8f92819d0 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2aea expref: 9 pid: 6694 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789477407.320967:0:6700:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff9d0d50b05880 00000100:00100000:1.0:1789477407.337964:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:3.0:1789477407.341020:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783679744 00000100:00100000:3.0:1789477407.341039:0:6711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783679744 00010000:00010000:2.0:1789477407.341249:0:6711:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000009a42fe57/0xafddb3c8f92819d0 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2aea expref: 9 pid: 6694 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789477407.341301:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 36 00000100:00100000:2.0:1789477407.341312:0:6711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d50b07800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9bc33f26-0aab-4a14-832f-c58d566de1b0+9:2355:x1876402783679744:12345-192.168.201.23@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789477407.341328:0:6711:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1789477407.341348:0:6711:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x2:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:2.0:1789477407.341351:0:6711:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x2:0x0] updating lvb mtime from disk: 0 -> 1789477406 00002000:00010000:2.0:1789477407.341353:0:6711:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x2:0x0] updating lvb atime from disk: 0 -> 1789477406 00002000:00010000:2.0:1789477407.341354:0:6711:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x2:0x0] updating lvb ctime from disk: 0 -> 1789477406 00010000:00010000:2.0:1789477407.341361:0:6711:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000009a42fe57/0xafddb3c8f92819d0 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2aea expref: 9 pid: 6694 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477407.341389:0:6711:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000009a42fe57/0xafddb3c8f92819d0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2aea expref: 9 pid: 6694 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477407.341414:0:6711:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009a42fe57/0xafddb3c8f92819d0 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2aea expref: 9 pid: 6694 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477407.341432:0:6711:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789477407.341437:0:6711:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789477407.341443:0:6711:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000d6e7a3d9/0xafddb3c8f9281a1d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477407.341453:0:6711:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d6e7a3d9/0xafddb3c8f9281a1d lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477407.341498:0:6711:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789477407.341652:0:8241:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000d6e7a3d9/0xafddb3c8f9281a1d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477407.341668:0:8241:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d6e7a3d9/0xafddb3c8f9281a1d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477407.341693:0:8241:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d6e7a3d9/0xafddb3c8f9281a1d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477407.341702:0:8241:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d6e7a3d9/0xafddb3c8f9281a1d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477407.341710:0:8241:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d6e7a3d9/0xafddb3c8f9281a1d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477407.341717:0:8241:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d0d59d6a400 already unused, calling callback (ffffffffc15972a0) 00010000:00010000:3.0:1789477407.341721:0:8241:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d6e7a3d9/0xafddb3c8f9281a1d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477407.341730:0:8241:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d6e7a3d9/0xafddb3c8f9281a1d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477407.341754:0:8241:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d6e7a3d9/0xafddb3c8f9281a1d lrc: 2/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477407.341761:0:8241:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d6e7a3d9/0xafddb3c8f9281a1d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789477407.342047:0:6711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d50b07800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9bc33f26-0aab-4a14-832f-c58d566de1b0+8:2355:x1876402783679744:12345-192.168.201.23@tcp:103:ldlm_bl.0 Request processed in 735us (4091us total) trans 0 rc 0/0 00000100:00100000:2.0:1789477407.342055:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 36 00000100:00100000:3.0:1789477407.342320:0:8241:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d50b04000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9bc33f26-0aab-4a14-832f-c58d566de1b0+7:2355:x1876402783679488:12345-192.168.201.23@tcp:1:lfs.0 Request processed in 67335us (71381us total) trans 0 rc 0/0 00000100:00100000:3.0:1789477407.342329:0:8241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 24 00000100:00100000:2.0:1789477407.346368:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:0.0:1789477407.346446:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783680000 00000100:00100000:0.0:1789477407.346457:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783680000 00000100:00100000:0.0:1789477407.346520:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 8 00000100:00100000:0.0:1789477407.346531:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d50413480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9bc33f26-0aab-4a14-832f-c58d566de1b0+19:10307:x1876402783680000:12345-192.168.201.23@tcp:35:lfs.0 00000004:00010000:0.0:1789477407.346648:0:5847:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0x4:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be4c00/0xafddb3c8f9281a0f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2b06 expref: 19 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789477407.346958:0:5847:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967317 00000001:00080000:0.0:1789477407.347018:0:5847:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967318 00000001:00080000:0.0:1789477407.347713:0:5847:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967319 00010000:00010000:0.0:1789477407.347784:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be4800/0xafddb3c8f9281a24 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477407.347803:0:5847:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be4a00/0xafddb3c8f92819b4 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2adc expref: 23 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477407.347813:0:5847:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be4800/0xafddb3c8f9281a24 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477407.347851:0:5847:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be4a00/0xafddb3c8f92819b4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2adc expref: 23 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477407.347868:0:5847:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be4a00/0xafddb3c8f92819b4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2adc expref: 23 pid: 5845 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789477407.347884:0:5847:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d75369c00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5847:1876402802587520:192.168.201.23@tcp:104: 00000100:00100000:0.0:1789477407.347991:0:5847:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d0d47344180 going to sleep for 11 seconds 00000100:00100000:1.0:1789477407.354016:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:0.0:1789477407.354165:0:5847:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d75369c00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5847:1876402802587520:192.168.201.23@tcp:104: 00010000:00010000:0.0:1789477407.354199:0:5847:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be4800/0xafddb3c8f9281a24 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789477407.354920:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783680128 00000100:00100000:3.0:1789477407.354935:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783680128 00010000:00010000:3.0:1789477407.354987:0:5829:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be4a00/0xafddb3c8f92819b4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2adc expref: 24 pid: 5845 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789477407.355036:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 37 00000100:00100000:3.0:1789477407.355047:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d74f86a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9bc33f26-0aab-4a14-832f-c58d566de1b0+24:2354:x1876402783680128:12345-192.168.201.23@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789477407.355065:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789477407.355072:0:5829:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be4a00/0xafddb3c8f92819b4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2adc expref: 24 pid: 5845 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477407.355086:0:5829:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be4a00/0xafddb3c8f92819b4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2adc expref: 24 pid: 5845 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477407.355115:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be4a00/0xafddb3c8f92819b4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2adc expref: 24 pid: 5845 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477407.355136:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9d0d596aed00) 00010000:00010000:3.0:1789477407.355141:0:5829:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be4800/0xafddb3c8f9281a24 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477407.355150:0:5829:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be4800/0xafddb3c8f9281a24 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477407.355178:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be4800/0xafddb3c8f9281a24 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477407.355218:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789477407.355301:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d74f86a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9bc33f26-0aab-4a14-832f-c58d566de1b0+23:2354:x1876402783680128:12345-192.168.201.23@tcp:103:ldlm_bl.0 Request processed in 255us (1295us total) trans 0 rc 0/0 00000100:00100000:3.0:1789477407.355309:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 37 00010000:00010000:2.0:1789477407.355505:0:5847:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be4800/0xafddb3c8f9281a24 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477407.355514:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be4800/0xafddb3c8f9281a24 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789477407.355704:0:5847:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967320 00000001:00080000:2.0:1789477407.356183:0:5847:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967321 00000100:00100000:2.0:1789477407.356337:0:5847:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d50410700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5847:1876402802587648:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1789477407.356446:0:5847:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789477407.356943:0:5847:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d0d413706c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789477407.365919:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802587648 00000100:00100000:2.0:1789477407.365937:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802587648 00000100:00100000:2.0:1789477407.366058:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789477407.366070:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d50410000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5847:x1876402802587648:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1789477407.366267:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d50410000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5847:x1876402802587648:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 167us (9788us total) trans 0 rc 0/0 00000100:00100000:2.0:1789477407.366275:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789477407.366358:0:5847:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d50410700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5847:1876402802587648:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:3.0:1789477407.367164:0:5847:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967322 00000100:00100000:3.0:1789477407.367292:0:5847:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d7f700380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5847:1876402802587776:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1789477407.367357:0:5847:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789477407.375940:0:5847:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d0d44480e40 going to sleep for 11 seconds 00000100:00100000:0.0:1789477407.377348:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802587776 00000100:00100000:0.0:1789477407.377364:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802587776 00000100:00100000:0.0:1789477407.377438:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789477407.377450:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d7bddce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5847:x1876402802587776:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1789477407.378073:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d7bddce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5847:x1876402802587776:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 622us (10713us total) trans 4294967300 rc 0/0 00000100:00100000:0.0:1789477407.378083:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789477407.378242:0:5847:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d7f700380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5847:1876402802587776:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:3.0:1789477407.378333:0:5847:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967323 00010000:00010000:3.0:1789477407.378394:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be4800/0xafddb3c8f9281a24 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477407.378405:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be4800/0xafddb3c8f9281a24 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477407.378412:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be4800/0xafddb3c8f9281a24 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477407.378419:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d0d50be4800 already unused, calling callback (ffffffffc1fd54f0) 00010000:00010000:3.0:1789477407.378423:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be4800/0xafddb3c8f9281a24 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477407.378432:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be4800/0xafddb3c8f9281a24 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477407.378456:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9d0d596aed00) 00010000:00010000:3.0:1789477407.378459:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:3.0:1789477407.378463:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be4800/0xafddb3c8f9281a24 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477407.378470:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be4800/0xafddb3c8f9281a24 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1789477407.380287:0:5847:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x5:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:3.0:1789477407.380547:0:5847:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].2, 64 off8320 00000004:00080000:0.0:1789477407.382017:0:5847:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 352453437152ns, next at 353453429670ns, rc = 0 00000001:00080000:0.0:1789477407.382039:0:5847:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967324 00010000:00010000:0.0:1789477407.382118:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9d0d596aed00) 00010000:00010000:0.0:1789477407.382122:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1789477407.382133:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be4c00/0xafddb3c8f9281a0f lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2b06 expref: 27 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789477407.382330:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d50413480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9bc33f26-0aab-4a14-832f-c58d566de1b0+26:10307:x1876402783680000:12345-192.168.201.23@tcp:35:lfs.0 Request processed in 35798us (35968us total) trans 4294967325 rc 0/0 00000100:00100000:0.0:1789477407.382341:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 8 00000020:00080000:0.0:1789477407.382348:0:5847:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:1.0:1789477407.386161:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:2.0:1789477407.391529:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783680256 00000100:00100000:2.0:1789477407.391548:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783680256 00000100:00100000:2.0:1789477407.392028:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 45 00000100:00100000:2.0:1789477407.392041:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d74f84e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9bc33f26-0aab-4a14-832f-c58d566de1b0+26:10307:x1876402783680256:12345-192.168.201.23@tcp:101:lfs.0 00010000:00010000:2.0:1789477407.392075:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789477407.392106:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d59d6b400/0xafddb3c8f9281a2b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa90d500d7b8f2b0d expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477407.392180:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d59d6b400/0xafddb3c8f9281a2b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2b0d expref: 27 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477407.392196:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d59d6b400/0xafddb3c8f9281a2b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2b0d expref: 27 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477407.392218:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9d0d50919f00) 00010000:00010000:2.0:1789477407.392222:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789477407.392253:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d0d59d6b400, rc 0) 00000100:00100000:2.0:1789477407.392349:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d74f84e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9bc33f26-0aab-4a14-832f-c58d566de1b0+27:10307:x1876402783680256:12345-192.168.201.23@tcp:101:lfs.0 Request processed in 306us (6194us total) trans 0 rc 0/0 00000100:00100000:2.0:1789477407.392357:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 45 00000100:00100000:1.0:1789477407.398360:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:3.0:1789477407.398463:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783680512 00000100:00100000:3.0:1789477407.398474:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783680512 00000100:00100000:3.0:1789477407.398540:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 9 00000100:00100000:3.0:1789477407.398561:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d5845f450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9bc33f26-0aab-4a14-832f-c58d566de1b0+27:10307:x1876402783680512:12345-192.168.201.23@tcp:35:lfs.0 00000100:00100000:3.0:1789477407.399211:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d5845f450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9bc33f26-0aab-4a14-832f-c58d566de1b0+28:10307:x1876402783680512:12345-192.168.201.23@tcp:35:lfs.0 Request processed in 660us (861us total) trans 4294967326 rc 0/0 00000100:00100000:3.0:1789477407.399220:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 9 00010000:00010000:3.0:1789477407.409035:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789477407.576294:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:0.0:1789477407.576722:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783680768 00000100:00100000:0.0:1789477407.577062:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783680768 00000100:00100000:0.0:1789477407.577168:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 46 00000100:00100000:0.0:1789477407.577179:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d74f85c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9bc33f26-0aab-4a14-832f-c58d566de1b0+28:10317:x1876402783680768:12345-192.168.201.23@tcp:101:lfs.0 00010000:00010000:0.0:1789477407.577205:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789477407.577226:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be4c00/0xafddb3c8f9281a32 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa90d500d7b8f2b14 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789477407.577351:0:5845:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00010000:00010000:0.0:1789477407.577491:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be4c00/0xafddb3c8f9281a32 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2b14 expref: 30 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477407.577510:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9d0d596ae000) 00010000:00010000:0.0:1789477407.577513:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1789477407.577518:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be4c00/0xafddb3c8f9281a32 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2b14 expref: 30 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477407.577574:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d0d50be4c00, rc 0) 00000100:00100000:0.0:1789477407.577740:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d74f85c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9bc33f26-0aab-4a14-832f-c58d566de1b0+29:10317:x1876402783680768:12345-192.168.201.23@tcp:101:lfs.0 Request processed in 563us (1460us total) trans 4294967327 rc 301/301 00000100:00100000:0.0:1789477407.577748:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 46 00000100:00100000:2.0:1789477407.594328:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:3.0:1789477407.594449:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783680896 00000100:00100000:3.0:1789477407.594461:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783680896 00000100:00100000:3.0:1789477407.594539:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 47 00000100:00100000:3.0:1789477407.594552:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d50411880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9bc33f26-0aab-4a14-832f-c58d566de1b0+29:10317:x1876402783680896:12345-192.168.201.23@tcp:34:lfs.0 00010000:00010000:3.0:1789477407.594983:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49eca000/0xafddb3c8f9281a40 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477407.595075:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49eca000/0xafddb3c8f9281a40 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477407.595113:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49eca000/0xafddb3c8f9281a40 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477407.595132:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49eca600/0xafddb3c8f9281a47 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477407.595139:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49eca600/0xafddb3c8f9281a47 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477407.595145:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49eca600/0xafddb3c8f9281a47 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477407.595833:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49ecba00/0xafddb3c8f9281a4e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477407.595845:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49ecba00/0xafddb3c8f9281a4e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477407.595853:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49ecba00/0xafddb3c8f9281a4e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789477407.595906:0:5846:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49ecba00/0xafddb3c8f9281a4e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477407.595920:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49eca000/0xafddb3c8f9281a40 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477407.595927:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49eca000/0xafddb3c8f9281a40 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477407.595933:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49eca000/0xafddb3c8f9281a40 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477407.595952:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d0d49eca000 already unused, calling callback (ffffffffc1fd54f0) 00010000:00010000:3.0:1789477407.595957:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49eca000/0xafddb3c8f9281a40 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477407.595965:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49eca000/0xafddb3c8f9281a40 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477407.595980:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9d0d5b9f4000) 00010000:00010000:3.0:1789477407.595984:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789477407.595989:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49eca000/0xafddb3c8f9281a40 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477407.595995:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49eca000/0xafddb3c8f9281a40 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477407.596836:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49eca600/0xafddb3c8f9281a47 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477407.596843:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49eca600/0xafddb3c8f9281a47 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477407.596849:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49eca600/0xafddb3c8f9281a47 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477407.596854:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d0d49eca600 already unused, calling callback (ffffffffc1fd54f0) 00010000:00010000:3.0:1789477407.596858:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49eca600/0xafddb3c8f9281a47 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477407.596864:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49eca600/0xafddb3c8f9281a47 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477407.596885:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9d0d44568200) 00010000:00010000:3.0:1789477407.596888:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789477407.596891:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49eca600/0xafddb3c8f9281a47 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477407.596897:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49eca600/0xafddb3c8f9281a47 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477407.596915:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49ecba00/0xafddb3c8f9281a4e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477407.596920:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49ecba00/0xafddb3c8f9281a4e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477407.596925:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49ecba00/0xafddb3c8f9281a4e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477407.596929:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d0d49ecba00 already unused, calling callback (ffffffffc1fd54f0) 00010000:00010000:3.0:1789477407.596933:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49ecba00/0xafddb3c8f9281a4e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477407.596938:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49ecba00/0xafddb3c8f9281a4e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477407.596944:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9d0d50919f00) 00010000:00010000:3.0:1789477407.596946:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789477407.596949:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49ecba00/0xafddb3c8f9281a4e lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477407.596954:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49ecba00/0xafddb3c8f9281a4e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789477407.598969:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d50411880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9bc33f26-0aab-4a14-832f-c58d566de1b0+29:10317:x1876402783680896:12345-192.168.201.23@tcp:34:lfs.0 Request processed in 4408us (4640us total) trans 0 rc 0/0 00000100:00100000:3.0:1789477407.598986:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 47 00000100:00100000:2.0:1789477407.610317:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:1.0:1789477407.613125:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783681152 00000100:00100000:1.0:1789477407.613143:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783681152 00000100:00100000:1.0:1789477407.613216:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 10 00000100:00100000:1.0:1789477407.613239:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d50413800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9bc33f26-0aab-4a14-832f-c58d566de1b0+29:10317:x1876402783681152:12345-192.168.201.23@tcp:35:lfs.0 00000100:00100000:1.0:1789477407.613549:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d50413800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9bc33f26-0aab-4a14-832f-c58d566de1b0+30:10317:x1876402783681152:12345-192.168.201.23@tcp:35:lfs.0 Request processed in 322us (3240us total) trans 4294967328 rc 0/0 00000100:00100000:1.0:1789477407.613557:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 10 00000100:00100000:2.0:1789477407.701846:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:3.0:1789477407.702369:0:6999:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783681408 00000100:00100000:3.0:1789477407.702387:0:6999:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783681408 00000100:00100000:3.0:1789477407.702479:0:6999:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 48 00000100:00100000:3.0:1789477407.702492:0:6999:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d50410a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9bc33f26-0aab-4a14-832f-c58d566de1b0+30:10320:x1876402783681408:12345-192.168.201.23@tcp:101:lfs.0 00010000:00010000:3.0:1789477407.702531:0:6999:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789477407.702564:0:6999:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49ecba00/0xafddb3c8f9281a55 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa90d500d7b8f2b1b expref: -99 pid: 6999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477407.702766:0:6999:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49eca600/0xafddb3c8f9281a5c lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477407.702785:0:6999:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49eca600/0xafddb3c8f9281a5c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477407.702798:0:6999:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49eca600/0xafddb3c8f9281a5c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477407.702816:0:6999:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49eca000/0xafddb3c8f9281a63 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477407.702823:0:6999:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49eca000/0xafddb3c8f9281a63 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477407.702829:0:6999:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49eca000/0xafddb3c8f9281a63 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477407.703106:0:6999:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49ecb200/0xafddb3c8f9281a6a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477407.703116:0:6999:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49ecb200/0xafddb3c8f9281a6a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477407.703124:0:6999:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49ecb200/0xafddb3c8f9281a6a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789477407.703135:0:6999:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:3.0:1789477407.704494:0:6999:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49eca600/0xafddb3c8f9281a5c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477407.704516:0:6999:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49eca600/0xafddb3c8f9281a5c lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477407.704525:0:6999:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49eca600/0xafddb3c8f9281a5c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477407.704532:0:6999:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d0d49eca600 already unused, calling callback (ffffffffc1fd54f0) 00010000:00010000:3.0:1789477407.704538:0:6999:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49eca600/0xafddb3c8f9281a5c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477407.704547:0:6999:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49eca600/0xafddb3c8f9281a5c lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477407.704567:0:6999:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9d0d5b9f4000) 00010000:00010000:3.0:1789477407.704571:0:6999:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789477407.704692:0:6999:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49eca600/0xafddb3c8f9281a5c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477407.704722:0:6999:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49eca600/0xafddb3c8f9281a5c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477407.704746:0:6999:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49eca000/0xafddb3c8f9281a63 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477407.704753:0:6999:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49eca000/0xafddb3c8f9281a63 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477407.704760:0:6999:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49eca000/0xafddb3c8f9281a63 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477407.704765:0:6999:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d0d49eca000 already unused, calling callback (ffffffffc1fd54f0) 00010000:00010000:3.0:1789477407.704769:0:6999:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49eca000/0xafddb3c8f9281a63 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477407.704775:0:6999:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49eca000/0xafddb3c8f9281a63 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477407.704784:0:6999:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9d0d44568200) 00010000:00010000:3.0:1789477407.704787:0:6999:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789477407.704790:0:6999:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49eca000/0xafddb3c8f9281a63 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477407.704796:0:6999:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49eca000/0xafddb3c8f9281a63 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477407.704865:0:6999:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49ecba00/0xafddb3c8f9281a55 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2b1b expref: 33 pid: 6999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477407.704883:0:6999:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49ecb200/0xafddb3c8f9281a6a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2b1b expref: 32 pid: 6999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477407.704898:0:6999:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9d0d50919f00) 00010000:00010000:3.0:1789477407.704901:0:6999:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789477407.704904:0:6999:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d0d49ecb200, rc 0) 00000100:00100000:3.0:1789477407.705021:0:6999:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d50410a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9bc33f26-0aab-4a14-832f-c58d566de1b0+32:10320:x1876402783681408:12345-192.168.201.23@tcp:101:lfs.0 Request processed in 2531us (3185us total) trans 4294967329 rc 0/0 00000100:00100000:3.0:1789477407.705032:0:6999:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 48 00000100:00100000:2.0:1789477407.713170:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:0.0:1789477407.713987:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783681536 00000100:00100000:0.0:1789477407.714000:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783681536 00000100:00100000:0.0:1789477407.714065:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 49 00000100:00100000:0.0:1789477407.714076:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d50411f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9bc33f26-0aab-4a14-832f-c58d566de1b0+32:10320:x1876402783681536:12345-192.168.201.23@tcp:54:lfs.0 00010000:00010000:0.0:1789477407.714156:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be4c00/0xafddb3c8f9281a78 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477407.714177:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be4c00/0xafddb3c8f9281a78 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477407.714190:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be4c00/0xafddb3c8f9281a78 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477407.714223:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be4c00/0xafddb3c8f9281a78 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477407.714240:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be4c00/0xafddb3c8f9281a78 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477407.714247:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be4c00/0xafddb3c8f9281a78 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477407.714255:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d0d50be4c00 already unused, calling callback (ffffffffc1fd54f0) 00010000:00010000:0.0:1789477407.714260:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be4c00/0xafddb3c8f9281a78 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477407.714285:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be4c00/0xafddb3c8f9281a78 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477407.714299:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9d0d50919f00) 00010000:00010000:0.0:1789477407.714302:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1789477407.714307:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be4c00/0xafddb3c8f9281a78 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477407.714313:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be4c00/0xafddb3c8f9281a78 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789477407.714418:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d50411f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9bc33f26-0aab-4a14-832f-c58d566de1b0+32:10320:x1876402783681536:12345-192.168.201.23@tcp:54:lfs.0 Request processed in 342us (1257us total) trans 0 rc 0/0 00000100:00100000:0.0:1789477407.714426:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 49 00000100:00100000:1.0:1789477407.718795:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:0.0:1789477407.718900:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783681792 00000100:00100000:0.0:1789477407.718921:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783681792 00000100:00100000:0.0:1789477407.719006:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 11 00000100:00100000:0.0:1789477407.719018:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d6d464700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9bc33f26-0aab-4a14-832f-c58d566de1b0+32:10320:x1876402783681792:12345-192.168.201.23@tcp:35:lfs.0 00000100:00100000:0.0:1789477407.719297:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d6d464700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9bc33f26-0aab-4a14-832f-c58d566de1b0+33:10320:x1876402783681792:12345-192.168.201.23@tcp:35:lfs.0 Request processed in 281us (518us total) trans 4294967330 rc 0/0 00000100:00100000:0.0:1789477407.719306:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 11 00000100:00100000:2.0:1789477408.062047:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:0.0:1789477408.062521:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783682048 00000100:00100000:0.0:1789477408.062536:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783682048 00000100:00100000:0.0:1789477408.062702:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 50 00000100:00100000:0.0:1789477408.062714:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d50413b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9bc33f26-0aab-4a14-832f-c58d566de1b0+33:10351:x1876402783682048:12345-192.168.201.23@tcp:101:cat.0 00000100:00080000:2.0:1789477408.062913:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1789477408.063027:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789477408.063058:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be4c00/0xafddb3c8f9281a7f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa90d500d7b8f2b22 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477408.063241:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be5800/0xafddb3c8f9281a86 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477408.063259:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be5800/0xafddb3c8f9281a86 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477408.063274:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be5800/0xafddb3c8f9281a86 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789477408.063287:0:5845:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:0.0:1789477408.065699:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be4c00/0xafddb3c8f9281a7f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2b22 expref: 36 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477408.066490:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be5800/0xafddb3c8f9281a86 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2b22 expref: 35 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477408.066507:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9d0d50919f00) 00010000:00010000:0.0:1789477408.066510:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789477408.066515:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d0d50be5800, rc 0) 00000100:00100000:0.0:1789477408.067692:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d50413b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9bc33f26-0aab-4a14-832f-c58d566de1b0+35:10351:x1876402783682048:12345-192.168.201.23@tcp:101:cat.0 Request processed in 4968us (5649us total) trans 4294967331 rc 0/0 00000100:00100000:0.0:1789477408.067706:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 50 00000100:00100000:2.0:1789477408.074411:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:2.0:1789477408.074484:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:0.0:1789477408.074735:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783682304 00000100:00100000:0.0:1789477408.074751:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783682304 00000100:00100000:0.0:1789477408.074828:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 12 00000100:00100000:0.0:1789477408.074841:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d50412300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9bc33f26-0aab-4a14-832f-c58d566de1b0+35:10351:x1876402783682304:12345-192.168.201.23@tcp:35:cat.0 00000100:00100000:3.0:1789477408.075268:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783682432 00000100:00100000:3.0:1789477408.075274:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783682432 00000100:00100000:0.0:1789477408.075497:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d50412300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9bc33f26-0aab-4a14-832f-c58d566de1b0+37:10351:x1876402783682304:12345-192.168.201.23@tcp:35:cat.0 Request processed in 656us (1101us total) trans 4294967332 rc 0/0 00000100:00100000:0.0:1789477408.075526:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 12 00000100:00100000:2.0:1789477408.082748:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 3 00000100:00100000:2.0:1789477408.082790:0:6711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d50a81050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9bc33f26-0aab-4a14-832f-c58d566de1b0+37:2353:x1876402783682432:12345-192.168.201.23@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789477408.082822:0:6711:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789477408.082865:0:6711:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be5800/0xafddb3c8f9281a86 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2b22 expref: 37 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477408.082895:0:6711:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9d0d50919f00) 00010000:00010000:2.0:1789477408.082902:0:6711:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789477408.083005:0:6711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d50a81050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9bc33f26-0aab-4a14-832f-c58d566de1b0+36:2353:x1876402783682432:12345-192.168.201.23@tcp:103:ldlm_bl.0 Request processed in 239us (8520us total) trans 0 rc 0/0 00000100:00100000:2.0:1789477408.083014:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 3 00000100:00100000:2.0:1789477408.206283:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:0.0:1789477408.206426:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783682688 00000100:00100000:0.0:1789477408.206442:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783682688 00000100:00100000:0.0:1789477408.206525:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 51 00000100:00100000:0.0:1789477408.206548:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d50411500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9bc33f26-0aab-4a14-832f-c58d566de1b0+35:10357:x1876402783682688:12345-192.168.201.23@tcp:101:dd.0 00010000:00010000:0.0:1789477408.206621:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789477408.206626:0:5844:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1789477408.206666:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49ecbc00/0xafddb3c8f92819ec lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2af8 expref: 35 pid: 6999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477408.206696:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9d0d5b9f4000) 00010000:00010000:0.0:1789477408.206702:0:5844:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789477408.206719:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be4c00/0xafddb3c8f9281a94 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa90d500d7b8f2b29 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477408.207196:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be5a00/0xafddb3c8f9281a9b lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477408.207215:0:5844:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49ecb200/0xafddb3c8f9281a6a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2b1b expref: 35 pid: 6999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477408.207235:0:5844:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be5a00/0xafddb3c8f9281a9b lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477408.207283:0:5844:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49ecb200/0xafddb3c8f9281a6a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2b1b expref: 35 pid: 6999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477408.207301:0:5844:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49ecb200/0xafddb3c8f9281a6a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2b1b expref: 35 pid: 6999 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789477408.207338:0:5844:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d75369c00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5844:1876402802587904:192.168.201.23@tcp:104: 00000100:00100000:0.0:1789477408.207546:0:5844:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d0d473446c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789477408.214831:0:5844:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d75369c00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5844:1876402802587904:192.168.201.23@tcp:104: 00010000:00010000:0.0:1789477408.214878:0:5844:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be5a00/0xafddb3c8f9281a9b lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789477408.217376:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:3.0:1789477408.217634:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783682816 00000100:00100000:3.0:1789477408.217649:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783682816 00010000:00010000:3.0:1789477408.217713:0:5829:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49ecb200/0xafddb3c8f9281a6a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2b1b expref: 36 pid: 6999 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789477408.217780:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 38 00000100:00100000:3.0:1789477408.217793:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d50412d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9bc33f26-0aab-4a14-832f-c58d566de1b0+36:2354:x1876402783682816:12345-192.168.201.23@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789477408.217813:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789477408.217823:0:5829:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49ecb200/0xafddb3c8f9281a6a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2b1b expref: 36 pid: 6999 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477408.217839:0:5829:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49ecb200/0xafddb3c8f9281a6a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2b1b expref: 36 pid: 6999 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477408.217872:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49ecb200/0xafddb3c8f9281a6a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2b1b expref: 36 pid: 6999 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477408.217900:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9d0d50919f00) 00010000:00010000:3.0:1789477408.217936:0:5829:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be5a00/0xafddb3c8f9281a9b lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477408.217949:0:5829:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be5a00/0xafddb3c8f9281a9b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477408.217958:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be5a00/0xafddb3c8f9281a9b lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477408.218000:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789477408.218087:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d50412d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9bc33f26-0aab-4a14-832f-c58d566de1b0+35:2354:x1876402783682816:12345-192.168.201.23@tcp:103:ldlm_bl.0 Request processed in 296us (726us total) trans 0 rc 0/0 00000100:00100000:3.0:1789477408.218096:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 38 00010000:00010000:2.0:1789477408.219093:0:5844:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be5a00/0xafddb3c8f9281a9b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477408.219126:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be5a00/0xafddb3c8f9281a9b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789477408.219156:0:5844:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:2.0:1789477408.219406:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be4c00/0xafddb3c8f9281a94 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2b29 expref: 36 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477408.219442:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be5a00/0xafddb3c8f9281a9b lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2b29 expref: 35 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477408.219454:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9d0d50919f00) 00010000:00010000:2.0:1789477408.219457:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1789477408.219460:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d0d50be5a00, rc 0) 00000100:00100000:2.0:1789477408.219537:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d50411500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9bc33f26-0aab-4a14-832f-c58d566de1b0+35:10357:x1876402783682688:12345-192.168.201.23@tcp:101:dd.0 Request processed in 12999us (13270us total) trans 4294967333 rc 0/0 00000100:00100000:2.0:1789477408.219549:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 51 00000100:00100000:2.0:1789477408.232909:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:3.0:1789477408.233085:0:6999:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783683072 00000100:00100000:3.0:1789477408.233101:0:6999:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783683072 00000100:00100000:3.0:1789477408.233188:0:6999:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 52 00000100:00100000:3.0:1789477408.233202:0:6999:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d50410e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9bc33f26-0aab-4a14-832f-c58d566de1b0+35:10357:x1876402783683072:12345-192.168.201.23@tcp:36:dd.0 00010000:00010000:3.0:1789477408.233664:0:6999:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49ecb200/0xafddb3c8f9281aa9 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477408.233688:0:6999:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49ecb200/0xafddb3c8f9281aa9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477408.233702:0:6999:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49ecb200/0xafddb3c8f9281aa9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789477408.234079:0:6999:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967334 00000004:00010000:3.0:1789477408.234116:0:6999:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000ca2da9c9 reply state 000000000bcb1d09 transno 4294967335 ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49ecb200/0xafddb3c8f9281aa9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789477408.234128:0:6999:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789477408.234294:0:6999:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d50410e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9bc33f26-0aab-4a14-832f-c58d566de1b0+38:10357:x1876402783683072:12345-192.168.201.23@tcp:36:dd.0 Request processed in 1093us (1408us total) trans 4294967335 rc 0/0 00000100:00100000:3.0:1789477408.234304:0:6999:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 52 00000020:00080000:3.0:1789477408.234310:0:6999:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1789477408.244950:0:3296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49ecb200/0xafddb3c8f9281aa9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477408.244976:0:3296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49ecb200/0xafddb3c8f9281aa9 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477408.244984:0:3296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49ecb200/0xafddb3c8f9281aa9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477408.244992:0:3296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d0d49ecb200 already unused, calling callback (ffffffffc1fd54f0) 00010000:00010000:2.0:1789477408.244999:0:3296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49ecb200/0xafddb3c8f9281aa9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477408.245034:0:3296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49ecb200/0xafddb3c8f9281aa9 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477408.245057:0:3296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9d0d50919f00) 00010000:00010000:2.0:1789477408.245061:0:3296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789477408.245067:0:3296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49ecb200/0xafddb3c8f9281aa9 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477408.245073:0:3296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49ecb200/0xafddb3c8f9281aa9 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477408.435240:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789477408.611245:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:3.0:1789477408.611483:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783683200 00000100:00100000:3.0:1789477408.611510:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783683200 00000100:00100000:3.0:1789477408.611633:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 53 00000100:00100000:3.0:1789477408.611656:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d47668e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9bc33f26-0aab-4a14-832f-c58d566de1b0+37:10371:x1876402783683200:12345-192.168.201.23@tcp:101:stat.0 00010000:00010000:3.0:1789477408.611689:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789477408.611725:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49ecba00/0xafddb3c8f9281ab0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa90d500d7b8f2b30 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477408.611813:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49eca000/0xafddb3c8f9281ab7 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477408.611833:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49eca000/0xafddb3c8f9281ab7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477408.611850:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49eca000/0xafddb3c8f9281ab7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477408.611869:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49eca600/0xafddb3c8f9281abe lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477408.611876:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49eca600/0xafddb3c8f9281abe lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477408.611883:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49eca600/0xafddb3c8f9281abe lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477408.612030:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49ecb200/0xafddb3c8f9281ac5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477408.612062:0:5846:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be5a00/0xafddb3c8f9281a9b lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2b29 expref: 38 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477408.612073:0:5846:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49ecb200/0xafddb3c8f9281ac5 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477408.612120:0:5846:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be5a00/0xafddb3c8f9281a9b lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2b29 expref: 38 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477408.612137:0:5846:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be5a00/0xafddb3c8f9281a9b lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2b29 expref: 38 pid: 5844 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789477408.612154:0:5846:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d7bdde680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5846:1876402802588032:192.168.201.23@tcp:104: 00000100:00100000:3.0:1789477408.612286:0:5846:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d0d44480f00 going to sleep for 11 seconds 00000100:00100000:2.0:1789477408.615703:0:5846:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d7bdde680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5846:1876402802588032:192.168.201.23@tcp:104: 00010000:00010000:2.0:1789477408.615756:0:5846:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49ecb200/0xafddb3c8f9281ac5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789477408.616277:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:2.0:1789477408.616940:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783683456 00000100:00100000:2.0:1789477408.616968:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783683456 00000100:00100000:2.0:1789477408.617052:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 13 00000100:00100000:2.0:1789477408.617065:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d4766aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9bc33f26-0aab-4a14-832f-c58d566de1b0+39:9241:x1876402783683456:12345-192.168.201.23@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1789477408.618826:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d4766aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9bc33f26-0aab-4a14-832f-c58d566de1b0+40:9241:x1876402783683456:12345-192.168.201.23@tcp:35:ldlm_bl.0 Request processed in 1750us (2538us total) trans 4294967336 rc 0/0 00000100:00100000:2.0:1789477408.618843:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 13 00000100:00100000:1.0:1789477408.622207:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:2.0:1789477408.623294:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783683584 00000100:00100000:2.0:1789477408.623321:0:6711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783683584 00010000:00010000:2.0:1789477408.623384:0:6711:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be5a00/0xafddb3c8f9281a9b lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2b29 expref: 40 pid: 5844 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789477408.624085:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 39 00000100:00100000:2.0:1789477408.624119:0:6711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d623c8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9bc33f26-0aab-4a14-832f-c58d566de1b0+40:2355:x1876402783683584:12345-192.168.201.23@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789477408.624141:0:6711:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789477408.624150:0:6711:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be5a00/0xafddb3c8f9281a9b lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2b29 expref: 40 pid: 5844 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477408.624167:0:6711:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be5a00/0xafddb3c8f9281a9b lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2b29 expref: 40 pid: 5844 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477408.624197:0:6711:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be5a00/0xafddb3c8f9281a9b lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2b29 expref: 40 pid: 5844 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477408.624229:0:6711:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9d0d50919f00) 00010000:00010000:2.0:1789477408.624235:0:6711:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49ecb200/0xafddb3c8f9281ac5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477408.624246:0:6711:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49ecb200/0xafddb3c8f9281ac5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477408.624255:0:6711:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49ecb200/0xafddb3c8f9281ac5 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477408.624308:0:6711:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789477408.624390:0:6711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d623c8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9bc33f26-0aab-4a14-832f-c58d566de1b0+39:2355:x1876402783683584:12345-192.168.201.23@tcp:103:ldlm_bl.0 Request processed in 276us (2196us total) trans 0 rc 0/0 00000100:00100000:2.0:1789477408.624526:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 39 00010000:00010000:0.0:1789477408.625101:0:5846:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49ecb200/0xafddb3c8f9281ac5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477408.625114:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49ecb200/0xafddb3c8f9281ac5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789477408.625181:0:5846:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:0.0:1789477408.625187:0:5846:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1789477408.625256:0:5846:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49ecb200/0xafddb3c8f9281ac5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477408.625274:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49ecb200/0xafddb3c8f9281ac5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477408.625284:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49eca000/0xafddb3c8f9281ab7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477408.625291:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49eca000/0xafddb3c8f9281ab7 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477408.625298:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49eca000/0xafddb3c8f9281ab7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477408.625329:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d0d49eca000 already unused, calling callback (ffffffffc1fd54f0) 00010000:00010000:0.0:1789477408.625334:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49eca000/0xafddb3c8f9281ab7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477408.625343:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49eca000/0xafddb3c8f9281ab7 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477408.625360:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9d0d5b9f4000) 00010000:00010000:0.0:1789477408.625363:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789477408.625366:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49eca000/0xafddb3c8f9281ab7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477408.625372:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49eca000/0xafddb3c8f9281ab7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477408.625832:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49eca600/0xafddb3c8f9281abe lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477408.625843:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49eca600/0xafddb3c8f9281abe lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477408.625850:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49eca600/0xafddb3c8f9281abe lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477408.625855:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d0d49eca600 already unused, calling callback (ffffffffc1fd54f0) 00010000:00010000:0.0:1789477408.625858:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49eca600/0xafddb3c8f9281abe lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477408.625865:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49eca600/0xafddb3c8f9281abe lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477408.625887:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9d0d44568200) 00010000:00010000:0.0:1789477408.625889:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789477408.625892:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49eca600/0xafddb3c8f9281abe lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477408.625898:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49eca600/0xafddb3c8f9281abe lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477408.626459:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49ecba00/0xafddb3c8f9281ab0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2b30 expref: 39 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477408.626485:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49ecb200/0xafddb3c8f9281ac5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2b30 expref: 38 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477408.626494:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9d0d50919f00) 00010000:00010000:0.0:1789477408.626497:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789477408.626499:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d0d49ecb200, rc 0) 00000100:00100000:0.0:1789477408.626885:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d47668e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9bc33f26-0aab-4a14-832f-c58d566de1b0+38:10371:x1876402783683200:12345-192.168.201.23@tcp:101:stat.0 Request processed in 15230us (15655us total) trans 0 rc 0/0 00000100:00100000:0.0:1789477408.626896:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 53 00000100:00100000:1.0:1789477408.747028:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:0.0:1789477408.747403:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783683840 00000100:00100000:0.0:1789477408.747427:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783683840 00000100:00100000:0.0:1789477408.747720:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 54 00000100:00100000:0.0:1789477408.747736:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d623c9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9bc33f26-0aab-4a14-832f-c58d566de1b0+38:10377:x1876402783683840:12345-192.168.201.23@tcp:36:truncate.0 00010000:00010000:0.0:1789477408.747848:0:5845:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789477408.747888:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49ecb200/0xafddb3c8f9281ac5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2b30 expref: 38 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477408.747945:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9d0d50919f00) 00010000:00010000:0.0:1789477408.747951:0:5845:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789477408.748333:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be5a00/0xafddb3c8f9281acc lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477408.748353:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be5a00/0xafddb3c8f9281acc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477408.748365:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be5a00/0xafddb3c8f9281acc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789477408.748434:0:5845:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967337 00000004:00010000:0.0:1789477408.748462:0:5845:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000099730762 reply state 0000000005679eed transno 4294967338 ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be5a00/0xafddb3c8f9281acc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789477408.748473:0:5845:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789477408.748693:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d623c9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9bc33f26-0aab-4a14-832f-c58d566de1b0+40:10377:x1876402783683840:12345-192.168.201.23@tcp:36:truncate.0 Request processed in 959us (1674us total) trans 4294967338 rc 0/0 00000100:00100000:0.0:1789477408.748703:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 54 00000020:00080000:0.0:1789477408.748710:0:5845:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1789477408.751144:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:1.0:1789477408.751200:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:1.0:1789477408.751239:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:0.0:1789477408.751313:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783684096 00000100:00100000:0.0:1789477408.751326:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783684096 00000100:00100000:0.0:1789477408.751427:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 62 00000100:00100000:0.0:1789477408.751438:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d623ca680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9bc33f26-0aab-4a14-832f-c58d566de1b0+7:2353:x1876402783684096:12345-192.168.201.23@tcp:400:kworker.0 00000100:00100000:2.0:1789477408.751493:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783684224 00000100:00100000:2.0:1789477408.751498:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783684224 00000100:00100000:2.0:1789477408.751542:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 134 00000100:00100000:0.0:1789477408.751543:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d623ca680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9bc33f26-0aab-4a14-832f-c58d566de1b0+7:2353:x1876402783684096:12345-192.168.201.23@tcp:400:kworker.0 Request processed in 106us (413us total) trans 0 rc 0/0 00000100:00100000:2.0:1789477408.751550:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d623cb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cf70c55a-e056-446b-8936-49e7cd31fc79+5:2353:x1876402783684224:12345-192.168.201.23@tcp:400:kworker.0 00000100:00100000:0.0:1789477408.751551:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 62 00000100:00100000:2.0:1789477408.751628:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d623cb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cf70c55a-e056-446b-8936-49e7cd31fc79+5:2353:x1876402783684224:12345-192.168.201.23@tcp:400:kworker.0 Request processed in 79us (388us total) trans 0 rc 0/0 00000100:00100000:2.0:1789477408.751635:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 134 00000100:00100000:3.0:1789477408.751860:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783683968 00000100:00100000:3.0:1789477408.751865:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783683968 00000100:00100000:3.0:1789477408.751897:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 287 00000100:00100000:3.0:1789477408.751903:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d44523c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5c82dded-6a10-4ce8-abd1-52bd956b9523+13:2353:x1876402783683968:12345-192.168.201.23@tcp:400:kworker.0 00000100:00100000:3.0:1789477408.751938:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d44523c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5c82dded-6a10-4ce8-abd1-52bd956b9523+13:2353:x1876402783683968:12345-192.168.201.23@tcp:400:kworker.0 Request processed in 35us (738us total) trans 0 rc 0/0 00000100:00100000:3.0:1789477408.751945:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 287 00000100:00080000:1.0:1789477408.752092:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789477408.752097:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1789477408.758257:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be5a00/0xafddb3c8f9281acc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477408.758305:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be5a00/0xafddb3c8f9281acc lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477408.758314:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be5a00/0xafddb3c8f9281acc lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477408.758321:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d0d50be5a00 already unused, calling callback (ffffffffc1fd54f0) 00010000:00010000:0.0:1789477408.758327:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be5a00/0xafddb3c8f9281acc lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477408.758337:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be5a00/0xafddb3c8f9281acc lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477408.758360:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9d0d50919f00) 00010000:00010000:0.0:1789477408.758364:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789477408.758370:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be5a00/0xafddb3c8f9281acc lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477408.758377:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be5a00/0xafddb3c8f9281acc lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789477408.938005:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:3.0:1789477408.938285:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783684352 00000100:00100000:3.0:1789477408.938300:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783684352 00000100:00100000:3.0:1789477408.938380:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 55 00000100:00100000:3.0:1789477408.938393:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d75369c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9bc33f26-0aab-4a14-832f-c58d566de1b0+39:10391:x1876402783684352:12345-192.168.201.23@tcp:101:stat.0 00010000:00010000:3.0:1789477408.938428:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789477408.938474:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49ecbc00/0xafddb3c8f9281ad3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa90d500d7b8f2b37 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477408.938630:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49ecb200/0xafddb3c8f9281ada lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477408.938649:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49ecb200/0xafddb3c8f9281ada lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477408.938667:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49ecb200/0xafddb3c8f9281ada lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477408.938686:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49ecba00/0xafddb3c8f9281ae1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477408.938693:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49ecba00/0xafddb3c8f9281ae1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477408.938699:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49ecba00/0xafddb3c8f9281ae1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477408.938836:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49eca600/0xafddb3c8f9281ae8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477408.938844:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49eca600/0xafddb3c8f9281ae8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477408.938851:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49eca600/0xafddb3c8f9281ae8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789477408.938896:0:5845:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 1234567 00000004:00200000:3.0:1789477408.938901:0:5845:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1789477408.938926:0:5845:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49eca600/0xafddb3c8f9281ae8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477408.939308:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49eca600/0xafddb3c8f9281ae8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477408.939322:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49ecb200/0xafddb3c8f9281ada lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477408.939329:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49ecb200/0xafddb3c8f9281ada lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477408.939336:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49ecb200/0xafddb3c8f9281ada lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477408.939344:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d0d49ecb200 already unused, calling callback (ffffffffc1fd54f0) 00010000:00010000:3.0:1789477408.939349:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49ecb200/0xafddb3c8f9281ada lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477408.939357:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49ecb200/0xafddb3c8f9281ada lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477408.939372:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9d0d5b9f4000) 00010000:00010000:3.0:1789477408.939376:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789477408.939381:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49ecb200/0xafddb3c8f9281ada lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477408.939388:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49ecb200/0xafddb3c8f9281ada lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477408.939410:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49ecba00/0xafddb3c8f9281ae1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477408.939416:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49ecba00/0xafddb3c8f9281ae1 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477408.939430:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49ecba00/0xafddb3c8f9281ae1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477408.939435:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d0d49ecba00 already unused, calling callback (ffffffffc1fd54f0) 00010000:00010000:3.0:1789477408.939439:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49ecba00/0xafddb3c8f9281ae1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477408.939445:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49ecba00/0xafddb3c8f9281ae1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477408.939454:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9d0d44568400) 00010000:00010000:3.0:1789477408.939457:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789477408.939460:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49ecba00/0xafddb3c8f9281ae1 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477408.939464:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49ecba00/0xafddb3c8f9281ae1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477408.939507:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49ecbc00/0xafddb3c8f9281ad3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2b37 expref: 41 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477408.939713:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49eca600/0xafddb3c8f9281ae8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2b37 expref: 40 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477408.939723:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9d0d50919f00) 00010000:00010000:3.0:1789477408.939725:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789477408.939728:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d0d49eca600, rc 0) 00000100:00100000:3.0:1789477408.939834:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d75369c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9bc33f26-0aab-4a14-832f-c58d566de1b0+40:10391:x1876402783684352:12345-192.168.201.23@tcp:101:stat.0 Request processed in 1442us (1844us total) trans 0 rc 0/0 00000100:00100000:3.0:1789477408.939852:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 55 00000100:00100000:1.0:1789477409.049749:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:0.0:1789477409.050621:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783684608 00000100:00100000:0.0:1789477409.050638:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783684608 00000100:00100000:0.0:1789477409.050733:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 56 00000100:00100000:0.0:1789477409.050746:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d623c9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9bc33f26-0aab-4a14-832f-c58d566de1b0+40:10401:x1876402783684608:12345-192.168.201.23@tcp:101:lfs.0 00010000:00010000:0.0:1789477409.052365:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789477409.052418:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be5a00/0xafddb3c8f9281aef lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa90d500d7b8f2b3e expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789477409.052672:0:5846:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00010000:00010000:0.0:1789477409.052846:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be5a00/0xafddb3c8f9281aef lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2b3e expref: 42 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477409.052867:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9d0d596ae000) 00010000:00010000:0.0:1789477409.052871:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1789477409.052876:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be5a00/0xafddb3c8f9281aef lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2b3e expref: 42 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477409.052896:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d0d50be5a00, rc 0) 00000100:00100000:0.0:1789477409.053015:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d623c9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9bc33f26-0aab-4a14-832f-c58d566de1b0+41:10401:x1876402783684608:12345-192.168.201.23@tcp:101:lfs.0 Request processed in 2269us (3279us total) trans 4294967339 rc 301/301 00000100:00100000:0.0:1789477409.053025:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 56 00000100:00100000:2.0:1789477409.072992:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:0.0:1789477409.073437:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783684864 00000100:00100000:0.0:1789477409.073452:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783684864 00000100:00100000:0.0:1789477409.073534:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 14 00000100:00100000:0.0:1789477409.073549:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d50411180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9bc33f26-0aab-4a14-832f-c58d566de1b0+41:10401:x1876402783684864:12345-192.168.201.23@tcp:35:lfs.0 00000100:00100000:0.0:1789477409.074038:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d50411180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9bc33f26-0aab-4a14-832f-c58d566de1b0+42:10401:x1876402783684864:12345-192.168.201.23@tcp:35:lfs.0 Request processed in 490us (1069us total) trans 4294967340 rc 0/0 00000100:00100000:0.0:1789477409.074048:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 14 00000100:00100000:2.0:1789477409.188514:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:0.0:1789477409.189118:0:6999:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783685120 00000100:00100000:0.0:1789477409.189140:0:6999:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783685120 00000100:00100000:0.0:1789477409.189222:0:6999:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 57 00000100:00100000:0.0:1789477409.189234:0:6999:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d50412680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9bc33f26-0aab-4a14-832f-c58d566de1b0+42:10407:x1876402783685120:12345-192.168.201.23@tcp:101:bash.0 00010000:00010000:0.0:1789477409.189265:0:6999:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789477409.189477:0:6999:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be5a00/0xafddb3c8f9281afd lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa90d500d7b8f2b45 expref: -99 pid: 6999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477409.189900:0:6999:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be4800/0xafddb3c8f9281b04 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477409.189920:0:6999:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49eca600/0xafddb3c8f9281ae8 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2b37 expref: 43 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477409.189931:0:6999:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be4800/0xafddb3c8f9281b04 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477409.191816:0:6999:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49eca600/0xafddb3c8f9281ae8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2b37 expref: 43 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477409.191847:0:6999:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49eca600/0xafddb3c8f9281ae8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2b37 expref: 43 pid: 5845 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789477409.191865:0:6999:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d50413100 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6999:1876402802588160:192.168.201.23@tcp:104: 00000100:00100000:2.0:1789477409.192024:0:6999:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d0d50a28540 going to sleep for 11 seconds 00000100:00100000:1.0:1789477409.199502:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:3.0:1789477409.199995:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783685248 00000100:00100000:3.0:1789477409.200009:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783685248 00010000:00010000:3.0:1789477409.200068:0:5829:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49eca600/0xafddb3c8f9281ae8 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2b37 expref: 44 pid: 5845 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789477409.200135:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 40 00000100:00100000:3.0:1789477409.200149:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d623caa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9bc33f26-0aab-4a14-832f-c58d566de1b0+44:2355:x1876402783685248:12345-192.168.201.23@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789477409.200168:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789477409.200177:0:5829:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49eca600/0xafddb3c8f9281ae8 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2b37 expref: 44 pid: 5845 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477409.200193:0:5829:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49eca600/0xafddb3c8f9281ae8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2b37 expref: 44 pid: 5845 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477409.200235:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9d0d50919f00) 00010000:00010000:3.0:1789477409.200241:0:5829:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be4800/0xafddb3c8f9281b04 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477409.200252:0:5829:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be4800/0xafddb3c8f9281b04 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477409.200260:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be4800/0xafddb3c8f9281b04 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477409.200283:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789477409.200375:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d623caa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9bc33f26-0aab-4a14-832f-c58d566de1b0+44:2355:x1876402783685248:12345-192.168.201.23@tcp:103:ldlm_bl.0 Request processed in 228us (888us total) trans 0 rc 0/0 00000100:00100000:3.0:1789477409.200408:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 40 00010000:00010000:2.0:1789477409.201554:0:6999:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49eca600/0xafddb3c8f9281ae8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2b37 expref: 43 pid: 5845 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789477409.201626:0:6999:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d50413100 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6999:1876402802588160:192.168.201.23@tcp:104: 00010000:00010000:2.0:1789477409.201660:0:6999:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be4800/0xafddb3c8f9281b04 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477409.201671:0:6999:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be4800/0xafddb3c8f9281b04 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477409.201677:0:6999:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be4800/0xafddb3c8f9281b04 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789477409.201891:0:6999:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 1234567 00010000:00010000:2.0:1789477409.204668:0:6999:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be5a00/0xafddb3c8f9281afd lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2b45 expref: 44 pid: 6999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477409.204910:0:6999:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be4800/0xafddb3c8f9281b04 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2b45 expref: 43 pid: 6999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477409.204923:0:6999:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9d0d50919f00) 00010000:00010000:2.0:1789477409.204927:0:6999:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1789477409.204931:0:6999:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d0d50be4800, rc 0) 00000100:00100000:2.0:1789477409.205044:0:6999:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d50412680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9bc33f26-0aab-4a14-832f-c58d566de1b0+43:10407:x1876402783685120:12345-192.168.201.23@tcp:101:bash.0 Request processed in 15810us (16543us total) trans 4294967341 rc 0/0 00000100:00100000:2.0:1789477409.205054:0:6999:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 57 00000100:00100000:1.0:1789477409.213932:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:2.0:1789477409.214103:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783685504 00000100:00100000:2.0:1789477409.214117:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783685504 00000100:00100000:2.0:1789477409.214194:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 58 00000100:00100000:2.0:1789477409.214215:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d623c8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9bc33f26-0aab-4a14-832f-c58d566de1b0+43:10407:x1876402783685504:12345-192.168.201.23@tcp:36:bash.0 00010000:00010000:2.0:1789477409.214649:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d59d6a400/0xafddb3c8f9281b12 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477409.214671:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d59d6a400/0xafddb3c8f9281b12 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477409.214686:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d59d6a400/0xafddb3c8f9281b12 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789477409.214768:0:5844:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967342 00000004:00010000:2.0:1789477409.214797:0:5844:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000006f9817f9 reply state 00000000e3176465 transno 4294967343 ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d59d6a400/0xafddb3c8f9281b12 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789477409.214806:0:5844:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789477409.214934:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d623c8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9bc33f26-0aab-4a14-832f-c58d566de1b0+46:10407:x1876402783685504:12345-192.168.201.23@tcp:36:bash.0 Request processed in 721us (1014us total) trans 4294967343 rc 0/0 00000100:00100000:2.0:1789477409.214942:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 58 00000020:00080000:2.0:1789477409.214948:0:5844:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1789477409.223005:0:3296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d59d6a400/0xafddb3c8f9281b12 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477409.223032:0:3296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d59d6a400/0xafddb3c8f9281b12 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477409.223041:0:3296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d59d6a400/0xafddb3c8f9281b12 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477409.223049:0:3296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d0d59d6a400 already unused, calling callback (ffffffffc1fd54f0) 00010000:00010000:2.0:1789477409.223055:0:3296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d59d6a400/0xafddb3c8f9281b12 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477409.223064:0:3296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d59d6a400/0xafddb3c8f9281b12 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477409.223087:0:3296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9d0d50919f00) 00010000:00010000:2.0:1789477409.223090:0:3296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789477409.223097:0:3296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d59d6a400/0xafddb3c8f9281b12 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477409.223104:0:3296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d59d6a400/0xafddb3c8f9281b12 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789477409.226146:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:3.0:1789477409.226477:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783685632 00000100:00100000:3.0:1789477409.226491:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783685632 00000100:00100000:3.0:1789477409.226570:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 59 00000100:00100000:3.0:1789477409.226614:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d623cb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9bc33f26-0aab-4a14-832f-c58d566de1b0+45:10407:x1876402783685632:12345-192.168.201.23@tcp:101:bash.0 00010000:00010000:3.0:1789477409.226649:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789477409.226676:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49ecbc00/0xafddb3c8f9281b19 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa90d500d7b8f2b4c expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477409.226811:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49ecba00/0xafddb3c8f9281b20 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477409.226830:0:5845:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be4800/0xafddb3c8f9281b04 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2b45 expref: 46 pid: 6999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477409.226839:0:5845:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49ecba00/0xafddb3c8f9281b20 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477409.226887:0:5845:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be4800/0xafddb3c8f9281b04 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2b45 expref: 46 pid: 6999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477409.226902:0:5845:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be4800/0xafddb3c8f9281b04 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2b45 expref: 46 pid: 6999 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789477409.226919:0:5845:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d7bdde680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5845:1876402802588288:192.168.201.23@tcp:104: 00000100:00100000:3.0:1789477409.227030:0:5845:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d0d444806c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789477409.236107:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:2.0:1789477409.236431:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783685760 00000100:00100000:2.0:1789477409.236446:0:6711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783685760 00010000:00010000:2.0:1789477409.236513:0:6711:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be4800/0xafddb3c8f9281b04 lrc: 5/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2b45 expref: 47 pid: 6999 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789477409.236642:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 41 00000100:00100000:2.0:1789477409.236655:0:6711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d7536aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9bc33f26-0aab-4a14-832f-c58d566de1b0+47:2355:x1876402783685760:12345-192.168.201.23@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789477409.236673:0:6711:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789477409.236681:0:6711:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be4800/0xafddb3c8f9281b04 lrc: 5/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2b45 expref: 47 pid: 6999 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477409.236696:0:6711:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be4800/0xafddb3c8f9281b04 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2b45 expref: 47 pid: 6999 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477409.236726:0:6711:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9d0d50919f00) 00010000:00010000:2.0:1789477409.236731:0:6711:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49ecba00/0xafddb3c8f9281b20 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477409.236744:0:6711:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49ecba00/0xafddb3c8f9281b20 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477409.236753:0:6711:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49ecba00/0xafddb3c8f9281b20 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477409.236775:0:6711:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789477409.236847:0:6711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d7536aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9bc33f26-0aab-4a14-832f-c58d566de1b0+47:2355:x1876402783685760:12345-192.168.201.23@tcp:103:ldlm_bl.0 Request processed in 194us (756us total) trans 0 rc 0/0 00000100:00100000:2.0:1789477409.236855:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 41 00010000:00010000:3.0:1789477409.237911:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be4800/0xafddb3c8f9281b04 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2b45 expref: 46 pid: 6999 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789477409.237955:0:5845:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d7bdde680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5845:1876402802588288:192.168.201.23@tcp:104: 00010000:00010000:3.0:1789477409.237983:0:5845:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49ecba00/0xafddb3c8f9281b20 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477409.237993:0:5845:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49ecba00/0xafddb3c8f9281b20 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477409.237999:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49ecba00/0xafddb3c8f9281b20 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789477409.238065:0:5845:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:3.0:1789477409.238070:0:5845:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1789477409.238097:0:5845:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49ecba00/0xafddb3c8f9281b20 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477409.238389:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49ecbc00/0xafddb3c8f9281b19 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2b4c expref: 46 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477409.238414:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49ecba00/0xafddb3c8f9281b20 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2b4c expref: 45 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477409.238424:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9d0d50919f00) 00010000:00010000:3.0:1789477409.238427:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789477409.238431:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d0d49ecba00, rc 0) 00000100:00100000:3.0:1789477409.238513:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d623cb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9bc33f26-0aab-4a14-832f-c58d566de1b0+45:10407:x1876402783685632:12345-192.168.201.23@tcp:101:bash.0 Request processed in 11902us (12392us total) trans 0 rc 0/0 00000100:00100000:3.0:1789477409.239854:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 59 00000100:00100000:2.0:1789477409.251742:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:1.0:1789477409.251842:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783686016 00000100:00100000:1.0:1789477409.251857:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783686016 00000100:00100000:1.0:1789477409.251935:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 15 00000100:00100000:1.0:1789477409.251947:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d5845d850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9bc33f26-0aab-4a14-832f-c58d566de1b0+45:10407:x1876402783686016:12345-192.168.201.23@tcp:35:bash.0 00000100:00100000:1.0:1789477409.252314:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d5845d850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9bc33f26-0aab-4a14-832f-c58d566de1b0+46:10407:x1876402783686016:12345-192.168.201.23@tcp:35:bash.0 Request processed in 368us (588us total) trans 4294967344 rc 0/0 00000100:00100000:1.0:1789477409.252323:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 15 00000100:00100000:1.0:1789477409.379259:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:2.0:1789477409.379721:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783686272 00000100:00100000:2.0:1789477409.379735:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783686272 00000100:00100000:2.0:1789477409.379811:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 60 00000100:00100000:2.0:1789477409.379840:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d623c8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9bc33f26-0aab-4a14-832f-c58d566de1b0+46:10417:x1876402783686272:12345-192.168.201.23@tcp:101:lfs.0 00010000:00010000:2.0:1789477409.379877:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789477409.379912:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d59d6a400/0xafddb3c8f9281b27 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa90d500d7b8f2b53 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789477409.380075:0:5844:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00010000:00010000:2.0:1789477409.380254:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d59d6a400/0xafddb3c8f9281b27 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2b53 expref: 48 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477409.380273:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9d0d596ae000) 00010000:00010000:2.0:1789477409.380276:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789477409.380282:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d59d6a400/0xafddb3c8f9281b27 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2b53 expref: 48 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477409.380300:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d0d59d6a400, rc 0) 00000100:00100000:2.0:1789477409.380406:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d623c8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9bc33f26-0aab-4a14-832f-c58d566de1b0+47:10417:x1876402783686272:12345-192.168.201.23@tcp:101:lfs.0 Request processed in 568us (1161us total) trans 4294967345 rc 301/301 00000100:00100000:2.0:1789477409.380415:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 60 00000100:00100000:3.0:1789477409.386958:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:2.0:1789477409.387073:0:6999:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783686400 00000100:00100000:2.0:1789477409.387091:0:6999:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783686400 00000100:00100000:2.0:1789477409.387189:0:6999:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 61 00000100:00100000:2.0:1789477409.387212:0:6999:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d7bdde680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9bc33f26-0aab-4a14-832f-c58d566de1b0+47:10417:x1876402783686400:12345-192.168.201.23@tcp:34:lfs.0 00010000:00010000:2.0:1789477409.387325:0:6999:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d59d6a400/0xafddb3c8f9281b35 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477409.387348:0:6999:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d59d6a400/0xafddb3c8f9281b35 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477409.387386:0:6999:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d59d6a400/0xafddb3c8f9281b35 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477409.387405:0:6999:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d59d6a800/0xafddb3c8f9281b3c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477409.387412:0:6999:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d59d6a800/0xafddb3c8f9281b3c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477409.387418:0:6999:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d59d6a800/0xafddb3c8f9281b3c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477409.387600:0:6999:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d59d6be00/0xafddb3c8f9281b43 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477409.387612:0:6999:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d59d6be00/0xafddb3c8f9281b43 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477409.387618:0:6999:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d59d6be00/0xafddb3c8f9281b43 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789477409.387675:0:6999:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d59d6be00/0xafddb3c8f9281b43 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477409.387690:0:6999:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d59d6a400/0xafddb3c8f9281b35 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477409.387698:0:6999:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d59d6a400/0xafddb3c8f9281b35 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477409.387706:0:6999:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d59d6a400/0xafddb3c8f9281b35 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477409.387724:0:6999:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d0d59d6a400 already unused, calling callback (ffffffffc1fd54f0) 00010000:00010000:2.0:1789477409.387729:0:6999:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d59d6a400/0xafddb3c8f9281b35 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477409.387737:0:6999:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d59d6a400/0xafddb3c8f9281b35 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477409.387752:0:6999:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9d0d5b9f4000) 00010000:00010000:2.0:1789477409.387757:0:6999:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789477409.387764:0:6999:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d59d6a400/0xafddb3c8f9281b35 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477409.387770:0:6999:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d59d6a400/0xafddb3c8f9281b35 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477409.387785:0:6999:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d59d6a800/0xafddb3c8f9281b3c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477409.387792:0:6999:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d59d6a800/0xafddb3c8f9281b3c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477409.387799:0:6999:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d59d6a800/0xafddb3c8f9281b3c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477409.387804:0:6999:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d0d59d6a800 already unused, calling callback (ffffffffc1fd54f0) 00010000:00010000:2.0:1789477409.387807:0:6999:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d59d6a800/0xafddb3c8f9281b3c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477409.387814:0:6999:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d59d6a800/0xafddb3c8f9281b3c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477409.387832:0:6999:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9d0d50919d00) 00010000:00010000:2.0:1789477409.387835:0:6999:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789477409.387838:0:6999:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d59d6a800/0xafddb3c8f9281b3c lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477409.387844:0:6999:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d59d6a800/0xafddb3c8f9281b3c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477409.387863:0:6999:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d59d6be00/0xafddb3c8f9281b43 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477409.387869:0:6999:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d59d6be00/0xafddb3c8f9281b43 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477409.387875:0:6999:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d59d6be00/0xafddb3c8f9281b43 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477409.387880:0:6999:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d0d59d6be00 already unused, calling callback (ffffffffc1fd54f0) 00010000:00010000:2.0:1789477409.387884:0:6999:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d59d6be00/0xafddb3c8f9281b43 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477409.387890:0:6999:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d59d6be00/0xafddb3c8f9281b43 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477409.387897:0:6999:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9d0d50919f00) 00010000:00010000:2.0:1789477409.387899:0:6999:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789477409.387902:0:6999:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d59d6be00/0xafddb3c8f9281b43 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477409.387907:0:6999:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d59d6be00/0xafddb3c8f9281b43 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789477409.388022:0:6999:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d7bdde680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9bc33f26-0aab-4a14-832f-c58d566de1b0+47:10417:x1876402783686400:12345-192.168.201.23@tcp:34:lfs.0 Request processed in 821us (1079us total) trans 0 rc 0/0 00000100:00100000:2.0:1789477409.388031:0:6999:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 61 00000100:00100000:3.0:1789477409.393377:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:1.0:1789477409.393752:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783686656 00000100:00100000:1.0:1789477409.393765:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783686656 00000100:00100000:1.0:1789477409.394080:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 16 00000100:00100000:1.0:1789477409.394095:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d74cd9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9bc33f26-0aab-4a14-832f-c58d566de1b0+47:10417:x1876402783686656:12345-192.168.201.23@tcp:35:lfs.0 00000100:00100000:1.0:1789477409.394499:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d74cd9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9bc33f26-0aab-4a14-832f-c58d566de1b0+48:10417:x1876402783686656:12345-192.168.201.23@tcp:35:lfs.0 Request processed in 406us (1136us total) trans 4294967346 rc 0/0 00000100:00100000:1.0:1789477409.394509:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 16 00000100:00100000:1.0:1789477409.448373:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:2.0:1789477409.448810:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783686912 00000100:00100000:2.0:1789477409.448826:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783686912 00000100:00100000:2.0:1789477409.449046:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 62 00000100:00100000:2.0:1789477409.449062:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d623c8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9bc33f26-0aab-4a14-832f-c58d566de1b0+48:10420:x1876402783686912:12345-192.168.201.23@tcp:101:lfs.0 00010000:00010000:2.0:1789477409.449097:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789477409.449203:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d59d6be00/0xafddb3c8f9281b4a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa90d500d7b8f2b5a expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477409.449315:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d59d6a800/0xafddb3c8f9281b51 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477409.449334:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d59d6a800/0xafddb3c8f9281b51 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477409.449348:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d59d6a800/0xafddb3c8f9281b51 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477409.449366:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d59d6a400/0xafddb3c8f9281b58 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477409.449373:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d59d6a400/0xafddb3c8f9281b58 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477409.449380:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d59d6a400/0xafddb3c8f9281b58 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477409.451079:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d59d6b600/0xafddb3c8f9281b5f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477409.451102:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d59d6b600/0xafddb3c8f9281b5f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477409.451256:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d59d6b600/0xafddb3c8f9281b5f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789477409.451274:0:5844:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:3.0:1789477409.451614:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d59d6a800/0xafddb3c8f9281b51 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477409.451623:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d59d6a800/0xafddb3c8f9281b51 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477409.451631:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d59d6a800/0xafddb3c8f9281b51 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477409.451637:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d0d59d6a800 already unused, calling callback (ffffffffc1fd54f0) 00010000:00010000:3.0:1789477409.451642:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d59d6a800/0xafddb3c8f9281b51 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477409.451651:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d59d6a800/0xafddb3c8f9281b51 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477409.451666:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9d0d5b9f4000) 00010000:00010000:3.0:1789477409.451669:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789477409.451673:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d59d6a800/0xafddb3c8f9281b51 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477409.451680:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d59d6a800/0xafddb3c8f9281b51 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477409.451805:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d59d6a400/0xafddb3c8f9281b58 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477409.451812:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d59d6a400/0xafddb3c8f9281b58 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477409.451819:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d59d6a400/0xafddb3c8f9281b58 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477409.451841:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d0d59d6a400 already unused, calling callback (ffffffffc1fd54f0) 00010000:00010000:3.0:1789477409.451845:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d59d6a400/0xafddb3c8f9281b58 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477409.451852:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d59d6a400/0xafddb3c8f9281b58 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477409.451860:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9d0d50919d00) 00010000:00010000:3.0:1789477409.451863:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789477409.451866:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d59d6a400/0xafddb3c8f9281b58 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477409.451872:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d59d6a400/0xafddb3c8f9281b58 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477409.452097:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d59d6be00/0xafddb3c8f9281b4a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2b5a expref: 51 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477409.452186:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d59d6b600/0xafddb3c8f9281b5f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2b5a expref: 50 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477409.452204:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9d0d50919f00) 00010000:00010000:3.0:1789477409.452207:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789477409.452210:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d0d59d6b600, rc 0) 00000100:00100000:3.0:1789477409.452314:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d623c8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9bc33f26-0aab-4a14-832f-c58d566de1b0+50:10420:x1876402783686912:12345-192.168.201.23@tcp:101:lfs.0 Request processed in 3255us (3957us total) trans 4294967347 rc 0/0 00000100:00100000:3.0:1789477409.452324:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 62 00010000:00010000:3.0:1789477409.456476:0:6710:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789477409.457510:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:3.0:1789477409.457574:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:1.0:1789477409.457693:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783687168 00000100:00100000:1.0:1789477409.457716:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783687168 00000100:00100000:1.0:1789477409.457808:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 4 00000100:00100000:1.0:1789477409.457823:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d50b04700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9bc33f26-0aab-4a14-832f-c58d566de1b0+50:2354:x1876402783687168:12345-192.168.201.23@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789477409.457843:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789477409.457875:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d59d6b600/0xafddb3c8f9281b5f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2b5a expref: 50 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477409.457901:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9d0d50919f00) 00010000:00010000:1.0:1789477409.457907:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789477409.458126:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d50b04700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9bc33f26-0aab-4a14-832f-c58d566de1b0+49:2354:x1876402783687168:12345-192.168.201.23@tcp:103:ldlm_bl.0 Request processed in 294us (538us total) trans 0 rc 0/0 00000100:00100000:1.0:1789477409.458136:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 4 00000100:00100000:2.0:1789477409.458714:0:6999:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783687040 00000100:00100000:2.0:1789477409.458724:0:6999:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783687040 00000100:00100000:2.0:1789477409.458777:0:6999:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 63 00000100:00100000:2.0:1789477409.458786:0:6999:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d50b04e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9bc33f26-0aab-4a14-832f-c58d566de1b0+49:10420:x1876402783687040:12345-192.168.201.23@tcp:54:lfs.0 00010000:00010000:2.0:1789477409.458869:0:6999:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d41646a00/0xafddb3c8f9281b6d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477409.458888:0:6999:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d41646a00/0xafddb3c8f9281b6d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477409.458911:0:6999:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d41646a00/0xafddb3c8f9281b6d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477409.458949:0:6999:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d41646a00/0xafddb3c8f9281b6d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477409.458957:0:6999:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d41646a00/0xafddb3c8f9281b6d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477409.458965:0:6999:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d41646a00/0xafddb3c8f9281b6d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477409.459173:0:6999:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d0d41646a00 already unused, calling callback (ffffffffc1fd54f0) 00010000:00010000:2.0:1789477409.459179:0:6999:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d41646a00/0xafddb3c8f9281b6d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477409.459187:0:6999:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d41646a00/0xafddb3c8f9281b6d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477409.459209:0:6999:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9d0d50919f00) 00010000:00010000:2.0:1789477409.459213:0:6999:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789477409.459218:0:6999:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d41646a00/0xafddb3c8f9281b6d lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477409.459224:0:6999:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d41646a00/0xafddb3c8f9281b6d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789477409.459295:0:6999:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d50b04e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9bc33f26-0aab-4a14-832f-c58d566de1b0+49:10420:x1876402783687040:12345-192.168.201.23@tcp:54:lfs.0 Request processed in 509us (1795us total) trans 0 rc 0/0 00000100:00100000:2.0:1789477409.459303:0:6999:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 63 00000100:00100000:3.0:1789477409.463838:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:2.0:1789477409.464449:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783687424 00000100:00100000:2.0:1789477409.464465:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783687424 00000100:00100000:2.0:1789477409.464559:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 17 00000100:00100000:2.0:1789477409.464572:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d50b07800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9bc33f26-0aab-4a14-832f-c58d566de1b0+49:10420:x1876402783687424:12345-192.168.201.23@tcp:35:lfs.0 00000100:00100000:2.0:1789477409.465264:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d50b07800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9bc33f26-0aab-4a14-832f-c58d566de1b0+50:10420:x1876402783687424:12345-192.168.201.23@tcp:35:lfs.0 Request processed in 692us (1441us total) trans 4294967348 rc 0/0 00000100:00100000:2.0:1789477409.465274:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 17 00000100:00100000:2.0:1789477409.646544:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:1.0:1789477409.647300:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783687680 00000100:00100000:1.0:1789477409.647316:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783687680 00000100:00100000:1.0:1789477409.647404:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 64 00000100:00100000:1.0:1789477409.647417:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d50413100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9bc33f26-0aab-4a14-832f-c58d566de1b0+50:10438:x1876402783687680:12345-192.168.201.23@tcp:101:cat.0 00010000:00010000:1.0:1789477409.647454:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789477409.647486:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f519400/0xafddb3c8f9281b74 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa90d500d7b8f2b61 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477409.647721:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f518e00/0xafddb3c8f9281b7b lrc: 3/1,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477409.647740:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f518e00/0xafddb3c8f9281b7b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477409.647757:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f518e00/0xafddb3c8f9281b7b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789477409.647771:0:5846:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:1.0:1789477409.647966:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f519400/0xafddb3c8f9281b74 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2b61 expref: 53 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477409.648412:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f518e00/0xafddb3c8f9281b7b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2b61 expref: 52 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477409.648425:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9d0d50919f00) 00010000:00010000:1.0:1789477409.648428:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1789477409.648454:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d0d7f518e00, rc 0) 00000100:00100000:1.0:1789477409.648741:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d50413100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9bc33f26-0aab-4a14-832f-c58d566de1b0+52:10438:x1876402783687680:12345-192.168.201.23@tcp:101:cat.0 Request processed in 1324us (2222us total) trans 4294967349 rc 0/0 00000100:00100000:1.0:1789477409.648755:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 64 00000100:00100000:1.0:1789477409.686418:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:2.0:1789477409.686637:0:6999:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783687808 00000100:00100000:2.0:1789477409.686651:0:6999:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783687808 00000100:00100000:2.0:1789477409.686802:0:6999:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 65 00000100:00100000:2.0:1789477409.686814:0:6999:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d623c9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9bc33f26-0aab-4a14-832f-c58d566de1b0+52:10439:x1876402783687808:12345-192.168.201.23@tcp:101:lfs.0 00010000:00010000:2.0:1789477409.686846:0:6999:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789477409.686874:0:6999:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d41646a00/0xafddb3c8f9281b89 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa90d500d7b8f2b68 expref: -99 pid: 6999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477409.689452:0:6999:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d41647000/0xafddb3c8f9281b90 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477409.689486:0:6999:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d41647000/0xafddb3c8f9281b90 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477409.689504:0:6999:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d41647000/0xafddb3c8f9281b90 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789477409.689635:0:6999:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00000004:00200000:2.0:1789477409.689640:0:6999:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:2.0:1789477409.689672:0:6999:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d41647000/0xafddb3c8f9281b90 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477409.689736:0:6999:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d41646a00/0xafddb3c8f9281b89 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2b68 expref: 54 pid: 6999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477409.689767:0:6999:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d41647000/0xafddb3c8f9281b90 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2b68 expref: 53 pid: 6999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477409.689779:0:6999:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9d0d5b9f4000) 00010000:00010000:2.0:1789477409.689783:0:6999:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789477409.689787:0:6999:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d0d41647000, rc 0) 00000100:00100000:2.0:1789477409.689886:0:6999:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d623c9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9bc33f26-0aab-4a14-832f-c58d566de1b0+53:10439:x1876402783687808:12345-192.168.201.23@tcp:101:lfs.0 Request processed in 3072us (3484us total) trans 0 rc 0/0 00000100:00100000:2.0:1789477409.689930:0:6999:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 65 00000100:00100000:3.0:1789477409.712165:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d50b07100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3313:1876402802588672:0@lo:400:kworker.0 00000100:00100000:3.0:1789477409.712277:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789477409.712347:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d74aa8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1876402802589184:0@lo:400:kworker.0 00000100:00100000:3.0:1789477409.712389:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789477409.712657:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d4e643480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1876402802588800:0@lo:400:kworker.0 00000100:00100000:2.0:1789477409.712968:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d7536b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1876402802588416:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789477409.718559:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d74aa9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3311:1876402802588928:0@lo:400:kworker.0 00000100:00100000:3.0:1789477409.721095:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802588672 00000100:00100000:3.0:1789477409.721418:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802588672 00000100:00100000:2.0:1789477409.721776:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789477409.721853:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d50b05180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:07d5e05c-913f-419f-adbc-d3cf15e9cd51:3312:1876402802588544:0@lo:400:kworker.0 00000100:00100000:3.0:1789477409.721959:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:3.0:1789477409.722786:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d74aa9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1876402802588672:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789477409.723215:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789477409.723264:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d74aaad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3312:1876402802589056:0@lo:400:kworker.0 00000100:00100000:2.0:1789477409.723305:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789477409.723452:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789477409.724225:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d74aa9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1876402802588672:12345-0@lo:400:kworker.0 Request processed in 920us (10611us total) trans 0 rc 0/0 00000100:00100000:3.0:1789477409.724242:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:3.0:1789477409.724282:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802589056 00000100:00100000:3.0:1789477409.724292:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802589056 00000100:00100000:3.0:1789477409.724819:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:3.0:1789477409.724832:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d50412a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1876402802589056:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789477409.724951:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d50412a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1876402802589056:12345-0@lo:400:kworker.0 Request processed in 123us (1645us total) trans 0 rc 0/0 00000100:00100000:3.0:1789477409.724959:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:2.0:1789477409.725176:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802588544 00000100:00100000:2.0:1789477409.725183:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802588544 00000100:00100000:2.0:1789477409.725234:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 288 00000100:00100000:2.0:1789477409.725244:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d44523450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07d5e05c-913f-419f-adbc-d3cf15e9cd51+19:3312:x1876402802588544:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789477409.725326:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d44523450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07d5e05c-913f-419f-adbc-d3cf15e9cd51+19:3312:x1876402802588544:12345-0@lo:400:kworker.0 Request processed in 85us (2111us total) trans 0 rc 0/0 00000100:00100000:2.0:1789477409.725334:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 288 00000100:00100000:2.0:1789477409.725413:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802588416 00000100:00100000:2.0:1789477409.725419:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802588416 00000100:00100000:2.0:1789477409.725458:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1789477409.725465:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d50411c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1876402802588416:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789477409.725503:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789477409.725549:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d50411c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1876402802588416:12345-0@lo:13:osp-pre-1-0.0 Request processed in 85us (3777us total) trans 0 rc 0/0 00000100:00100000:2.0:1789477409.725556:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1789477409.725634:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d7536b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1876402802588416:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789477409.725646:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d50b05180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:07d5e05c-913f-419f-adbc-d3cf15e9cd51:3312:1876402802588544:0@lo:400:kworker.0 00000100:00100000:2.0:1789477409.725669:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d74aaad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3312:1876402802589056:0@lo:400:kworker.0 00000100:00100000:0.0:1789477409.728490:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789477409.740346:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802589184 00000100:00100000:0.0:1789477409.740373:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802589184 00000100:00100000:0.0:1789477409.740466:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802588800 00000100:00100000:0.0:1789477409.740470:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802588800 00000100:00100000:0.0:1789477409.740758:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1789477409.740772:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d74aaa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3313:x1876402802589184:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789477409.740899:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d74aaa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3313:x1876402802589184:12345-0@lo:400:kworker.0 Request processed in 130us (28508us total) trans 0 rc 0/0 00000100:00100000:0.0:1789477409.740908:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1789477409.740928:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1789477409.740935:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d623cb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3310:x1876402802588800:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789477409.740967:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d623cb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3310:x1876402802588800:12345-0@lo:400:kworker.0 Request processed in 33us (18457us total) trans 0 rc 0/0 00000100:00100000:1.0:1789477409.741571:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802588928 00000100:00100000:1.0:1789477409.741592:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802588928 00000100:00100000:0.0:1789477409.741613:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1789477409.741652:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:1.0:1789477409.741659:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d75368700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1876402802588928:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789477409.741734:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d4e643480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1876402802588800:0@lo:400:kworker.0 00000100:00100000:1.0:1789477409.741736:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d75368700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1876402802588928:12345-0@lo:400:kworker.0 Request processed in 79us (13260us total) trans 0 rc 0/0 00000100:00100000:1.0:1789477409.741742:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:1.0:1789477409.741778:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d74aa9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3311:1876402802588928:0@lo:400:kworker.0 00000100:00100000:0.0:1789477409.741818:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d50b07100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3313:1876402802588672:0@lo:400:kworker.0 00000100:00100000:0.0:1789477409.741832:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d74aa8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1876402802589184:0@lo:400:kworker.0 00000100:00100000:0.0:1789477409.741903:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:1.0:1789477409.741978:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783688192 00000100:00100000:1.0:1789477409.741983:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783688192 00000100:00100000:1.0:1789477409.742014:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 18 00000100:00100000:1.0:1789477409.742020:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d7536b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9bc33f26-0aab-4a14-832f-c58d566de1b0+53:10439:x1876402783688192:12345-192.168.201.23@tcp:35:lfs.0 00000100:00080000:0.0:1789477409.742079:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789477409.742085:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789477409.742088:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789477409.742426:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d7536b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9bc33f26-0aab-4a14-832f-c58d566de1b0+54:10439:x1876402783688192:12345-192.168.201.23@tcp:35:lfs.0 Request processed in 404us (524us total) trans 4294967350 rc 0/0 00000100:00100000:1.0:1789477409.742433:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 18 00000100:00100000:0.0:1789477409.751984:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:2.0:1789477409.754503:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783688320 00000100:00100000:2.0:1789477409.754540:0:6711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783688320 00000100:00100000:2.0:1789477409.754665:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 5 00000100:00100000:2.0:1789477409.754680:0:6711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d4e643480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9bc33f26-0aab-4a14-832f-c58d566de1b0+54:10439:x1876402783688320:12345-192.168.201.23@tcp:103:lfs.0 00010000:00010000:2.0:1789477409.754826:0:6711:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1789477409.754862:0:6711:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49ecba00/0xafddb3c8f9281b20 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2b4c expref: 54 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477409.754933:0:6711:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f518e00/0xafddb3c8f9281b7b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2b61 expref: 53 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477409.754948:0:6711:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d59d6b400/0xafddb3c8f9281a2b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2b0d expref: 52 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477409.754961:0:6711:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9d0d50919f00) 00010000:00010000:2.0:1789477409.754975:0:6711:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789477409.755075:0:6711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d4e643480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9bc33f26-0aab-4a14-832f-c58d566de1b0+51:10439:x1876402783688320:12345-192.168.201.23@tcp:103:lfs.0 Request processed in 397us (3117us total) trans 0 rc 0/0 00000100:00100000:2.0:1789477409.755084:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 5 00000100:00100000:1.0:1789477409.758380:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:2.0:1789477409.758825:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783688448 00000100:00100000:2.0:1789477409.758839:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783688448 00000100:00100000:2.0:1789477409.758996:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 66 00000100:00100000:2.0:1789477409.759011:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d623c8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9bc33f26-0aab-4a14-832f-c58d566de1b0+51:10439:x1876402783688448:12345-192.168.201.23@tcp:58:lfs.0 00010000:00010000:2.0:1789477409.759211:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d41646a00/0xafddb3c8f9281b97 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477409.759243:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d41646a00/0xafddb3c8f9281b97 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477409.759259:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d41646a00/0xafddb3c8f9281b97 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1789477409.762504:0:5846:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789477409.769377:0:5846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 64 off8256 00000040:00080000:3.0:1789477409.769483:0:5846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1, 136 off8328 00000100:00100000:3.0:1789477409.772292:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d623c8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9bc33f26-0aab-4a14-832f-c58d566de1b0+51:10439:x1876402783688448:12345-192.168.201.23@tcp:58:lfs.0 Request processed in 13268us (13926us total) trans 0 rc 0/0 00000100:00100000:3.0:1789477409.772314:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 66 00000100:00100000:3.0:1789477409.840712:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:0.0:1789477409.840833:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783688576 00000100:00100000:0.0:1789477409.840847:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783688576 00000100:00100000:0.0:1789477409.840929:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 67 00000100:00100000:0.0:1789477409.840941:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d74aab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9bc33f26-0aab-4a14-832f-c58d566de1b0+51:10441:x1876402783688576:12345-192.168.201.23@tcp:101:lfs.0 00010000:00010000:0.0:1789477409.840967:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789477409.841008:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be4600/0xafddb3c8f9281b9e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa90d500d7b8f2b6f expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477409.841110:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be5200/0xafddb3c8f9281ba5 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477409.841128:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be5200/0xafddb3c8f9281ba5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477409.841144:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be5200/0xafddb3c8f9281ba5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477409.841163:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be5600/0xafddb3c8f9281bac lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477409.841170:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be5600/0xafddb3c8f9281bac lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477409.841207:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be5600/0xafddb3c8f9281bac lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477409.841337:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be4200/0xafddb3c8f9281bb3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477409.841346:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be4200/0xafddb3c8f9281bb3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477409.841354:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be4200/0xafddb3c8f9281bb3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789477409.841399:0:5844:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:0.0:1789477409.841404:0:5844:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1789477409.841427:0:5844:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be4200/0xafddb3c8f9281bb3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477409.841442:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be4200/0xafddb3c8f9281bb3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477409.841452:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be5200/0xafddb3c8f9281ba5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477409.841459:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be5200/0xafddb3c8f9281ba5 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477409.841466:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be5200/0xafddb3c8f9281ba5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477409.841473:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d0d50be5200 already unused, calling callback (ffffffffc1fd54f0) 00010000:00010000:0.0:1789477409.841479:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be5200/0xafddb3c8f9281ba5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477409.841496:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be5200/0xafddb3c8f9281ba5 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477409.841513:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9d0d5b9f4000) 00010000:00010000:0.0:1789477409.841516:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789477409.841521:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be5200/0xafddb3c8f9281ba5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477409.841527:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be5200/0xafddb3c8f9281ba5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477409.841543:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be5600/0xafddb3c8f9281bac lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477409.841550:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be5600/0xafddb3c8f9281bac lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477409.841557:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be5600/0xafddb3c8f9281bac lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477409.841563:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d0d50be5600 already unused, calling callback (ffffffffc1fd54f0) 00010000:00010000:0.0:1789477409.841566:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be5600/0xafddb3c8f9281bac lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477409.841573:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be5600/0xafddb3c8f9281bac lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477409.845387:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9d0d596aed00) 00010000:00010000:0.0:1789477409.845394:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789477409.845404:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be5600/0xafddb3c8f9281bac lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477409.845451:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be5600/0xafddb3c8f9281bac lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477409.845548:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be4600/0xafddb3c8f9281b9e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2b6f expref: 53 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477409.845566:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be4200/0xafddb3c8f9281bb3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2b6f expref: 52 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477409.845574:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9d0d50919900) 00010000:00010000:0.0:1789477409.845607:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789477409.845611:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d0d50be4200, rc 0) 00000100:00100000:3.0:1789477409.846292:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d74aab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9bc33f26-0aab-4a14-832f-c58d566de1b0+52:10441:x1876402783688576:12345-192.168.201.23@tcp:101:lfs.0 Request processed in 5348us (5597us total) trans 0 rc 0/0 00000100:00100000:3.0:1789477409.846304:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 67 00000040:00080000:2.0:1789477410.031974:0:11717:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1789477410.031992:0:11717:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1789477410.032069:0:11717:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:2.0:1789477410.032077:0:11717:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1789477410.032264:0:11717:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d50410380 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11717:1876402802589312:192.168.201.23@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1789477410.032415:0:11717:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d0d50c3d240 going to sleep for 11 seconds 00000100:00100000:3.0:1789477410.036773:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:0.0:1789477410.037182:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783688704 00000100:00100000:0.0:1789477410.037205:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783688704 00000100:00100000:0.0:1789477410.037291:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 1 00000100:00100000:0.0:1789477410.037305:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d74aa9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:9bc33f26-0aab-4a14-832f-c58d566de1b0+53:10452:x1876402783688704:12345-192.168.201.23@tcp:900:lhsmtool_posix.0 00000100:00100000:0.0:1789477410.037420:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d74aa9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:9bc33f26-0aab-4a14-832f-c58d566de1b0+53:10452:x1876402783688704:12345-192.168.201.23@tcp:900:lhsmtool_posix.0 Request processed in 118us (661us total) trans 0 rc 0/0 00000100:00100000:0.0:1789477410.037429:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 1 00000100:00080000:1.0:1789477410.037828:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789477410.038572:0:11717:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d50410380 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11717:1876402802589312:192.168.201.23@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1789477410.055275:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:3.0:1789477410.055433:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783688832 00000100:00100000:3.0:1789477410.055447:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783688832 00000100:00100000:3.0:1789477410.055534:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 68 00000100:00100000:3.0:1789477410.055548:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d50410380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9bc33f26-0aab-4a14-832f-c58d566de1b0+52:10452:x1876402783688832:12345-192.168.201.23@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1789477410.055616:0:5845:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1789477410.055819:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d50410380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9bc33f26-0aab-4a14-832f-c58d566de1b0+52:10452:x1876402783688832:12345-192.168.201.23@tcp:53:lhsmtool_posix.0 Request processed in 274us (559us total) trans 0 rc 0/0 00000100:00100000:3.0:1789477410.055828:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 68 00000100:00100000:0.0:1789477410.062948:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:3.0:1789477410.063668:0:6999:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783688960 00000100:00100000:3.0:1789477410.063685:0:6999:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783688960 00000100:00100000:3.0:1789477410.063769:0:6999:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 69 00000100:00100000:3.0:1789477410.063783:0:6999:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d58245880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9bc33f26-0aab-4a14-832f-c58d566de1b0+52:10452:x1876402783688960:12345-192.168.201.23@tcp:34:lhsmtool_posix.0 00010000:00010000:3.0:1789477410.063918:0:6999:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49ecb200/0xafddb3c8f9281bba lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477410.063942:0:6999:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49ecb200/0xafddb3c8f9281bba lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477410.064151:0:6999:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49ecb200/0xafddb3c8f9281bba lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477410.064182:0:6999:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49ecbc00/0xafddb3c8f9281bc1 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477410.064228:0:6999:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49ecbc00/0xafddb3c8f9281bc1 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477410.064236:0:6999:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49ecbc00/0xafddb3c8f9281bc1 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477410.064283:0:6999:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49eca000/0xafddb3c8f9281bc8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477410.064293:0:6999:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49eca000/0xafddb3c8f9281bc8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477410.064299:0:6999:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49eca000/0xafddb3c8f9281bc8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789477410.064357:0:6999:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:3.0:1789477410.064363:0:6999:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1789477410.064381:0:6999:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49eca000/0xafddb3c8f9281bc8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477410.064395:0:6999:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49ecb200/0xafddb3c8f9281bba lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477410.064402:0:6999:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49ecb200/0xafddb3c8f9281bba lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477410.064411:0:6999:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49ecb200/0xafddb3c8f9281bba lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477410.064418:0:6999:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d0d49ecb200 already unused, calling callback (ffffffffc1fd54f0) 00010000:00010000:3.0:1789477410.064424:0:6999:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49ecb200/0xafddb3c8f9281bba lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477410.064440:0:6999:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49ecb200/0xafddb3c8f9281bba lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477410.064456:0:6999:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9d0d48f9be00) 00010000:00010000:3.0:1789477410.064459:0:6999:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789477410.064465:0:6999:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49ecb200/0xafddb3c8f9281bba lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477410.064470:0:6999:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49ecb200/0xafddb3c8f9281bba lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477410.064494:0:6999:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49ecbc00/0xafddb3c8f9281bc1 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477410.064501:0:6999:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49ecbc00/0xafddb3c8f9281bc1 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477410.066771:0:6999:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49ecbc00/0xafddb3c8f9281bc1 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477410.066789:0:6999:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d0d49ecbc00 already unused, calling callback (ffffffffc1fd54f0) 00010000:00010000:3.0:1789477410.066794:0:6999:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49ecbc00/0xafddb3c8f9281bc1 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477410.066806:0:6999:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49ecbc00/0xafddb3c8f9281bc1 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477410.066827:0:6999:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x3c15db59 (ffff9d0d44568800) 00010000:00010000:3.0:1789477410.066830:0:6999:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789477410.066835:0:6999:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49ecbc00/0xafddb3c8f9281bc1 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477410.066860:0:6999:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49ecbc00/0xafddb3c8f9281bc1 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477410.066911:0:6999:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49eca000/0xafddb3c8f9281bc8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477410.066920:0:6999:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49eca000/0xafddb3c8f9281bc8 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477410.066926:0:6999:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49eca000/0xafddb3c8f9281bc8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477410.066932:0:6999:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d0d49eca000 already unused, calling callback (ffffffffc1fd54f0) 00010000:00010000:3.0:1789477410.066935:0:6999:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49eca000/0xafddb3c8f9281bc8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477410.066941:0:6999:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49eca000/0xafddb3c8f9281bc8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477410.066950:0:6999:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9d0d50919900) 00010000:00010000:3.0:1789477410.066953:0:6999:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789477410.066956:0:6999:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49eca000/0xafddb3c8f9281bc8 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477410.067436:0:6999:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49eca000/0xafddb3c8f9281bc8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789477410.067737:0:6999:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d58245880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9bc33f26-0aab-4a14-832f-c58d566de1b0+52:10452:x1876402783688960:12345-192.168.201.23@tcp:34:lhsmtool_posix.0 Request processed in 3947us (4798us total) trans 0 rc 0/0 00000100:00100000:3.0:1789477410.067751:0:6999:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 69 00000100:00100000:3.0:1789477410.075727:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:0.0:1789477410.075903:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783689216 00000100:00100000:0.0:1789477410.075918:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783689216 00000100:00100000:0.0:1789477410.076009:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 70 00000100:00100000:0.0:1789477410.076023:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d74aaaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9bc33f26-0aab-4a14-832f-c58d566de1b0+52:10452:x1876402783689216:12345-192.168.201.23@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789477410.076052:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789477410.076080:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be5200/0xafddb3c8f9281bcf lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa90d500d7b8f2b76 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477410.076274:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be4800/0xafddb3c8f9281bd6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477410.076295:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be4800/0xafddb3c8f9281bd6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477410.076311:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be4800/0xafddb3c8f9281bd6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789477410.076325:0:5845:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:0.0:1789477410.076480:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be4800/0xafddb3c8f9281bd6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477410.076490:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be4800/0xafddb3c8f9281bd6 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477410.076498:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be4800/0xafddb3c8f9281bd6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477410.076505:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d0d50be4800 already unused, calling callback (ffffffffc1fd54f0) 00010000:00010000:0.0:1789477410.076510:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be4800/0xafddb3c8f9281bd6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477410.076520:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be4800/0xafddb3c8f9281bd6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477410.076536:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9d0d50919900) 00010000:00010000:0.0:1789477410.076539:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789477410.076546:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be4800/0xafddb3c8f9281bd6 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477410.076566:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be4800/0xafddb3c8f9281bd6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477410.076652:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be5200/0xafddb3c8f9281bcf lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2b76 expref: 54 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477410.076664:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9d0d48f9be00) 00010000:00010000:0.0:1789477410.076666:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1789477410.076670:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be5200/0xafddb3c8f9281bcf lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2b76 expref: 54 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477410.076680:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d0d50be5200, rc 0) 00000100:00100000:0.0:1789477410.076773:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d74aaaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9bc33f26-0aab-4a14-832f-c58d566de1b0+53:10452:x1876402783689216:12345-192.168.201.23@tcp:101:lhsmtool_posix.0 Request processed in 753us (1061us total) trans 4294967351 rc 301/301 00000100:00100000:0.0:1789477410.076781:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 70 00000100:00100000:3.0:1789477410.084413:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:0.0:1789477410.084525:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783689344 00000100:00100000:0.0:1789477410.084540:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783689344 00000100:00100000:0.0:1789477410.084644:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 71 00000100:00100000:0.0:1789477410.084658:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d74aa8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9bc33f26-0aab-4a14-832f-c58d566de1b0+53:10452:x1876402783689344:12345-192.168.201.23@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1789477410.084747:0:5844:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1789477410.084911:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d74aa8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9bc33f26-0aab-4a14-832f-c58d566de1b0+53:10452:x1876402783689344:12345-192.168.201.23@tcp:53:lhsmtool_posix.0 Request processed in 255us (517us total) trans 0 rc 0/0 00000100:00100000:0.0:1789477410.084920:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 71 00000100:00100000:0.0:1789477410.095305:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:1.0:1789477410.095428:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783689600 00000100:00100000:1.0:1789477410.095447:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783689600 00000100:00100000:1.0:1789477410.095569:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 72 00000100:00100000:1.0:1789477410.095622:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d58244000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9bc33f26-0aab-4a14-832f-c58d566de1b0+53:10452:x1876402783689600:12345-192.168.201.23@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789477410.095654:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789477410.095660:0:5845:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1789477410.095714:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d41647000/0xafddb3c8f9281b90 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2b68 expref: 53 pid: 6999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477410.095741:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9d0d5b9f4000) 00010000:00010000:1.0:1789477410.095747:0:5845:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789477410.095767:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f518000/0xafddb3c8f9281be4 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa90d500d7b8f2b7d expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1789477410.097890:0:5845:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x3:0x0], index 1: 0 00010000:00010000:0.0:1789477410.098265:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be5200/0xafddb3c8f9281beb lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477410.098304:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be5200/0xafddb3c8f9281beb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477410.098319:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be5200/0xafddb3c8f9281beb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477410.098427:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f518000/0xafddb3c8f9281be4 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2b7d expref: 55 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477410.099053:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be5200/0xafddb3c8f9281beb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2b7d expref: 54 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477410.099066:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9d0d596aed00) 00010000:00010000:0.0:1789477410.099069:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789477410.099074:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d0d50be5200, rc 0) 00000100:00100000:0.0:1789477410.099182:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d58244000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9bc33f26-0aab-4a14-832f-c58d566de1b0+54:10452:x1876402783689600:12345-192.168.201.23@tcp:101:lhsmtool_posix.0 Request processed in 3561us (3893us total) trans 4294967352 rc 0/0 00000100:00100000:0.0:1789477410.099204:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 72 00000100:00100000:2.0:1789477410.107905:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:3.0:1789477410.108088:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783689856 00000100:00100000:3.0:1789477410.108102:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783689856 00000100:00100000:3.0:1789477410.108192:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 73 00000100:00100000:3.0:1789477410.108204:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d50413800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9bc33f26-0aab-4a14-832f-c58d566de1b0+54:10452:x1876402783689856:12345-192.168.201.23@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1789477410.108285:0:5844:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789477410.108319:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be5200/0xafddb3c8f9281beb lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2b7d expref: 54 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477410.108345:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9d0d596aed00) 00010000:00010000:3.0:1789477410.108360:0:5844:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789477410.108391:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49eca000/0xafddb3c8f9281bf9 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477410.108411:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49eca000/0xafddb3c8f9281bf9 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477410.108424:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49eca000/0xafddb3c8f9281bf9 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477410.108653:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49ecbc00/0xafddb3c8f9281c00 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0xc261c573 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477410.108731:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49ecbc00/0xafddb3c8f9281c00 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0xc261c573 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477410.108744:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49ecbc00/0xafddb3c8f9281c00 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0xc261c573 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477410.108836:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49eca000/0xafddb3c8f9281bf9 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477410.108855:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49eca000/0xafddb3c8f9281bf9 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477410.108861:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49eca000/0xafddb3c8f9281bf9 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477410.108867:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d0d49eca000 already unused, calling callback (ffffffffc1fd54f0) 00010000:00010000:3.0:1789477410.108871:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49eca000/0xafddb3c8f9281bf9 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477410.108878:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49eca000/0xafddb3c8f9281bf9 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477410.108890:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9d0d5b9f4000) 00010000:00010000:3.0:1789477410.108894:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789477410.109038:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49eca000/0xafddb3c8f9281bf9 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477410.112738:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49eca000/0xafddb3c8f9281bf9 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477410.112785:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49ecbc00/0xafddb3c8f9281c00 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0xc261c573 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477410.112793:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49ecbc00/0xafddb3c8f9281c00 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xc261c573 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477410.112802:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49ecbc00/0xafddb3c8f9281c00 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xc261c573 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477410.112809:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d0d49ecbc00 already unused, calling callback (ffffffffc1fd54f0) 00010000:00010000:3.0:1789477410.112834:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49ecbc00/0xafddb3c8f9281c00 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xc261c573 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477410.112843:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49ecbc00/0xafddb3c8f9281c00 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xc261c573 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477410.112863:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0xc261c573 (ffff9d0d44568800) 00010000:00010000:3.0:1789477410.112867:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789477410.112872:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49ecbc00/0xafddb3c8f9281c00 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0xc261c573 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477410.112878:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49ecbc00/0xafddb3c8f9281c00 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0xc261c573 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789477410.113441:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d50413800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9bc33f26-0aab-4a14-832f-c58d566de1b0+53:10452:x1876402783689856:12345-192.168.201.23@tcp:36:lhsmtool_posix.0 Request processed in 5232us (5546us total) trans 0 rc -2/-2 00000100:00100000:2.0:1789477410.113451:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 73 00000100:00100000:3.0:1789477410.119615:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:1.0:1789477410.121336:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783689984 00000100:00100000:1.0:1789477410.121352:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783689984 00000100:00100000:1.0:1789477410.121440:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 74 00000100:00100000:1.0:1789477410.121453:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d74aab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9bc33f26-0aab-4a14-832f-c58d566de1b0+53:10452:x1876402783689984:12345-192.168.201.23@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789477410.121475:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789477410.121501:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f518a00/0xafddb3c8f9281c07 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa90d500d7b8f2b84 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477410.121544:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f518400/0xafddb3c8f9281c0e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477410.121559:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f518400/0xafddb3c8f9281c0e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477410.121570:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f518400/0xafddb3c8f9281c0e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477410.122190:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f518a00/0xafddb3c8f9281c07 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2b84 expref: 55 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477410.122216:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f518400/0xafddb3c8f9281c0e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2b84 expref: 54 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477410.122225:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9d0d5b9f4e00) 00010000:00010000:1.0:1789477410.122228:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1789477410.122231:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d0d7f518400, rc 0) 00000100:00100000:1.0:1789477410.122310:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d74aab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9bc33f26-0aab-4a14-832f-c58d566de1b0+54:10452:x1876402783689984:12345-192.168.201.23@tcp:101:lhsmtool_posix.0 Request processed in 859us (2734us total) trans 0 rc 0/0 00000100:00100000:1.0:1789477410.122316:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 74 00000100:00100000:3.0:1789477410.129015:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:1.0:1789477410.129230:0:6999:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783690240 00000100:00100000:1.0:1789477410.129242:0:6999:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783690240 00000100:00100000:1.0:1789477410.129310:0:6999:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 75 00000100:00100000:1.0:1789477410.129322:0:6999:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d74aa8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9bc33f26-0aab-4a14-832f-c58d566de1b0+54:10452:x1876402783690240:12345-192.168.201.23@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1789477410.129418:0:6999:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f518c00/0xafddb3c8f9281c15 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477410.129438:0:6999:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f518c00/0xafddb3c8f9281c15 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477410.129451:0:6999:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f518c00/0xafddb3c8f9281c15 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1789477410.130145:0:6999:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].3, 88 off8408 00000004:00080000:1.0:1789477410.130157:0:6999:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 355201578562ns, next at 356201575944ns, rc = 0 00000004:00010000:1.0:1789477410.130285:0:6999:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000b1c0e148 reply state 000000003e63b558 transno 4294967353 ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f518c00/0xafddb3c8f9281c15 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789477410.130297:0:6999:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1789477410.130412:0:6999:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d74aa8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9bc33f26-0aab-4a14-832f-c58d566de1b0+56:10452:x1876402783690240:12345-192.168.201.23@tcp:36:lhsmtool_posix.0 Request processed in 1090us (1406us total) trans 4294967353 rc 0/0 00000100:00100000:1.0:1789477410.130420:0:6999:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 75 00000100:00100000:3.0:1789477410.139165:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00010000:00010000:1.0:1789477410.139426:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f518c00/0xafddb3c8f9281c15 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477410.139440:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f518c00/0xafddb3c8f9281c15 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477410.139448:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f518c00/0xafddb3c8f9281c15 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477410.139455:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d0d7f518c00 already unused, calling callback (ffffffffc1fd54f0) 00010000:00010000:1.0:1789477410.139460:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f518c00/0xafddb3c8f9281c15 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477410.139468:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f518c00/0xafddb3c8f9281c15 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789477410.139475:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783690368 00010000:00010000:1.0:1789477410.139487:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9d0d5b9f4e00) 00000100:00100000:0.0:1789477410.139494:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783690368 00010000:00010000:1.0:1789477410.139495:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1789477410.139516:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f518c00/0xafddb3c8f9281c15 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477410.139524:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f518c00/0xafddb3c8f9281c15 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789477410.139606:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 76 00000100:00100000:0.0:1789477410.139620:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d74aa8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9bc33f26-0aab-4a14-832f-c58d566de1b0+55:10452:x1876402783690368:12345-192.168.201.23@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789477410.139654:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789477410.139679:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be4800/0xafddb3c8f9281c1c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa90d500d7b8f2b8b expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477410.139764:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be4800/0xafddb3c8f9281c1c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2b8b expref: 56 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477410.139798:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be4800/0xafddb3c8f9281c1c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2b8b expref: 56 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477410.139822:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9d0d5b9f4e00) 00010000:00010000:0.0:1789477410.139825:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789477410.139829:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d0d50be4800, rc 0) 00000100:00100000:0.0:1789477410.139915:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d74aa8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9bc33f26-0aab-4a14-832f-c58d566de1b0+56:10452:x1876402783690368:12345-192.168.201.23@tcp:101:lhsmtool_posix.0 Request processed in 298us (760us total) trans 0 rc 0/0 00000100:00100000:0.0:1789477410.139923:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 76 00000100:00100000:0.0:1789477410.145461:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:1.0:1789477410.146267:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783690496 00000100:00100000:1.0:1789477410.146301:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783690496 00000100:00100000:1.0:1789477410.146352:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 25 00000100:00100000:1.0:1789477410.146362:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d58244e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2351:x1876402783690496:12345-192.168.201.23@tcp:8:lhsmtool_posix.0 00010000:00080000:1.0:1789477410.146402:0:6696:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 9bc33f26-0aab-4a14-832f-c58d566de1b0@192.168.201.23@tcp t0 exp 0000000000000000 cur 355 last 0 00000020:00000080:1.0:1789477410.146459:0:6696:0:(genops.c:1385:class_connect()) connect: client 9bc33f26-0aab-4a14-832f-c58d566de1b0, cookie 0xafddb3c8f9281c23 00002000:00100000:1.0:1789477410.146472:0:6696:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 9bc33f26-0aab-4a14-832f-c58d566de1b0/ffff9d0d7c675000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113954 ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1789477410.146485:0:6696:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:1.0:1789477410.146803:0:6696:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1789477410.146840:0:6696:0:(import.c:65:import_set_state_nolock()) ffff9d0d7c672800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789477410.146914:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d58244e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9bc33f26-0aab-4a14-832f-c58d566de1b0+6:2351:x1876402783690496:12345-192.168.201.23@tcp:8:lhsmtool_posix.0 Request processed in 551us (1469us total) trans 0 rc 0/0 00000100:00100000:1.0:1789477410.146922:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 25 00000100:00100000:1.0:1789477410.151781:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:0.0:1789477410.154113:0:8241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783690624 00000100:00100000:0.0:1789477410.154133:0:8241:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783690624 00000100:00080000:2.0:1789477410.154270:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789477410.154311:0:8241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 26 00000100:00100000:1.0:1789477410.154324:0:8241:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d623c9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9bc33f26-0aab-4a14-832f-c58d566de1b0+6:0:x1876402783690624:12345-192.168.201.23@tcp:2:lhsmtool_posix.0 00000001:00080000:1.0:1789477410.264795:0:7678:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967301 is committed 00000001:00100000:1.0:1789477410.264819:0:7678:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 9bc33f26-0aab-4a14-832f-c58d566de1b0 00000100:00100000:1.0:1789477410.264995:0:8241:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d623c9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9bc33f26-0aab-4a14-832f-c58d566de1b0+5:0:x1876402783690624:12345-192.168.201.23@tcp:2:lhsmtool_posix.0 Request processed in 110663us (113214us total) trans 4294967301 rc 0/0 00000100:00100000:1.0:1789477410.265009:0:8241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 26 00000100:00100000:3.0:1789477410.281960:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:1.0:1789477410.282661:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783690880 00000100:00100000:1.0:1789477410.282677:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783690880 00000100:00100000:1.0:1789477410.283086:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 19 00000100:00100000:1.0:1789477410.283101:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d74aa9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9bc33f26-0aab-4a14-832f-c58d566de1b0+56:10452:x1876402783690880:12345-192.168.201.23@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1789477410.283470:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d74aa9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9bc33f26-0aab-4a14-832f-c58d566de1b0+57:10452:x1876402783690880:12345-192.168.201.23@tcp:35:lhsmtool_posix.0 Request processed in 372us (1525us total) trans 4294967354 rc 0/0 00000100:00100000:1.0:1789477410.283499:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 19 00000100:00100000:2.0:1789477410.294953:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:1.0:1789477410.299827:0:6999:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783691136 00000100:00100000:1.0:1789477410.299849:0:6999:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783691136 00000100:00100000:1.0:1789477410.299935:0:6999:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 77 00000100:00100000:1.0:1789477410.299948:0:6999:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d50412300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9bc33f26-0aab-4a14-832f-c58d566de1b0+57:10452:x1876402783691136:12345-192.168.201.23@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1789477410.300114:0:6999:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d50412300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9bc33f26-0aab-4a14-832f-c58d566de1b0+57:10452:x1876402783691136:12345-192.168.201.23@tcp:57:lhsmtool_posix.0 Request processed in 167us (5177us total) trans 0 rc 0/0 00000100:00100000:1.0:1789477410.300123:0:6999:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 77 00000100:00100000:1.0:1789477410.303551:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:3.0:1789477410.306172:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783691264 00000100:00100000:3.0:1789477410.306204:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783691264 00000100:00100000:3.0:1789477410.306301:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 78 00000100:00100000:3.0:1789477410.306315:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d623cbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9bc33f26-0aab-4a14-832f-c58d566de1b0+57:10452:x1876402783691264:12345-192.168.201.23@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789477410.306353:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789477410.306382:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49ecbc00/0xafddb3c8f9281c2a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa90d500d7b8f2b92 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477410.306482:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49eca000/0xafddb3c8f9281c31 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477410.306513:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49eca000/0xafddb3c8f9281c31 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477410.306543:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49eca000/0xafddb3c8f9281c31 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789477410.306621:0:5846:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1789477410.306646:0:5846:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49eca000/0xafddb3c8f9281c31 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477410.306796:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49ecbc00/0xafddb3c8f9281c2a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2b92 expref: 59 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477410.306827:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49eca000/0xafddb3c8f9281c31 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2b92 expref: 58 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477410.306837:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9d0d5b9f4e00) 00010000:00010000:3.0:1789477410.306840:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1789477410.306844:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d0d49eca000, rc 0) 00000100:00100000:3.0:1789477410.306939:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d623cbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9bc33f26-0aab-4a14-832f-c58d566de1b0+58:10452:x1876402783691264:12345-192.168.201.23@tcp:101:lhsmtool_posix.0 Request processed in 627us (3401us total) trans 0 rc 0/0 00000100:00100000:3.0:1789477410.306947:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 78 00000100:00100000:1.0:1789477410.333511:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:0.0:1789477410.333988:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783691392 00000100:00100000:0.0:1789477410.334003:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783691392 00000100:00100000:0.0:1789477410.334490:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 27 00000100:00100000:0.0:1789477410.334515:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d623ca300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9bc33f26-0aab-4a14-832f-c58d566de1b0+5:2354:x1876402783691392:12345-192.168.201.23@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789477410.334540:0:6696:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789477410.334566:0:6696:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000bc5573ae/0xafddb3c8f9281c38 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa90d500d7b8f2b99 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789477410.334634:0:6696:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6aa94221, blocks: 0x1 00010000:00010000:0.0:1789477410.334661:0:6696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=355s v=(0 0) 00010000:00010000:0.0:1789477410.334666:0:6696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789477410.334679:0:6696:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bc5573ae/0xafddb3c8f9281c38 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2b99 expref: 6 pid: 6696 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477410.334733:0:6696:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000bc5573ae/0xafddb3c8f9281c38 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2b99 expref: 6 pid: 6696 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477410.334752:0:6696:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d0d50be5800, rc 0) 00000100:00100000:0.0:1789477410.334834:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d623ca300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9bc33f26-0aab-4a14-832f-c58d566de1b0+6:2354:x1876402783691392:12345-192.168.201.23@tcp:101:lhsmtool_posix.0 Request processed in 333us (1340us total) trans 0 rc 0/0 00000100:00100000:0.0:1789477410.334844:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 27 00000100:00100000:3.0:1789477410.342900:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:1.0:1789477410.349535:0:6999:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783691648 00000100:00100000:1.0:1789477410.349557:0:6999:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783691648 00000100:00100000:1.0:1789477410.349675:0:6999:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 79 00000100:00100000:1.0:1789477410.349884:0:6999:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d74aab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9bc33f26-0aab-4a14-832f-c58d566de1b0+58:10452:x1876402783691648:12345-192.168.201.23@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1789477410.350067:0:6999:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d74aab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9bc33f26-0aab-4a14-832f-c58d566de1b0+58:10452:x1876402783691648:12345-192.168.201.23@tcp:57:lhsmtool_posix.0 Request processed in 189us (7183us total) trans 0 rc 0/0 00000100:00100000:1.0:1789477410.350076:0:6999:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 79 00000100:00100000:3.0:1789477410.353318:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:1.0:1789477410.353851:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783691776 00000100:00100000:1.0:1789477410.353867:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783691776 00000100:00100000:1.0:1789477410.353953:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 28 00000100:00100000:1.0:1789477410.353966:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d74aa8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9bc33f26-0aab-4a14-832f-c58d566de1b0+6:10452:x1876402783691776:12345-192.168.201.23@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789477410.353994:0:6694:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789477410.354024:0:6694:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006b2f4150/0xafddb3c8f9281c3f lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa90d500d7b8f2ba0 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477410.354091:0:6694:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000bc5573ae/0xafddb3c8f9281c38 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2b99 expref: 7 pid: 6696 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477410.354103:0:6694:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789477410.354108:0:6694:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789477410.354114:0:6694:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006b2f4150/0xafddb3c8f9281c3f lrc: 4/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2ba0 expref: 7 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477410.354160:0:6694:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000bc5573ae/0xafddb3c8f9281c38 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2b99 expref: 7 pid: 6696 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477410.354177:0:6694:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000bc5573ae/0xafddb3c8f9281c38 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2b99 expref: 7 pid: 6696 timeout: 455 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789477410.354203:0:6694:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d623c9500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6694:1876402802589440:192.168.201.23@tcp:104: 00000100:00100000:1.0:1789477410.354319:0:6694:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d0d46da9600 going to sleep for 11 seconds 00000100:00100000:2.0:1789477410.361955:0:6694:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d623c9500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6694:1876402802589440:192.168.201.23@tcp:104: 00010000:00010000:2.0:1789477410.362012:0:6694:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000006b2f4150/0xafddb3c8f9281c3f lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2ba0 expref: 7 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477410.362043:0:6694:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d0d7f518c00, rc 0) 00000100:00100000:2.0:1789477410.362119:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d74aa8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9bc33f26-0aab-4a14-832f-c58d566de1b0+7:10452:x1876402783691776:12345-192.168.201.23@tcp:101:lhsmtool_posix.0 Request processed in 8154us (8818us total) trans 0 rc 0/0 00000100:00100000:2.0:1789477410.362148:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 28 00000100:00100000:3.0:1789477410.373053:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:1.0:1789477410.376786:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783691904 00000100:00100000:1.0:1789477410.376809:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783691904 00010000:00010000:0.0:1789477410.377759:0:5829:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000bc5573ae/0xafddb3c8f9281c38 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2b99 expref: 7 pid: 6696 timeout: 455 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789477410.377827:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 42 00000100:00100000:0.0:1789477410.377841:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d50a80850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9bc33f26-0aab-4a14-832f-c58d566de1b0+7:2354:x1876402783691904:12345-192.168.201.23@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789477410.377862:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789477410.377897:0:5829:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000bc5573ae/0xafddb3c8f9281c38 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2b99 expref: 7 pid: 6696 timeout: 455 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477410.377913:0:5829:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000bc5573ae/0xafddb3c8f9281c38 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2b99 expref: 7 pid: 6696 timeout: 455 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477410.377942:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bc5573ae/0xafddb3c8f9281c38 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2b99 expref: 7 pid: 6696 timeout: 455 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477410.377963:0:5829:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789477410.377988:0:5829:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789477410.377999:0:5829:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000006b2f4150/0xafddb3c8f9281c3f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2ba0 expref: 6 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477410.378010:0:5829:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006b2f4150/0xafddb3c8f9281c3f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2ba0 expref: 6 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477410.378061:0:5829:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000006b2f4150/0xafddb3c8f9281c3f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2ba0 expref: 6 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789477410.378199:0:5829:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d58244380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5829:1876402802589568:192.168.201.23@tcp:105: 00000100:00100000:0.0:1789477410.379540:0:5829:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d0d473449c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789477410.391860:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:1.0:1789477410.392042:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783692032 00000100:00100000:1.0:1789477410.392055:0:6702:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783692032 00002000:00100000:1.0:1789477410.392129:0:6702:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3:0x0] (0->8) req@ffff9d0d58247800 x1876402783692032/t0(0) o4->9bc33f26-0aab-4a14-832f-c58d566de1b0@192.168.201.23@tcp:581/0 lens 504/0 e 0 to 0 dl 1789477421 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789477410.392143:0:6702:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9d0d58247800 with x1876402783692032 ext(0->8) 00002000:00010000:1.0:1789477410.392150:0:6702:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9d0d58247800 00000100:00100000:1.0:1789477410.392202:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 0 00000100:00100000:1.0:1789477410.392232:0:6702:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d58247800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:9bc33f26-0aab-4a14-832f-c58d566de1b0+7:2355:x1876402783692032:12345-192.168.201.23@tcp:4:lhsmtool_posix.0 00000100:00100000:1.0:1789477410.393274:0:6702:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d58247800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:9bc33f26-0aab-4a14-832f-c58d566de1b0+9:2355:x1876402783692032:12345-192.168.201.23@tcp:4:lhsmtool_posix.0 Request processed in 1035us (1425us total) trans 4294967302 rc 0/0 00000100:00100000:1.0:1789477410.393285:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 0 00002000:00100000:1.0:1789477410.393298:0:6702:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3:0x0] (0->8) req@ffff9d0d58247800 x1876402783692032/t4294967302(0) o4->9bc33f26-0aab-4a14-832f-c58d566de1b0@192.168.201.23@tcp:581/0 lens 504/448 e 0 to 0 dl 1789477421 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789477410.393308:0:6702:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9d0d58247800 with x1876402783692032 ext(0->8) 00002000:00010000:1.0:1789477410.393312:0:6702:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9d0d58247800 00000100:00100000:3.0:1789477410.394458:0:5829:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d58244380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5829:1876402802589568:192.168.201.23@tcp:105: 00010000:00010000:3.0:1789477410.394493:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789477410.394613:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d50a80850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9bc33f26-0aab-4a14-832f-c58d566de1b0+8:2354:x1876402783691904:12345-192.168.201.23@tcp:103:ldlm_bl.0 Request processed in 16738us (21542us total) trans 0 rc 0/0 00000100:00100000:3.0:1789477410.394625:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 42 00000100:00100000:0.0:1789477410.411811:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:3.0:1789477410.412167:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783692160 00000100:00100000:3.0:1789477410.412192:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783692160 00000100:00100000:3.0:1789477410.412289:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 80 00000100:00100000:3.0:1789477410.412302:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d58244380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9bc33f26-0aab-4a14-832f-c58d566de1b0+58:10452:x1876402783692160:12345-192.168.201.23@tcp:44:lhsmtool_posix.0 00010000:00010000:1.0:1789477410.482157:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789477410.567773:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d58244380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9bc33f26-0aab-4a14-832f-c58d566de1b0+58:10452:x1876402783692160:12345-192.168.201.23@tcp:44:lhsmtool_posix.0 Request processed in 155459us (155966us total) trans 0 rc 0/0 00000100:00100000:3.0:1789477410.567790:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 80 00000001:00080000:3.0:1789477410.567851:0:5868:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967351 is committed 00000001:00080000:3.0:1789477410.567898:0:5868:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967354 is committed 00000004:00080000:3.0:1789477410.567907:0:5868:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 4 committed 00000004:00080000:3.0:1789477410.567971:0:5868:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00000020:00080000:3.0:1789477410.568003:0:5868:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9d0d444809c0 refcount 2 committed 0 result 0 batchid 1 00000020:00080000:3.0:1789477410.568008:0:5868:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9d0d50b48100 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9d0d44480780 00000020:00080000:3.0:1789477410.568011:0:5868:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9d0d50b48800 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9d0d7c3fe400 00000020:00080000:2.0:1789477410.568880:0:5879:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 1 committed batchid 0 00000020:00080000:2.0:1789477410.569032:0:5879:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000100:00100000:2.0:1789477410.569894:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d50411180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1876402802589824:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1789477410.569989:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789477410.570076:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789477410.570085:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d74aa9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1876402802589696:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1789477410.570110:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789477410.570156:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802589824 00000100:00100000:2.0:1789477410.570169:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802589824 00000100:00100000:2.0:1789477410.570239:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802589696 00000100:00100000:2.0:1789477410.570243:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802589696 00000100:00100000:2.0:1789477410.570267:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1789477410.570277:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d50413480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3311:x1876402802589824:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1789477410.570320:0:6697:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:2 count 1 00002000:00010000:2.0:1789477410.570380:0:6697:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x2:0x0] initial LVB size: 13, mtime: 0x6aa9421e, atime: 0x6aa9421e, ctime: 0x6aa9421e, blocks: 0x1 00010000:00010000:2.0:1789477410.570392:0:6697:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003a23395b/0xafddb3c8f9281c46 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477410.570419:0:6697:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=355s v=(0 0) 00010000:00010000:2.0:1789477410.570426:0:6697:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789477410.570435:0:6697:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003a23395b/0xafddb3c8f9281c46 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477410.570456:0:6697:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003a23395b/0xafddb3c8f9281c46 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477410.570489:0:6697:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003a23395b/0xafddb3c8f9281c46 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477410.570507:0:6697:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003a23395b/0xafddb3c8f9281c46 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477410.570529:0:6697:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1789477410.574982:0:8241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1789477410.575021:0:8241:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d50410700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3311:x1876402802589696:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1789477410.576276:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d50413480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3311:x1876402802589824:12345-0@lo:6:osp-syn-0-0.0 Request processed in 5987us (6273us total) trans 4294967301 rc 0/0 00000100:00100000:2.0:1789477410.576292:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00002000:00010000:0.0:1789477410.576625:0:8241:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:0.0:1789477410.576630:0:8241:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb mtime from disk: 0 -> 1789477409 00002000:00010000:0.0:1789477410.576633:0:8241:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1789477410.576635:0:8241:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb ctime from disk: 1789477409 -> 1789477409 00002000:00010000:0.0:1789477410.576637:0:8241:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:0.0:1789477410.576678:0:8241:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d50410700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3311:x1876402802589696:12345-0@lo:2:osp-syn-1-0.0 Request processed in 1678us (6566us total) trans 4294967303 rc 0/0 00000100:00100000:0.0:1789477410.576685:0:8241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00010000:00010000:2.0:1789477410.577453:0:5832:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789477410.577466:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003a23395b/0xafddb3c8f9281c46 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477410.577481:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d0d41647000 already unused, calling callback (ffffffffc15972a0) 00010000:00010000:2.0:1789477410.577487:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003a23395b/0xafddb3c8f9281c46 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789477410.577876:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00010000:00010000:2.0:1789477410.578053:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003a23395b/0xafddb3c8f9281c46 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477410.578084:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003a23395b/0xafddb3c8f9281c46 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477410.578092:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003a23395b/0xafddb3c8f9281c46 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477410.578131:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789477410.578134:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789477410.578136:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1789477410.578207:0:3311:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9d0d74aa9f80/2, rc 0, transno 4294967303 00000100:00100000:2.0:1789477410.578218:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d74aa9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1876402802589696:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1789477410.578236:0:3311:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9d0d50411180/2, rc 0, transno 4294967301 00000100:00100000:2.0:1789477410.578241:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d50411180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1876402802589824:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1789477410.578275:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783692288 00000100:00100000:2.0:1789477410.578284:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783692288 00000100:00100000:2.0:1789477410.578355:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 31 00000100:00100000:2.0:1789477410.578366:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d623cad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9bc33f26-0aab-4a14-832f-c58d566de1b0+8:2355:x1876402783692288:12345-192.168.201.23@tcp:16:lhsmtool_posix.0 00000001:00080000:0.0:1789477410.725929:0:7678:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967303 is committed 00000001:00080000:0.0:1789477410.725968:0:7678:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967302 is committed 00000100:00100000:2.0:1789477410.726290:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d623cad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9bc33f26-0aab-4a14-832f-c58d566de1b0+6:2355:x1876402783692288:12345-192.168.201.23@tcp:16:lhsmtool_posix.0 Request processed in 147917us (148411us total) trans 0 rc 0/0 00000100:00100000:2.0:1789477410.726306:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 31 00000100:00100000:1.0:1789477410.732728:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:2.0:1789477410.732819:0:6999:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783692544 00000100:00100000:2.0:1789477410.732834:0:6999:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783692544 00000100:00100000:2.0:1789477410.732908:0:6999:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 81 00000100:00100000:2.0:1789477410.732921:0:6999:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d623c8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9bc33f26-0aab-4a14-832f-c58d566de1b0+13:10452:x1876402783692544:12345-192.168.201.23@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1789477410.732999:0:6999:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789477410.733039:0:6999:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49eca000/0xafddb3c8f9281c31 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2b92 expref: 13 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477410.733067:0:6999:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9d0d5b9f4e00) 00010000:00010000:2.0:1789477410.733073:0:6999:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789477410.733125:0:6999:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d41647000/0xafddb3c8f9281c4d lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477410.733141:0:6999:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d41647000/0xafddb3c8f9281c4d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477410.733153:0:6999:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d41647000/0xafddb3c8f9281c4d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789477410.733528:0:6999:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000004c63ee4a reply state 000000009b1df40f transno 4294967355 ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d41647000/0xafddb3c8f9281c4d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789477410.733540:0:6999:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789477410.733687:0:6999:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d623c8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9bc33f26-0aab-4a14-832f-c58d566de1b0+14:10452:x1876402783692544:12345-192.168.201.23@tcp:36:lhsmtool_posix.0 Request processed in 768us (974us total) trans 4294967355 rc 0/0 00000100:00100000:2.0:1789477410.733696:0:6999:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 81 00000100:00100000:1.0:1789477410.750313:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00010000:00010000:3.0:1789477410.750450:0:3296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d41647000/0xafddb3c8f9281c4d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477410.750467:0:3296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d41647000/0xafddb3c8f9281c4d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477410.750475:0:3296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d41647000/0xafddb3c8f9281c4d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477410.750482:0:3296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d0d41647000 already unused, calling callback (ffffffffc1fd54f0) 00010000:00010000:3.0:1789477410.750489:0:3296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d41647000/0xafddb3c8f9281c4d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477410.750498:0:3296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d41647000/0xafddb3c8f9281c4d lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477410.750543:0:3296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9d0d5b9f4e00) 00010000:00010000:3.0:1789477410.750547:0:3296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789477410.750554:0:3296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d41647000/0xafddb3c8f9281c4d lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477410.750561:0:3296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d41647000/0xafddb3c8f9281c4d lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789477410.752047:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783692672 00000100:00100000:2.0:1789477410.752069:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783692672 00000100:00100000:2.0:1789477410.752157:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 32 00000100:00100000:2.0:1789477410.752169:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d623caa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9bc33f26-0aab-4a14-832f-c58d566de1b0+6:2355:x1876402783692672:12345-192.168.201.23@tcp:2:lhsmtool_posix.0 00002000:00010000:2.0:1789477410.754275:0:6696:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:2.0:1789477410.754288:0:6696:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb mtime from disk: 1789477409 -> 1789477408 00002000:00010000:2.0:1789477410.754292:0:6696:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb atime from disk: 0 -> 1789477406 00002000:00010000:2.0:1789477410.754294:0:6696:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb ctime from disk: 1789477409 -> 1789477408 00002000:00010000:2.0:1789477410.754297:0:6696:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:2.0:1789477410.755306:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d623caa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9bc33f26-0aab-4a14-832f-c58d566de1b0+7:2355:x1876402783692672:12345-192.168.201.23@tcp:2:lhsmtool_posix.0 Request processed in 3124us (4993us total) trans 4294967304 rc 0/0 00000100:00100000:2.0:1789477410.755323:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 32 00000100:00100000:3.0:1789477410.764885:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:1.0:1789477410.764974:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783692928 00000100:00100000:1.0:1789477410.764989:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783692928 00000100:00100000:1.0:1789477410.765072:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 82 00000100:00100000:1.0:1789477410.765098:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d74aabb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9bc33f26-0aab-4a14-832f-c58d566de1b0+13:10452:x1876402783692928:12345-192.168.201.23@tcp:55:lhsmtool_posix.0 00010000:00010000:1.0:1789477410.765208:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f518200/0xafddb3c8f9281c54 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477410.765231:0:5845:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f518400/0xafddb3c8f9281c0e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2b84 expref: 13 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477410.765241:0:5845:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f518200/0xafddb3c8f9281c54 lrc: 4/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477410.765286:0:5845:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f518400/0xafddb3c8f9281c0e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2b84 expref: 13 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477410.765323:0:5845:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f518400/0xafddb3c8f9281c0e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2b84 expref: 13 pid: 5846 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789477410.765352:0:5845:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d623c9500 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5845:1876402802589952:192.168.201.23@tcp:104: 00000100:00100000:1.0:1789477410.765464:0:5845:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d0d7f7629c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789477410.772243:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:2.0:1789477410.772325:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783693056 00000100:00100000:2.0:1789477410.772369:0:6711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783693056 00010000:00010000:2.0:1789477410.772428:0:6711:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f518400/0xafddb3c8f9281c0e lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2b84 expref: 14 pid: 5846 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789477410.772483:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 43 00000100:00100000:2.0:1789477410.772494:0:6711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d6d464700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9bc33f26-0aab-4a14-832f-c58d566de1b0+14:2354:x1876402783693056:12345-192.168.201.23@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789477410.772515:0:6711:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789477410.772523:0:6711:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f518400/0xafddb3c8f9281c0e lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2b84 expref: 14 pid: 5846 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477410.772539:0:6711:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f518400/0xafddb3c8f9281c0e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2b84 expref: 14 pid: 5846 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477410.772569:0:6711:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9d0d5b9f4e00) 00010000:00010000:2.0:1789477410.772603:0:6711:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f518200/0xafddb3c8f9281c54 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477410.772614:0:6711:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f518200/0xafddb3c8f9281c54 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477410.772623:0:6711:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f518200/0xafddb3c8f9281c54 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477410.772649:0:6711:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789477410.772723:0:6711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d6d464700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9bc33f26-0aab-4a14-832f-c58d566de1b0+14:2354:x1876402783693056:12345-192.168.201.23@tcp:103:ldlm_bl.0 Request processed in 230us (495us total) trans 0 rc 0/0 00000100:00100000:2.0:1789477410.772732:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 43 00010000:00010000:3.0:1789477410.773155:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f518400/0xafddb3c8f9281c0e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2b84 expref: 13 pid: 5846 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789477410.773184:0:5845:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d623c9500 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5845:1876402802589952:192.168.201.23@tcp:104: 00010000:00010000:3.0:1789477410.773213:0:5845:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f518200/0xafddb3c8f9281c54 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477410.773225:0:5845:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f518200/0xafddb3c8f9281c54 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477410.773231:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f518200/0xafddb3c8f9281c54 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477410.773270:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f518200/0xafddb3c8f9281c54 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477410.773277:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f518200/0xafddb3c8f9281c54 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477410.773283:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f518200/0xafddb3c8f9281c54 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477410.773305:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d0d7f518200 already unused, calling callback (ffffffffc1fd54f0) 00010000:00010000:3.0:1789477410.773311:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f518200/0xafddb3c8f9281c54 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477410.773319:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f518200/0xafddb3c8f9281c54 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477410.773342:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9d0d5b9f4e00) 00010000:00010000:3.0:1789477410.773345:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:3.0:1789477410.773350:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f518200/0xafddb3c8f9281c54 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477410.773356:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f518200/0xafddb3c8f9281c54 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789477410.773423:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d74aabb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9bc33f26-0aab-4a14-832f-c58d566de1b0+12:10452:x1876402783692928:12345-192.168.201.23@tcp:55:lhsmtool_posix.0 Request processed in 8328us (8554us total) trans 0 rc -22/-22 00000100:00100000:3.0:1789477410.773433:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 82 00000100:00100000:1.0:1789477410.781409:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:0.0:1789477410.781514:0:8241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783693184 00000100:00100000:0.0:1789477410.781528:0:8241:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783693184 00000100:00100000:0.0:1789477410.781913:0:8241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 33 00000100:00100000:0.0:1789477410.781926:0:8241:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d4766aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9bc33f26-0aab-4a14-832f-c58d566de1b0+7:2354:x1876402783693184:12345-192.168.201.23@tcp:1:lhsmtool_posix.0 00010000:00010000:0.0:1789477410.781991:0:8241:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000155b90f2/0xafddb3c8f9281c5b lrc: 3/1,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477410.782020:0:8241:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000006b2f4150/0xafddb3c8f9281c3f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2ba0 expref: 7 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477410.782031:0:8241:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789477410.782037:0:8241:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789477410.782042:0:8241:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000155b90f2/0xafddb3c8f9281c5b lrc: 4/1,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477410.782115:0:8241:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000006b2f4150/0xafddb3c8f9281c3f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2ba0 expref: 7 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477410.782132:0:8241:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000006b2f4150/0xafddb3c8f9281c3f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2ba0 expref: 7 pid: 6694 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789477410.782150:0:8241:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d7c64ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8241:1876402802590080:192.168.201.23@tcp:104: 00000100:00100000:0.0:1789477410.782276:0:8241:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d0d510ab300 going to sleep for 11 seconds 00000100:00100000:0.0:1789477410.785463:0:8241:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d7c64ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8241:1876402802590080:192.168.201.23@tcp:104: 00010000:00010000:0.0:1789477410.785510:0:8241:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000155b90f2/0xafddb3c8f9281c5b lrc: 3/1,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789477410.786344:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:3.0:1789477410.787053:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783693312 00000100:00100000:3.0:1789477410.787067:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783693312 00010000:00010000:3.0:1789477410.787190:0:5831:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000006b2f4150/0xafddb3c8f9281c3f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2ba0 expref: 8 pid: 6694 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789477410.787283:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 44 00000100:00100000:3.0:1789477410.787295:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d58071880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9bc33f26-0aab-4a14-832f-c58d566de1b0+8:2354:x1876402783693312:12345-192.168.201.23@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789477410.787317:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789477410.787361:0:5831:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000006b2f4150/0xafddb3c8f9281c3f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2ba0 expref: 8 pid: 6694 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477410.787394:0:5831:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000006b2f4150/0xafddb3c8f9281c3f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2ba0 expref: 8 pid: 6694 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477410.787431:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006b2f4150/0xafddb3c8f9281c3f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2ba0 expref: 8 pid: 6694 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477410.787453:0:5831:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789477410.787458:0:5831:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789477410.787466:0:5831:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000155b90f2/0xafddb3c8f9281c5b lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477410.787477:0:5831:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000155b90f2/0xafddb3c8f9281c5b lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477410.787534:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789477410.787648:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d58071880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9bc33f26-0aab-4a14-832f-c58d566de1b0+7:2354:x1876402783693312:12345-192.168.201.23@tcp:103:ldlm_bl.0 Request processed in 354us (1319us total) trans 0 rc 0/0 00000100:00100000:3.0:1789477410.787657:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 44 00010000:00010000:1.0:1789477410.787738:0:8241:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000155b90f2/0xafddb3c8f9281c5b lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477410.787749:0:8241:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000155b90f2/0xafddb3c8f9281c5b lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477410.787780:0:8241:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000155b90f2/0xafddb3c8f9281c5b lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477410.787788:0:8241:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000155b90f2/0xafddb3c8f9281c5b lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477410.787796:0:8241:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000155b90f2/0xafddb3c8f9281c5b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477410.787804:0:8241:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d0d50be4a00 already unused, calling callback (ffffffffc15972a0) 00010000:00010000:1.0:1789477410.787809:0:8241:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000155b90f2/0xafddb3c8f9281c5b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477410.787827:0:8241:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000155b90f2/0xafddb3c8f9281c5b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477410.787842:0:8241:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000155b90f2/0xafddb3c8f9281c5b lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477410.787850:0:8241:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000155b90f2/0xafddb3c8f9281c5b lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789477410.787902:0:8241:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d4766aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9bc33f26-0aab-4a14-832f-c58d566de1b0+6:2354:x1876402783693184:12345-192.168.201.23@tcp:1:lhsmtool_posix.0 Request processed in 5979us (6576us total) trans 0 rc 0/0 00000100:00100000:1.0:1789477410.787912:0:8241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 33 00000100:00100000:2.0:1789477410.793076:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:1.0:1789477410.793870:0:6999:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783693568 00000100:00100000:1.0:1789477410.793887:0:6999:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783693568 00000100:00100000:1.0:1789477410.794021:0:6999:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 83 00000100:00100000:1.0:1789477410.794035:0:6999:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d50412d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9bc33f26-0aab-4a14-832f-c58d566de1b0+12:10452:x1876402783693568:12345-192.168.201.23@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1789477410.794146:0:6999:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f519e00/0xafddb3c8f9281c62 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477410.794168:0:6999:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f519e00/0xafddb3c8f9281c62 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477410.794200:0:6999:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f519e00/0xafddb3c8f9281c62 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477410.794628:0:6999:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f519200/0xafddb3c8f9281c69 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477410.794662:0:6999:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be4800/0xafddb3c8f9281c1c lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2b8b expref: 13 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477410.794809:0:6999:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f519200/0xafddb3c8f9281c69 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477410.794863:0:6999:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be4800/0xafddb3c8f9281c1c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2b8b expref: 13 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477410.794882:0:6999:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be4800/0xafddb3c8f9281c1c lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2b8b expref: 13 pid: 5845 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789477410.794900:0:6999:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d58073800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6999:1876402802590208:192.168.201.23@tcp:104: 00000100:00100000:1.0:1789477410.795076:0:6999:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d0d7f762c00 going to sleep for 11 seconds 00000100:00100000:2.0:1789477410.802212:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:3.0:1789477410.802565:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783693696 00000100:00100000:3.0:1789477410.802608:0:6711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783693696 00010000:00010000:3.0:1789477410.802659:0:6711:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be4800/0xafddb3c8f9281c1c lrc: 5/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2b8b expref: 14 pid: 5845 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789477410.802710:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 45 00000100:00100000:3.0:1789477410.802721:0:6711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d50b04700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9bc33f26-0aab-4a14-832f-c58d566de1b0+14:2354:x1876402783693696:12345-192.168.201.23@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789477410.802752:0:6711:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789477410.802760:0:6711:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be4800/0xafddb3c8f9281c1c lrc: 5/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2b8b expref: 14 pid: 5845 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477410.802775:0:6711:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be4800/0xafddb3c8f9281c1c lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2b8b expref: 14 pid: 5845 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477410.802802:0:6711:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9d0d5b9f4e00) 00010000:00010000:3.0:1789477410.802808:0:6711:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f519200/0xafddb3c8f9281c69 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477410.802818:0:6711:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f519200/0xafddb3c8f9281c69 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477410.802827:0:6711:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f519200/0xafddb3c8f9281c69 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477410.802849:0:6711:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789477410.803193:0:6711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d50b04700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9bc33f26-0aab-4a14-832f-c58d566de1b0+14:2354:x1876402783693696:12345-192.168.201.23@tcp:103:ldlm_bl.0 Request processed in 471us (995us total) trans 0 rc 0/0 00000100:00100000:3.0:1789477410.803201:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 45 00010000:00010000:1.0:1789477410.804471:0:6999:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be4800/0xafddb3c8f9281c1c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2b8b expref: 13 pid: 5845 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789477410.804868:0:6999:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d58073800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6999:1876402802590208:192.168.201.23@tcp:104: 00010000:00010000:1.0:1789477410.805022:0:6999:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f519200/0xafddb3c8f9281c69 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477410.805035:0:6999:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f519200/0xafddb3c8f9281c69 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477410.805041:0:6999:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f519200/0xafddb3c8f9281c69 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789477410.805319:0:6999:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967356 00000001:00080000:1.0:1789477410.807085:0:6999:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967357 00000001:00080000:1.0:1789477410.807209:0:6999:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967358 00000100:00100000:1.0:1789477410.807354:0:6999:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d58073800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:6999:1876402802590336:0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1789477410.807459:0:6999:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789477410.807510:0:6999:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d0d50acba80 going to sleep for 11 seconds 00000100:00100000:0.0:1789477410.807742:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802590336 00000100:00100000:0.0:1789477410.807753:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802590336 00000100:00100000:0.0:1789477410.807824:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1789477410.807843:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d58070a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6999:x1876402802590336:12345-0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1789477410.807968:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d58070a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6999:x1876402802590336:12345-0@lo:1000:mdt00_003.0 Request processed in 124us (500us total) trans 0 rc 0/0 00000100:00100000:0.0:1789477410.807976:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789477410.809210:0:6999:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967303 gen 2 00000004:00080000:1.0:1789477410.809224:0:6999:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9d0d74aa9f80, transno 4294967303 00000100:00100000:1.0:1789477410.809253:0:6999:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d58073800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:6999:1876402802590336:0@lo:1000:mdt00_003.0 00000001:00080000:1.0:1789477410.811260:0:6999:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967359 00000100:00100000:1.0:1789477410.811740:0:6999:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d58073800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:6999:1876402802590464:0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1789477410.811826:0:6999:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789477410.811908:0:6999:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d0d7f762c00 going to sleep for 11 seconds 00000100:00100000:0.0:1789477410.815082:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802590464 00000100:00100000:0.0:1789477410.815103:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802590464 00000100:00100000:0.0:1789477410.815224:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1789477410.815237:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d58071f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6999:x1876402802590464:12345-0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1789477410.815736:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d58071f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:6999:x1876402802590464:12345-0@lo:1000:mdt00_003.0 Request processed in 435us (3843us total) trans 4294967305 rc 0/0 00000100:00100000:0.0:1789477410.815747:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789477410.815867:0:6999:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d58073800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:6999:1876402802590464:0@lo:1000:mdt00_003.0 00010000:00010000:1.0:1789477410.815937:0:6999:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f519200/0xafddb3c8f9281c69 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477410.815960:0:6999:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f519200/0xafddb3c8f9281c69 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477410.815969:0:6999:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f519200/0xafddb3c8f9281c69 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477410.815976:0:6999:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d0d7f519200 already unused, calling callback (ffffffffc1fd54f0) 00010000:00010000:1.0:1789477410.815982:0:6999:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f519200/0xafddb3c8f9281c69 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477410.815990:0:6999:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f519200/0xafddb3c8f9281c69 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477410.816011:0:6999:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9d0d5b9f4e00) 00010000:00010000:1.0:1789477410.816034:0:6999:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789477410.816041:0:6999:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f519200/0xafddb3c8f9281c69 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477410.816047:0:6999:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f519200/0xafddb3c8f9281c69 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477410.816098:0:6999:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d41646a00/0xafddb3c8f9281b97 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477410.816104:0:6999:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d41646a00/0xafddb3c8f9281b97 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477410.816109:0:6999:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d41646a00/0xafddb3c8f9281b97 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477410.816114:0:6999:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d0d41646a00 already unused, calling callback (ffffffffc1fd54f0) 00010000:00010000:1.0:1789477410.816117:0:6999:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d41646a00/0xafddb3c8f9281b97 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477410.816122:0:6999:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d41646a00/0xafddb3c8f9281b97 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477410.816130:0:6999:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9d0d50919900) 00010000:00010000:1.0:1789477410.816132:0:6999:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789477410.816135:0:6999:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d41646a00/0xafddb3c8f9281b97 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477410.816141:0:6999:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d41646a00/0xafddb3c8f9281b97 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477410.816166:0:6999:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f519000/0xafddb3c8f9281c70 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477410.816225:0:6999:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be4200/0xafddb3c8f9281bb3 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2b6f expref: 16 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477410.816235:0:6999:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f519000/0xafddb3c8f9281c70 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477410.816278:0:6999:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be4200/0xafddb3c8f9281bb3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2b6f expref: 16 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477410.816294:0:6999:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be4200/0xafddb3c8f9281bb3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2b6f expref: 16 pid: 5844 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789477410.816310:0:6999:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d58073b80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6999:1876402802590592:192.168.201.23@tcp:104: 00000100:00100000:1.0:1789477410.816417:0:6999:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d0d7f762c00 going to sleep for 11 seconds 00000100:00100000:1.0:1789477410.820484:0:6999:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d58073b80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6999:1876402802590592:192.168.201.23@tcp:104: 00010000:00010000:1.0:1789477410.820546:0:6999:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f519000/0xafddb3c8f9281c70 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789477410.823186:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:1.0:1789477410.823508:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783693824 00000100:00100000:1.0:1789477410.823522:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783693824 00010000:00010000:1.0:1789477410.823612:0:5829:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be4200/0xafddb3c8f9281bb3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2b6f expref: 17 pid: 5844 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789477410.823662:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 46 00000100:00100000:1.0:1789477410.823687:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d74aaa300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9bc33f26-0aab-4a14-832f-c58d566de1b0+17:2354:x1876402783693824:12345-192.168.201.23@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789477410.823708:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789477410.823739:0:5829:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be4200/0xafddb3c8f9281bb3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2b6f expref: 17 pid: 5844 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477410.823754:0:5829:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be4200/0xafddb3c8f9281bb3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2b6f expref: 17 pid: 5844 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477410.823784:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be4200/0xafddb3c8f9281bb3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2b6f expref: 17 pid: 5844 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477410.823810:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9d0d50919900) 00010000:00010000:1.0:1789477410.823817:0:5829:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f519000/0xafddb3c8f9281c70 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477410.823829:0:5829:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f519000/0xafddb3c8f9281c70 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477410.823837:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f519000/0xafddb3c8f9281c70 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477410.823870:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789477410.823938:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d74aaa300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9bc33f26-0aab-4a14-832f-c58d566de1b0+16:2354:x1876402783693824:12345-192.168.201.23@tcp:103:ldlm_bl.0 Request processed in 265us (775us total) trans 0 rc 0/0 00000100:00100000:1.0:1789477410.823947:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 46 00010000:00010000:1.0:1789477410.824088:0:6999:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f519000/0xafddb3c8f9281c70 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477410.824098:0:6999:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f519000/0xafddb3c8f9281c70 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477410.824112:0:6999:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f519000/0xafddb3c8f9281c70 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477410.824125:0:6999:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f519000/0xafddb3c8f9281c70 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477410.824131:0:6999:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f519000/0xafddb3c8f9281c70 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477410.824138:0:6999:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d0d7f519000 already unused, calling callback (ffffffffc1fd54f0) 00010000:00010000:1.0:1789477410.824143:0:6999:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f519000/0xafddb3c8f9281c70 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477410.824152:0:6999:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f519000/0xafddb3c8f9281c70 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477410.824161:0:6999:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9d0d50919900) 00010000:00010000:1.0:1789477410.824164:0:6999:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789477410.824168:0:6999:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f519000/0xafddb3c8f9281c70 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477410.824184:0:6999:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f519000/0xafddb3c8f9281c70 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477410.824196:0:6999:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f519e00/0xafddb3c8f9281c62 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477410.824203:0:6999:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f519e00/0xafddb3c8f9281c62 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477410.824209:0:6999:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f519e00/0xafddb3c8f9281c62 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477410.824214:0:6999:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d0d7f519e00 already unused, calling callback (ffffffffc1fd54f0) 00010000:00010000:1.0:1789477410.824224:0:6999:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f519e00/0xafddb3c8f9281c62 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477410.824231:0:6999:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f519e00/0xafddb3c8f9281c62 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477410.824240:0:6999:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9d0d50919900) 00010000:00010000:1.0:1789477410.824242:0:6999:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1789477410.824245:0:6999:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f519e00/0xafddb3c8f9281c62 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477410.824251:0:6999:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f519e00/0xafddb3c8f9281c62 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789477410.824532:0:6999:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d50412d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9bc33f26-0aab-4a14-832f-c58d566de1b0+15:10452:x1876402783693568:12345-192.168.201.23@tcp:57:lhsmtool_posix.0 Request processed in 30499us (31473us total) trans 4294967360 rc 0/0 00000100:00100000:1.0:1789477410.824543:0:6999:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 83 00000020:00080000:1.0:1789477410.824548:0:6999:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:2.0:1789477410.827645:0:11717:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1789477410.827662:0:11717:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1789477410.827714:0:11717:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:2.0:1789477410.827722:0:11717:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1789477410.830523:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:2.0:1789477410.831084:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783694080 00000100:00100000:2.0:1789477410.831101:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783694080 00000100:00100000:2.0:1789477410.831196:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 20 00000100:00100000:2.0:1789477410.831212:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d74aa9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9bc33f26-0aab-4a14-832f-c58d566de1b0+15:10452:x1876402783694080:12345-192.168.201.23@tcp:35:lhsmtool_posix.0 00000004:00080000:2.0:1789477410.833277:0:5848:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x6:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:2.0:1789477410.833435:0:5848:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967361 00010000:00010000:2.0:1789477410.834048:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d41647000/0xafddb3c8f9281c77 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477410.834073:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d41647000/0xafddb3c8f9281c77 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477410.834090:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d41647000/0xafddb3c8f9281c77 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477410.834102:0:5848:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d41647000/0xafddb3c8f9281c77 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477410.834110:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d41647000/0xafddb3c8f9281c77 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477410.834118:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d41647000/0xafddb3c8f9281c77 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477410.834202:0:5848:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1789477410.834367:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d74aa9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9bc33f26-0aab-4a14-832f-c58d566de1b0+17:10452:x1876402783694080:12345-192.168.201.23@tcp:35:lhsmtool_posix.0 Request processed in 3151us (3849us total) trans 4294967362 rc 0/0 00000100:00100000:2.0:1789477410.834396:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 20 00000020:00080000:2.0:1789477410.834405:0:5848:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1789477410.837317:0:6710:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789477410.837389:0:6710:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d41647000/0xafddb3c8f9281c77 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477410.837404:0:6710:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d0d41647000 already unused, calling callback (ffffffffc15972a0) 00010000:00010000:3.0:1789477410.837409:0:6710:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d41647000/0xafddb3c8f9281c77 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477410.837444:0:6710:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d41647000/0xafddb3c8f9281c77 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477410.837467:0:6710:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9d0d50919b00) 00010000:00010000:3.0:1789477410.837471:0:6710:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1789477410.837476:0:6710:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d41647000/0xafddb3c8f9281c77 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477410.837482:0:6710:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d41647000/0xafddb3c8f9281c77 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477410.838831:0:6710:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789477410.838839:0:6710:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789477410.838842:0:6710:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1789477411.120068:0:12031:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1789477411.120153:0:12031:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1789477411.120228:0:12031:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:2.0:1789477411.120235:0:12031:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1789477411.281221:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:3.0:1789477411.281278:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783694336 00000100:00100000:3.0:1789477411.281291:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783694336 00000100:00100000:3.0:1789477411.281362:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 84 00000100:00100000:3.0:1789477411.281374:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d74aa8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9bc33f26-0aab-4a14-832f-c58d566de1b0+17:10463:x1876402783694336:12345-192.168.201.23@tcp:101:lfs.0 00010000:00010000:3.0:1789477411.281424:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789477411.281454:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49ecbc00/0xafddb3c8f9281c7e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa90d500d7b8f2ba7 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477411.282047:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49ecb200/0xafddb3c8f9281c85 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477411.282557:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49ecb200/0xafddb3c8f9281c85 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477411.282606:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49ecb200/0xafddb3c8f9281c85 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789477411.282629:0:5846:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 7680 00010000:00010000:3.0:1789477411.282952:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49ecbc00/0xafddb3c8f9281c7e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2ba7 expref: 20 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477411.282980:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49ecb200/0xafddb3c8f9281c85 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2ba7 expref: 19 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477411.282990:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9d0d5b9f4000) 00010000:00010000:3.0:1789477411.282993:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1789477411.282997:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d0d49ecb200, rc 0) 00000100:00100000:3.0:1789477411.283097:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d74aa8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9bc33f26-0aab-4a14-832f-c58d566de1b0+19:10463:x1876402783694336:12345-192.168.201.23@tcp:101:lfs.0 Request processed in 1723us (1893us total) trans 4294967363 rc 0/0 00000100:00100000:3.0:1789477411.283107:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 84 00000100:00100000:1.0:1789477411.292784:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:3.0:1789477411.292874:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783694464 00000100:00100000:3.0:1789477411.292887:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783694464 00000100:00100000:3.0:1789477411.292956:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 85 00000100:00100000:3.0:1789477411.292969:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d58073b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9bc33f26-0aab-4a14-832f-c58d566de1b0+19:10463:x1876402783694464:12345-192.168.201.23@tcp:34:lfs.0 00010000:00010000:3.0:1789477411.293094:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49ecba00/0xafddb3c8f9281c93 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477411.293118:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49ecba00/0xafddb3c8f9281c93 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477411.293135:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49ecba00/0xafddb3c8f9281c93 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477411.293153:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49eca600/0xafddb3c8f9281c9a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477411.293169:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49eca600/0xafddb3c8f9281c9a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477411.293186:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49eca600/0xafddb3c8f9281c9a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477411.293772:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49eca000/0xafddb3c8f9281ca1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477411.293782:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49eca000/0xafddb3c8f9281ca1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477411.293791:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49eca000/0xafddb3c8f9281ca1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789477411.293842:0:5844:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49eca000/0xafddb3c8f9281ca1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477411.293858:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49ecba00/0xafddb3c8f9281c93 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477411.293865:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49ecba00/0xafddb3c8f9281c93 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477411.293873:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49ecba00/0xafddb3c8f9281c93 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477411.293881:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d0d49ecba00 already unused, calling callback (ffffffffc1fd54f0) 00010000:00010000:3.0:1789477411.293886:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49ecba00/0xafddb3c8f9281c93 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477411.293895:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49ecba00/0xafddb3c8f9281c93 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477411.293910:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9d0d5b9f4000) 00010000:00010000:3.0:1789477411.293919:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789477411.293925:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49ecba00/0xafddb3c8f9281c93 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477411.293932:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49ecba00/0xafddb3c8f9281c93 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477411.293950:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49eca600/0xafddb3c8f9281c9a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477411.293956:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49eca600/0xafddb3c8f9281c9a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477411.293962:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49eca600/0xafddb3c8f9281c9a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477411.293968:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d0d49eca600 already unused, calling callback (ffffffffc1fd54f0) 00010000:00010000:3.0:1789477411.293971:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49eca600/0xafddb3c8f9281c9a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477411.293976:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49eca600/0xafddb3c8f9281c9a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477411.293985:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9d0d44568400) 00010000:00010000:3.0:1789477411.293988:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789477411.293992:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49eca600/0xafddb3c8f9281c9a lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477411.293998:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49eca600/0xafddb3c8f9281c9a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477411.294022:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49eca000/0xafddb3c8f9281ca1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477411.294033:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49eca000/0xafddb3c8f9281ca1 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477411.294039:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49eca000/0xafddb3c8f9281ca1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477411.294045:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d0d49eca000 already unused, calling callback (ffffffffc1fd54f0) 00010000:00010000:3.0:1789477411.294047:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49eca000/0xafddb3c8f9281ca1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477411.294053:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49eca000/0xafddb3c8f9281ca1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477411.294062:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9d0d44568800) 00010000:00010000:3.0:1789477411.294684:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789477411.294751:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49eca000/0xafddb3c8f9281ca1 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477411.294762:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49eca000/0xafddb3c8f9281ca1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789477411.294908:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d58073b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9bc33f26-0aab-4a14-832f-c58d566de1b0+19:10463:x1876402783694464:12345-192.168.201.23@tcp:34:lfs.0 Request processed in 1938us (2222us total) trans 0 rc 0/0 00000100:00100000:3.0:1789477411.294919:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 85 00000100:00100000:1.0:1789477411.374711:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:3.0:1789477411.383190:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783694720 00000100:00100000:3.0:1789477411.383212:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783694720 00000100:00100000:3.0:1789477411.383460:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 86 00000100:00100000:3.0:1789477411.383473:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d58072300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9bc33f26-0aab-4a14-832f-c58d566de1b0+19:10466:x1876402783694720:12345-192.168.201.23@tcp:101:lfs.0 00010000:00010000:3.0:1789477411.383503:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789477411.383551:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49eca000/0xafddb3c8f9281ca8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa90d500d7b8f2bae expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477411.383676:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49eca600/0xafddb3c8f9281caf lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477411.383696:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49eca600/0xafddb3c8f9281caf lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477411.383711:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49eca600/0xafddb3c8f9281caf lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477411.383727:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49ecba00/0xafddb3c8f9281cb6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477411.383735:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49ecba00/0xafddb3c8f9281cb6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477411.383740:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49ecba00/0xafddb3c8f9281cb6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477411.386789:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49ecbc00/0xafddb3c8f9281cbd lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477411.386814:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49ecbc00/0xafddb3c8f9281cbd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477411.386829:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49ecbc00/0xafddb3c8f9281cbd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789477411.386845:0:5846:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 9 00010000:00010000:3.0:1789477411.386985:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49eca600/0xafddb3c8f9281caf lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477411.387005:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49eca600/0xafddb3c8f9281caf lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477411.387013:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49eca600/0xafddb3c8f9281caf lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477411.387020:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d0d49eca600 already unused, calling callback (ffffffffc1fd54f0) 00010000:00010000:3.0:1789477411.387026:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49eca600/0xafddb3c8f9281caf lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477411.387034:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49eca600/0xafddb3c8f9281caf lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477411.387049:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9d0d5b9f4000) 00010000:00010000:3.0:1789477411.387052:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789477411.387058:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49eca600/0xafddb3c8f9281caf lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477411.387065:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49eca600/0xafddb3c8f9281caf lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477411.387083:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49ecba00/0xafddb3c8f9281cb6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477411.387089:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49ecba00/0xafddb3c8f9281cb6 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477411.387095:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49ecba00/0xafddb3c8f9281cb6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477411.387100:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d0d49ecba00 already unused, calling callback (ffffffffc1fd54f0) 00010000:00010000:3.0:1789477411.387109:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49ecba00/0xafddb3c8f9281cb6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477411.387116:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49ecba00/0xafddb3c8f9281cb6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477411.387124:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9d0d44568800) 00010000:00010000:3.0:1789477411.387127:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789477411.387130:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49ecba00/0xafddb3c8f9281cb6 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477411.387136:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49ecba00/0xafddb3c8f9281cb6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477411.387213:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49eca000/0xafddb3c8f9281ca8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2bae expref: 22 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477411.387230:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49ecbc00/0xafddb3c8f9281cbd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2bae expref: 21 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477411.387239:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9d0d44568400) 00010000:00010000:3.0:1789477411.387242:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789477411.387244:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d0d49ecbc00, rc 0) 00000100:00100000:3.0:1789477411.390804:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d58072300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9bc33f26-0aab-4a14-832f-c58d566de1b0+21:10466:x1876402783694720:12345-192.168.201.23@tcp:101:lfs.0 Request processed in 7314us (16569us total) trans 4294967364 rc 0/0 00000100:00100000:3.0:1789477411.390821:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 86 00000100:00100000:3.0:1789477411.398295:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:2.0:1789477411.398400:0:6999:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783694848 00000100:00100000:2.0:1789477411.398418:0:6999:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783694848 00000100:00100000:2.0:1789477411.398499:0:6999:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 87 00000100:00100000:2.0:1789477411.398511:0:6999:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d74aa9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9bc33f26-0aab-4a14-832f-c58d566de1b0+21:10466:x1876402783694848:12345-192.168.201.23@tcp:54:lfs.0 00010000:00010000:2.0:1789477411.398639:0:6999:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d41646a00/0xafddb3c8f9281ccb lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477411.398659:0:6999:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d41646a00/0xafddb3c8f9281ccb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477411.398674:0:6999:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d41646a00/0xafddb3c8f9281ccb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477411.398711:0:6999:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d41646a00/0xafddb3c8f9281ccb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477411.398719:0:6999:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d41646a00/0xafddb3c8f9281ccb lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477411.398727:0:6999:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d41646a00/0xafddb3c8f9281ccb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477411.398753:0:6999:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d0d41646a00 already unused, calling callback (ffffffffc1fd54f0) 00010000:00010000:2.0:1789477411.398759:0:6999:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d41646a00/0xafddb3c8f9281ccb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477411.398767:0:6999:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d41646a00/0xafddb3c8f9281ccb lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477411.398784:0:6999:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9d0d44568400) 00010000:00010000:2.0:1789477411.398787:0:6999:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789477411.398793:0:6999:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d41646a00/0xafddb3c8f9281ccb lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477411.398799:0:6999:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d41646a00/0xafddb3c8f9281ccb lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789477411.398897:0:6999:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d74aa9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9bc33f26-0aab-4a14-832f-c58d566de1b0+21:10466:x1876402783694848:12345-192.168.201.23@tcp:54:lfs.0 Request processed in 387us (616us total) trans 0 rc 0/0 00000100:00100000:2.0:1789477411.398906:0:6999:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 87 00000100:00100000:3.0:1789477411.411402:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:1.0:1789477411.411830:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783695104 00000100:00100000:1.0:1789477411.411845:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783695104 00000100:00100000:1.0:1789477411.411926:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 21 00000100:00100000:1.0:1789477411.411949:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d5845d050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9bc33f26-0aab-4a14-832f-c58d566de1b0+21:10466:x1876402783695104:12345-192.168.201.23@tcp:35:lfs.0 00000100:00100000:1.0:1789477411.412269:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d5845d050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9bc33f26-0aab-4a14-832f-c58d566de1b0+22:10466:x1876402783695104:12345-192.168.201.23@tcp:35:lfs.0 Request processed in 331us (877us total) trans 4294967365 rc 0/0 00000100:00100000:1.0:1789477411.412277:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 21 00000100:00100000:1.0:1789477411.473296:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:0.0:1789477411.473386:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783695360 00000100:00100000:0.0:1789477411.473401:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783695360 00000100:00100000:0.0:1789477411.473498:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 88 00000100:00100000:0.0:1789477411.473513:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d58071500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9bc33f26-0aab-4a14-832f-c58d566de1b0+22:9992:x1876402783695360:12345-192.168.201.23@tcp:101:bash.0 00010000:00010000:0.0:1789477411.473552:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789477411.473602:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be5000/0xafddb3c8f9281cd2 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa90d500d7b8f2bb5 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477411.473760:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be5200/0xafddb3c8f9281cd9 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477411.473781:0:5845:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49ecbc00/0xafddb3c8f9281cbd lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2bae expref: 23 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477411.473817:0:5845:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be5200/0xafddb3c8f9281cd9 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477411.473863:0:5845:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49ecbc00/0xafddb3c8f9281cbd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2bae expref: 23 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477411.473879:0:5845:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49ecbc00/0xafddb3c8f9281cbd lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2bae expref: 23 pid: 5846 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789477411.473895:0:5845:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d7c64ca80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5845:1876402802590720:192.168.201.23@tcp:104: 00000100:00100000:0.0:1789477411.474011:0:5845:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d0d510ab900 going to sleep for 11 seconds 00000100:00100000:1.0:1789477411.480772:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:3.0:1789477411.481016:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783695488 00000100:00100000:3.0:1789477411.481030:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783695488 00010000:00010000:3.0:1789477411.481104:0:5830:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49ecbc00/0xafddb3c8f9281cbd lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2bae expref: 24 pid: 5846 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789477411.481152:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 47 00000100:00100000:3.0:1789477411.481172:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d58072d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9bc33f26-0aab-4a14-832f-c58d566de1b0+24:2354:x1876402783695488:12345-192.168.201.23@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789477411.481189:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789477411.481198:0:5830:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49ecbc00/0xafddb3c8f9281cbd lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2bae expref: 24 pid: 5846 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477411.481212:0:5830:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49ecbc00/0xafddb3c8f9281cbd lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2bae expref: 24 pid: 5846 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477411.481240:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9d0d44568400) 00010000:00010000:3.0:1789477411.481246:0:5830:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be5200/0xafddb3c8f9281cd9 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477411.481258:0:5830:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be5200/0xafddb3c8f9281cd9 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477411.481268:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be5200/0xafddb3c8f9281cd9 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477411.481291:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789477411.481352:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d58072d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9bc33f26-0aab-4a14-832f-c58d566de1b0+24:2354:x1876402783695488:12345-192.168.201.23@tcp:103:ldlm_bl.0 Request processed in 192us (662us total) trans 0 rc 0/0 00000100:00100000:3.0:1789477411.481361:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 47 00010000:00010000:0.0:1789477411.481971:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49ecbc00/0xafddb3c8f9281cbd lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2bae expref: 23 pid: 5846 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789477411.481998:0:5845:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d7c64ca80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5845:1876402802590720:192.168.201.23@tcp:104: 00010000:00010000:0.0:1789477411.482027:0:5845:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be5200/0xafddb3c8f9281cd9 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477411.482037:0:5845:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be5200/0xafddb3c8f9281cd9 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477411.482045:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be5200/0xafddb3c8f9281cd9 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789477411.482143:0:5845:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 9 00010000:00010000:0.0:1789477411.482343:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be5000/0xafddb3c8f9281cd2 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2bb5 expref: 24 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477411.482373:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be5200/0xafddb3c8f9281cd9 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2bb5 expref: 23 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477411.482383:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9d0d44568400) 00010000:00010000:0.0:1789477411.482386:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1789477411.482389:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d0d50be5200, rc 0) 00000100:00100000:0.0:1789477411.482493:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d58071500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9bc33f26-0aab-4a14-832f-c58d566de1b0+23:9992:x1876402783695360:12345-192.168.201.23@tcp:101:bash.0 Request processed in 8983us (9212us total) trans 4294967366 rc 0/0 00000100:00100000:0.0:1789477411.482501:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 88 00000100:00100000:1.0:1789477411.485999:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:3.0:1789477411.486179:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783695744 00000100:00100000:3.0:1789477411.486193:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783695744 00000100:00100000:3.0:1789477411.486306:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 89 00000100:00100000:3.0:1789477411.486331:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d58070e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9bc33f26-0aab-4a14-832f-c58d566de1b0+23:9992:x1876402783695744:12345-192.168.201.23@tcp:36:bash.0 00010000:00010000:3.0:1789477411.486857:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d59d6b600/0xafddb3c8f9281ce7 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477411.486879:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d59d6b600/0xafddb3c8f9281ce7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477411.486893:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d59d6b600/0xafddb3c8f9281ce7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789477411.486952:0:5844:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967367 00000004:00010000:3.0:1789477411.486974:0:5844:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000003a2e2c65 reply state 000000003d8edcf1 transno 4294967368 ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d59d6b600/0xafddb3c8f9281ce7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789477411.486984:0:5844:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:3.0:1789477411.487026:0:5844:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967368 00000100:00100000:3.0:1789477411.489823:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d58070e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9bc33f26-0aab-4a14-832f-c58d566de1b0+27:9992:x1876402783695744:12345-192.168.201.23@tcp:36:bash.0 Request processed in 3476us (3815us total) trans 4294967369 rc 0/0 00000100:00100000:3.0:1789477411.489839:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 89 00000020:00080000:3.0:1789477411.489850:0:5844:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00010000:00010000:1.0:1789477411.496223:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d59d6b600/0xafddb3c8f9281ce7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477411.496246:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d59d6b600/0xafddb3c8f9281ce7 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477411.496256:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d59d6b600/0xafddb3c8f9281ce7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477411.496263:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d0d59d6b600 already unused, calling callback (ffffffffc1fd54f0) 00010000:00010000:1.0:1789477411.496269:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d59d6b600/0xafddb3c8f9281ce7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477411.496279:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d59d6b600/0xafddb3c8f9281ce7 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477411.496301:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9d0d44568400) 00010000:00010000:1.0:1789477411.496304:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789477411.496309:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d59d6b600/0xafddb3c8f9281ce7 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477411.496316:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d59d6b600/0xafddb3c8f9281ce7 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789477411.497267:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:3.0:1789477411.499337:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783695872 00000100:00100000:3.0:1789477411.499357:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783695872 00000100:00100000:3.0:1789477411.499509:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 90 00000100:00100000:3.0:1789477411.499524:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d58071180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9bc33f26-0aab-4a14-832f-c58d566de1b0+26:9992:x1876402783695872:12345-192.168.201.23@tcp:101:bash.0 00010000:00010000:3.0:1789477411.499567:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789477411.500803:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d59d6b400/0xafddb3c8f9281cee lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa90d500d7b8f2bbc expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477411.500908:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d59d6b400/0xafddb3c8f9281cee lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2bbc expref: 27 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477411.500941:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d59d6b400/0xafddb3c8f9281cee lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2bbc expref: 27 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477411.500967:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9d0d44568400) 00010000:00010000:3.0:1789477411.500970:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789477411.500975:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d0d59d6b400, rc 0) 00000100:00100000:3.0:1789477411.501080:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d58071180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9bc33f26-0aab-4a14-832f-c58d566de1b0+27:9992:x1876402783695872:12345-192.168.201.23@tcp:101:bash.0 Request processed in 1559us (3822us total) trans 0 rc 0/0 00000100:00100000:3.0:1789477411.501092:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 90 00010000:00010000:1.0:1789477411.503947:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789477411.507790:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:3.0:1789477411.507873:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783696000 00000100:00100000:3.0:1789477411.507886:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783696000 00000100:00100000:3.0:1789477411.507950:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 34 00000100:00100000:3.0:1789477411.507960:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d58072680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9bc33f26-0aab-4a14-832f-c58d566de1b0+6:9992:x1876402783696000:12345-192.168.201.23@tcp:101:bash.0 00010000:00010000:3.0:1789477411.507985:0:6694:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789477411.508011:0:6694:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009f89a1db/0xafddb3c8f9281cf5 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa90d500d7b8f2bc3 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789477411.508046:0:6694:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3:0x0] initial LVB size: 9, mtime: 0x6aa94220, atime: 0x6aa9421e, ctime: 0x6aa94220, blocks: 0xb 00010000:00010000:3.0:1789477411.508074:0:6694:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=356s v=(0 0) 00010000:00010000:3.0:1789477411.508079:0:6694:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789477411.508088:0:6694:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009f89a1db/0xafddb3c8f9281cf5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2bc3 expref: 7 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477411.508109:0:6694:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000009f89a1db/0xafddb3c8f9281cf5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2bc3 expref: 7 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477411.508144:0:6694:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d0d59d6be00, rc 0) 00000100:00100000:3.0:1789477411.508227:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d58072680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9bc33f26-0aab-4a14-832f-c58d566de1b0+7:9992:x1876402783696000:12345-192.168.201.23@tcp:101:bash.0 Request processed in 267us (454us total) trans 0 rc 0/0 00000100:00100000:3.0:1789477411.508235:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 34 00000100:00100000:0.0:1789477411.522756:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:1.0:1789477411.522858:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783696128 00000100:00100000:1.0:1789477411.522873:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783696128 00002000:00010000:1.0:1789477411.522931:0:6700:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/3 (0->18446744073709551615) 00002000:00100000:1.0:1789477411.522937:0:6700:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9d0d7c64ca80 with x1876402783696128 ext(0->18446744073709551615) 00002000:00010000:1.0:1789477411.522959:0:6700:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9d0d7c64ca80. 00000100:00100000:1.0:1789477411.525279:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 1 00000100:00100000:1.0:1789477411.525308:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d7c64ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:9bc33f26-0aab-4a14-832f-c58d566de1b0+7:2354:x1876402783696128:12345-192.168.201.23@tcp:10:bash.0 00002000:00010000:1.0:1789477411.525727:0:6700:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:1.0:1789477411.525732:0:6700:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb mtime from disk: 1789477408 -> 1789477410 00002000:00010000:1.0:1789477411.525735:0:6700:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb atime from disk: 1789477406 -> 1789477406 00002000:00010000:1.0:1789477411.525737:0:6700:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb ctime from disk: 1789477408 -> 1789477410 00002000:00010000:1.0:1789477411.525740:0:6700:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:1.0:1789477411.525825:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d7c64ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:9bc33f26-0aab-4a14-832f-c58d566de1b0+8:2354:x1876402783696128:12345-192.168.201.23@tcp:10:bash.0 Request processed in 529us (3083us total) trans 4294967306 rc 0/0 00000100:00100000:1.0:1789477411.525832:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 1 00002000:00010000:1.0:1789477411.525838:0:6700:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/3 (0->18446744073709551615) 00002000:00100000:1.0:1789477411.525842:0:6700:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9d0d7c64ca80 with x1876402783696128 ext(0->18446744073709551615) 00002000:00010000:1.0:1789477411.525851:0:6700:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9d0d7c64ca80. 00000100:00100000:1.0:1789477411.627848:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:2.0:1789477411.627966:0:6999:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783696256 00000100:00100000:2.0:1789477411.627979:0:6999:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783696256 00000100:00100000:2.0:1789477411.628053:0:6999:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 91 00000100:00100000:2.0:1789477411.628065:0:6999:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d58073100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9bc33f26-0aab-4a14-832f-c58d566de1b0+27:10480:x1876402783696256:12345-192.168.201.23@tcp:34:lfs.0 00010000:00010000:2.0:1789477411.628183:0:6999:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d41646a00/0xafddb3c8f9281cfc lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477411.628207:0:6999:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d41646a00/0xafddb3c8f9281cfc lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477411.628221:0:6999:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d41646a00/0xafddb3c8f9281cfc lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477411.628259:0:6999:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d41647800/0xafddb3c8f9281d03 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477411.628267:0:6999:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d41647800/0xafddb3c8f9281d03 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477411.628273:0:6999:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d41647800/0xafddb3c8f9281d03 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477411.628888:0:6999:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d41647a00/0xafddb3c8f9281d0a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477411.628902:0:6999:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d41647a00/0xafddb3c8f9281d0a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477411.628910:0:6999:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d41647a00/0xafddb3c8f9281d0a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789477411.628962:0:6999:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d41647a00/0xafddb3c8f9281d0a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477411.628975:0:6999:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d41646a00/0xafddb3c8f9281cfc lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477411.628982:0:6999:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d41646a00/0xafddb3c8f9281cfc lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477411.628990:0:6999:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d41646a00/0xafddb3c8f9281cfc lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477411.628995:0:6999:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d0d41646a00 already unused, calling callback (ffffffffc1fd54f0) 00010000:00010000:2.0:1789477411.629001:0:6999:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d41646a00/0xafddb3c8f9281cfc lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477411.629015:0:6999:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d41646a00/0xafddb3c8f9281cfc lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477411.629030:0:6999:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9d0d5b9f4000) 00010000:00010000:2.0:1789477411.629033:0:6999:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789477411.629038:0:6999:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d41646a00/0xafddb3c8f9281cfc lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477411.629045:0:6999:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d41646a00/0xafddb3c8f9281cfc lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477411.629058:0:6999:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d41647800/0xafddb3c8f9281d03 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477411.629064:0:6999:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d41647800/0xafddb3c8f9281d03 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477411.629071:0:6999:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d41647800/0xafddb3c8f9281d03 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477411.629077:0:6999:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d0d41647800 already unused, calling callback (ffffffffc1fd54f0) 00010000:00010000:2.0:1789477411.629080:0:6999:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d41647800/0xafddb3c8f9281d03 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477411.629086:0:6999:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d41647800/0xafddb3c8f9281d03 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477411.629091:0:6999:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9d0d50919f00) 00010000:00010000:2.0:1789477411.629094:0:6999:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789477411.629096:0:6999:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d41647800/0xafddb3c8f9281d03 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477411.629110:0:6999:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d41647800/0xafddb3c8f9281d03 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477411.629128:0:6999:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d41647a00/0xafddb3c8f9281d0a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477411.629135:0:6999:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d41647a00/0xafddb3c8f9281d0a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477411.629142:0:6999:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d41647a00/0xafddb3c8f9281d0a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477411.629146:0:6999:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d0d41647a00 already unused, calling callback (ffffffffc1fd54f0) 00010000:00010000:2.0:1789477411.629149:0:6999:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d41647a00/0xafddb3c8f9281d0a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477411.629167:0:6999:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d41647a00/0xafddb3c8f9281d0a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477411.629176:0:6999:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9d0d44568400) 00010000:00010000:2.0:1789477411.629179:0:6999:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789477411.629182:0:6999:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d41647a00/0xafddb3c8f9281d0a lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477411.629188:0:6999:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d41647a00/0xafddb3c8f9281d0a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789477411.629279:0:6999:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d58073100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9bc33f26-0aab-4a14-832f-c58d566de1b0+27:10480:x1876402783696256:12345-192.168.201.23@tcp:34:lfs.0 Request processed in 1213us (1442us total) trans 0 rc 0/0 00000100:00100000:2.0:1789477411.629289:0:6999:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 91 00000100:00100000:1.0:1789477411.661044:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:0.0:1789477411.661378:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783696512 00000100:00100000:0.0:1789477411.661392:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783696512 00000100:00100000:0.0:1789477411.661684:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 92 00000100:00100000:0.0:1789477411.661698:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d58071c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9bc33f26-0aab-4a14-832f-c58d566de1b0+27:10483:x1876402783696512:12345-192.168.201.23@tcp:101:lfs.0 00010000:00010000:0.0:1789477411.661725:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789477411.661752:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be4600/0xafddb3c8f9281d11 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa90d500d7b8f2bca expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477411.661857:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be5600/0xafddb3c8f9281d18 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477411.661876:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be5600/0xafddb3c8f9281d18 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477411.661890:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be5600/0xafddb3c8f9281d18 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477411.661931:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be5000/0xafddb3c8f9281d1f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477411.661939:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be5000/0xafddb3c8f9281d1f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477411.661946:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be5000/0xafddb3c8f9281d1f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477411.662829:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be5a00/0xafddb3c8f9281d26 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477411.662846:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be5a00/0xafddb3c8f9281d26 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477411.662856:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be5a00/0xafddb3c8f9281d26 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789477411.662869:0:5845:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:0.0:1789477411.662999:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be5600/0xafddb3c8f9281d18 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477411.663007:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be5600/0xafddb3c8f9281d18 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477411.663016:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be5600/0xafddb3c8f9281d18 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477411.663024:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d0d50be5600 already unused, calling callback (ffffffffc1fd54f0) 00010000:00010000:0.0:1789477411.663030:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be5600/0xafddb3c8f9281d18 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477411.663050:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be5600/0xafddb3c8f9281d18 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477411.665301:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9d0d5b9f4000) 00010000:00010000:0.0:1789477411.665315:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789477411.665324:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be5600/0xafddb3c8f9281d18 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477411.665335:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be5600/0xafddb3c8f9281d18 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477411.665365:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be5000/0xafddb3c8f9281d1f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477411.665371:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be5000/0xafddb3c8f9281d1f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477411.665379:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be5000/0xafddb3c8f9281d1f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477411.665385:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d0d50be5000 already unused, calling callback (ffffffffc1fd54f0) 00010000:00010000:0.0:1789477411.665389:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be5000/0xafddb3c8f9281d1f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477411.665398:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be5000/0xafddb3c8f9281d1f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477411.665415:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9d0d596aed00) 00010000:00010000:0.0:1789477411.665418:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789477411.665421:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be5000/0xafddb3c8f9281d1f lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477411.665455:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be5000/0xafddb3c8f9281d1f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477411.666370:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be4600/0xafddb3c8f9281d11 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2bca expref: 30 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477411.666401:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be5a00/0xafddb3c8f9281d26 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2bca expref: 29 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477411.666411:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9d0d44568400) 00010000:00010000:2.0:1789477411.666414:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1789477411.666418:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d0d50be5a00, rc 0) 00000100:00100000:2.0:1789477411.666547:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d58071c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9bc33f26-0aab-4a14-832f-c58d566de1b0+29:10483:x1876402783696512:12345-192.168.201.23@tcp:101:lfs.0 Request processed in 4850us (5515us total) trans 4294967370 rc 0/0 00000100:00100000:2.0:1789477411.666557:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 92 00000100:00100000:0.0:1789477411.669766:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:2.0:1789477411.669886:0:6999:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783696640 00000100:00100000:2.0:1789477411.669899:0:6999:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783696640 00000100:00100000:2.0:1789477411.669968:0:6999:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 93 00000100:00100000:2.0:1789477411.669980:0:6999:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d7c64df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9bc33f26-0aab-4a14-832f-c58d566de1b0+29:10483:x1876402783696640:12345-192.168.201.23@tcp:54:lfs.0 00010000:00010000:2.0:1789477411.670085:0:6999:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d41647a00/0xafddb3c8f9281d34 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477411.670106:0:6999:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be5200/0xafddb3c8f9281cd9 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2bb5 expref: 29 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477411.670117:0:6999:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d41647a00/0xafddb3c8f9281d34 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477411.670169:0:6999:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be5200/0xafddb3c8f9281cd9 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2bb5 expref: 29 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477411.670187:0:6999:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be5200/0xafddb3c8f9281cd9 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2bb5 expref: 29 pid: 5845 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789477411.670222:0:6999:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d50b07100 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6999:1876402802590848:192.168.201.23@tcp:104: 00000100:00100000:2.0:1789477411.670338:0:6999:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d0d43921540 going to sleep for 11 seconds 00000100:00100000:0.0:1789477411.674453:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:1.0:1789477411.675011:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783696896 00000100:00100000:1.0:1789477411.675024:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783696896 00000100:00100000:1.0:1789477411.675111:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 22 00000100:00100000:1.0:1789477411.675122:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d7c64fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9bc33f26-0aab-4a14-832f-c58d566de1b0+30:5605:x1876402783696896:12345-192.168.201.23@tcp:35:ldlm_bl.0 00000001:00080000:1.0:1789477411.675480:0:5847:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967371 00000100:00100000:1.0:1789477411.675657:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d7c64fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9bc33f26-0aab-4a14-832f-c58d566de1b0+32:5605:x1876402783696896:12345-192.168.201.23@tcp:35:ldlm_bl.0 Request processed in 535us (1217us total) trans 4294967372 rc 0/0 00000100:00100000:1.0:1789477411.675666:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 22 00000020:00080000:1.0:1789477411.675672:0:5847:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1789477411.675809:0:6999:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d50b07100 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6999:1876402802590848:192.168.201.23@tcp:104: 00010000:00010000:2.0:1789477411.675842:0:6999:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d41647a00/0xafddb3c8f9281d34 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789477411.679897:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:0.0:1789477411.679985:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783697024 00000100:00100000:0.0:1789477411.679999:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783697024 00010000:00010000:0.0:1789477411.680055:0:5829:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be5200/0xafddb3c8f9281cd9 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2bb5 expref: 32 pid: 5845 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789477411.680107:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 48 00000100:00100000:0.0:1789477411.680118:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d58072a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9bc33f26-0aab-4a14-832f-c58d566de1b0+32:2354:x1876402783697024:12345-192.168.201.23@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789477411.680137:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789477411.680145:0:5829:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be5200/0xafddb3c8f9281cd9 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2bb5 expref: 32 pid: 5845 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477411.680174:0:5829:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be5200/0xafddb3c8f9281cd9 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2bb5 expref: 32 pid: 5845 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477411.680201:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be5200/0xafddb3c8f9281cd9 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2bb5 expref: 32 pid: 5845 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477411.680222:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9d0d44568400) 00010000:00010000:0.0:1789477411.680227:0:5829:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d41647a00/0xafddb3c8f9281d34 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477411.680238:0:5829:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d41647a00/0xafddb3c8f9281d34 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477411.680262:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d41647a00/0xafddb3c8f9281d34 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477411.680298:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789477411.680864:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d58072a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9bc33f26-0aab-4a14-832f-c58d566de1b0+31:2354:x1876402783697024:12345-192.168.201.23@tcp:103:ldlm_bl.0 Request processed in 744us (983us total) trans 0 rc 0/0 00000100:00100000:0.0:1789477411.680874:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 48 00010000:00010000:2.0:1789477411.681176:0:6999:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d41647a00/0xafddb3c8f9281d34 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477411.681188:0:6999:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d41647a00/0xafddb3c8f9281d34 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477411.681230:0:6999:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d41647a00/0xafddb3c8f9281d34 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477411.681239:0:6999:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d41647a00/0xafddb3c8f9281d34 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477411.681247:0:6999:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d41647a00/0xafddb3c8f9281d34 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477411.681254:0:6999:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d0d41647a00 already unused, calling callback (ffffffffc1fd54f0) 00010000:00010000:2.0:1789477411.681259:0:6999:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d41647a00/0xafddb3c8f9281d34 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477411.681268:0:6999:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d41647a00/0xafddb3c8f9281d34 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477411.681282:0:6999:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9d0d44568400) 00010000:00010000:2.0:1789477411.681296:0:6999:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789477411.681300:0:6999:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d41647a00/0xafddb3c8f9281d34 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477411.681307:0:6999:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d41647a00/0xafddb3c8f9281d34 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789477411.681374:0:6999:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d7c64df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9bc33f26-0aab-4a14-832f-c58d566de1b0+30:10483:x1876402783696640:12345-192.168.201.23@tcp:54:lfs.0 Request processed in 11395us (11621us total) trans 0 rc 0/0 00000100:00100000:2.0:1789477411.681383:0:6999:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 93 00000100:00100000:1.0:1789477411.689344:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:0.0:1789477411.689435:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783697280 00000100:00100000:0.0:1789477411.689450:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783697280 00000100:00100000:0.0:1789477411.689880:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 23 00000100:00100000:0.0:1789477411.689893:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d58070380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9bc33f26-0aab-4a14-832f-c58d566de1b0+30:10483:x1876402783697280:12345-192.168.201.23@tcp:35:lfs.0 00000100:00100000:0.0:1789477411.690219:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d58070380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9bc33f26-0aab-4a14-832f-c58d566de1b0+31:10483:x1876402783697280:12345-192.168.201.23@tcp:35:lfs.0 Request processed in 328us (891us total) trans 4294967373 rc 0/0 00000100:00100000:0.0:1789477411.690227:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 23 00000100:00100000:0.0:1789477411.762322:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:2.0:1789477411.763136:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783697536 00000100:00100000:2.0:1789477411.763168:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783697536 00000100:00100000:2.0:1789477411.763326:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 94 00000100:00100000:2.0:1789477411.763340:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d7c64e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9bc33f26-0aab-4a14-832f-c58d566de1b0+31:10494:x1876402783697536:12345-192.168.201.23@tcp:101:cat.0 00010000:00010000:2.0:1789477411.763375:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789477411.763405:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d41647a00/0xafddb3c8f9281d3b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa90d500d7b8f2bd1 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477411.763525:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d41646a00/0xafddb3c8f9281d42 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477411.763547:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d41646a00/0xafddb3c8f9281d42 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477411.763561:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d41646a00/0xafddb3c8f9281d42 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477411.763626:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d41647800/0xafddb3c8f9281d49 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477411.763634:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d41647800/0xafddb3c8f9281d49 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477411.763661:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d41647800/0xafddb3c8f9281d49 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477411.764058:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d41647000/0xafddb3c8f9281d50 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477411.764068:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d41647000/0xafddb3c8f9281d50 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477411.764076:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d41647000/0xafddb3c8f9281d50 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789477411.764087:0:5846:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 8 00010000:00010000:2.0:1789477411.764221:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d41646a00/0xafddb3c8f9281d42 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477411.764231:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d41646a00/0xafddb3c8f9281d42 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477411.764237:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d41646a00/0xafddb3c8f9281d42 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477411.764244:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d0d41646a00 already unused, calling callback (ffffffffc1fd54f0) 00010000:00010000:2.0:1789477411.764249:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d41646a00/0xafddb3c8f9281d42 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477411.764258:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d41646a00/0xafddb3c8f9281d42 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477411.764272:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9d0d5b9f4000) 00010000:00010000:2.0:1789477411.764276:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789477411.764289:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d41646a00/0xafddb3c8f9281d42 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477411.764296:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d41646a00/0xafddb3c8f9281d42 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477411.764310:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d41647800/0xafddb3c8f9281d49 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477411.764316:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d41647800/0xafddb3c8f9281d49 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477411.764322:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d41647800/0xafddb3c8f9281d49 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477411.764327:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d0d41647800 already unused, calling callback (ffffffffc1fd54f0) 00010000:00010000:2.0:1789477411.764331:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d41647800/0xafddb3c8f9281d49 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477411.764337:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d41647800/0xafddb3c8f9281d49 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477411.764346:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9d0d50919f00) 00010000:00010000:2.0:1789477411.764348:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789477411.764351:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d41647800/0xafddb3c8f9281d49 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477411.764358:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d41647800/0xafddb3c8f9281d49 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477411.764414:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d41647a00/0xafddb3c8f9281d3b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2bd1 expref: 34 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477411.764444:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d41647000/0xafddb3c8f9281d50 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2bd1 expref: 33 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477411.764452:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9d0d44568400) 00010000:00010000:2.0:1789477411.764454:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789477411.764457:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d0d41647000, rc 0) 00000100:00100000:2.0:1789477411.764541:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d7c64e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9bc33f26-0aab-4a14-832f-c58d566de1b0+33:10494:x1876402783697536:12345-192.168.201.23@tcp:101:cat.0 Request processed in 1205us (2236us total) trans 4294967374 rc 0/0 00000100:00100000:2.0:1789477411.764550:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 94 00000100:00100000:2.0:1789477411.768886:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:1.0:1789477411.769008:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783697792 00000100:00100000:1.0:1789477411.769022:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783697792 00000100:00100000:1.0:1789477411.769108:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 24 00000100:00100000:1.0:1789477411.769121:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d50b07100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9bc33f26-0aab-4a14-832f-c58d566de1b0+33:10494:x1876402783697792:12345-192.168.201.23@tcp:35:cat.0 00000100:00100000:1.0:1789477411.769890:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d50b07100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9bc33f26-0aab-4a14-832f-c58d566de1b0+34:10494:x1876402783697792:12345-192.168.201.23@tcp:35:cat.0 Request processed in 764us (1210us total) trans 4294967375 rc 0/0 00000100:00100000:1.0:1789477411.769903:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 24 00000100:00100000:1.0:1789477411.786149:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:3.0:1789477411.786283:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783698048 00000100:00100000:3.0:1789477411.786297:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783698048 00000100:00100000:3.0:1789477411.786368:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 95 00000100:00100000:3.0:1789477411.786380:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d58073480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9bc33f26-0aab-4a14-832f-c58d566de1b0+34:10495:x1876402783698048:12345-192.168.201.23@tcp:36:rm.0 00010000:00010000:3.0:1789477411.786468:0:5844:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:3.0:1789477411.786525:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d41647000/0xafddb3c8f9281d50 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2bd1 expref: 34 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477411.786554:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be5a00/0xafddb3c8f9281d26 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2bca expref: 33 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477411.786571:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d59d6b400/0xafddb3c8f9281cee lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2bbc expref: 32 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477411.786644:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9d0d44568400) 00010000:00010000:3.0:1789477411.786658:0:5844:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789477411.786681:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d59d6a800/0xafddb3c8f9281d5e lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477411.786695:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d59d6a800/0xafddb3c8f9281d5e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477411.786732:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d59d6a800/0xafddb3c8f9281d5e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477411.786748:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d59d6a400/0xafddb3c8f9281d65 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477411.786756:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d59d6a400/0xafddb3c8f9281d65 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477411.786763:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d59d6a400/0xafddb3c8f9281d65 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477411.787107:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d59d6b600/0xafddb3c8f9281d6c lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477411.787115:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d59d6b600/0xafddb3c8f9281d6c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477411.787123:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d59d6b600/0xafddb3c8f9281d6c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1789477411.787787:0:5844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].4, 64 off8472 00000004:00080000:3.0:1789477411.787797:0:5844:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 356859218143ns, next at 357859215705ns, rc = 0 00010000:00010000:3.0:1789477411.787855:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49ecbc00/0xafddb3c8f9281d73 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477411.787863:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49ecbc00/0xafddb3c8f9281d73 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477411.787870:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49ecbc00/0xafddb3c8f9281d73 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477411.787884:0:5844:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49ecbc00/0xafddb3c8f9281d73 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477411.787889:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49ecbc00/0xafddb3c8f9281d73 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477411.787893:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49ecbc00/0xafddb3c8f9281d73 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477411.787911:0:5844:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789477411.787932:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d59d6b600/0xafddb3c8f9281d6c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477411.787936:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d59d6b600/0xafddb3c8f9281d6c lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477411.787940:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d59d6b600/0xafddb3c8f9281d6c lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477411.787945:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d0d59d6b600 already unused, calling callback (ffffffffc1fd54f0) 00010000:00010000:3.0:1789477411.787949:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d59d6b600/0xafddb3c8f9281d6c lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477411.787954:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d59d6b600/0xafddb3c8f9281d6c lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477411.787957:0:5832:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789477411.787963:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9d0d44568300) 00010000:00010000:3.0:1789477411.787966:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1789477411.787967:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49ecbc00/0xafddb3c8f9281d73 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477411.787969:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d59d6b600/0xafddb3c8f9281d6c lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477411.787985:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d0d49ecbc00 already unused, calling callback (ffffffffc15972a0) 00010000:00010000:2.0:1789477411.787992:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49ecbc00/0xafddb3c8f9281d73 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477411.787994:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d59d6b600/0xafddb3c8f9281d6c lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477411.788009:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49ecbc00/0xafddb3c8f9281d73 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477411.788021:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9d0d44568300) 00010000:00010000:3.0:1789477411.788023:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d59d6a800/0xafddb3c8f9281d5e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477411.788024:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1789477411.788030:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49ecbc00/0xafddb3c8f9281d73 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477411.788032:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d59d6a800/0xafddb3c8f9281d5e lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477411.788049:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d59d6a800/0xafddb3c8f9281d5e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477411.788049:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49ecbc00/0xafddb3c8f9281d73 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477411.788063:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d0d59d6a800 already unused, calling callback (ffffffffc1fd54f0) 00010000:00010000:3.0:1789477411.788065:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d59d6a800/0xafddb3c8f9281d5e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477411.788071:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d59d6a800/0xafddb3c8f9281d5e lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477411.788090:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9d0d5b9f4000) 00010000:00010000:3.0:1789477411.788093:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789477411.788096:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d59d6a800/0xafddb3c8f9281d5e lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477411.788098:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789477411.788102:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789477411.788105:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789477411.788106:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d59d6a800/0xafddb3c8f9281d5e lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789477411.788121:0:5844:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000006d938bd9 reply state 00000000e44a2030 transno 4294967376 ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d59d6a400/0xafddb3c8f9281d65 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789477411.788130:0:5844:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789477411.788242:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d58073480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9bc33f26-0aab-4a14-832f-c58d566de1b0+33:10495:x1876402783698048:12345-192.168.201.23@tcp:36:rm.0 Request processed in 1861us (2105us total) trans 4294967376 rc 0/0 00000100:00100000:3.0:1789477411.788249:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 95 00010000:00010000:3.0:1789477411.790085:0:3296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d59d6a400/0xafddb3c8f9281d65 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477411.790145:0:3296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d59d6a400/0xafddb3c8f9281d65 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477411.790168:0:3296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d59d6a400/0xafddb3c8f9281d65 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477411.790175:0:3296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d0d59d6a400 already unused, calling callback (ffffffffc1fd54f0) 00010000:00010000:3.0:1789477411.790181:0:3296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d59d6a400/0xafddb3c8f9281d65 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477411.790191:0:3296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d59d6a400/0xafddb3c8f9281d65 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477411.790213:0:3296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9d0d44568e00) 00010000:00010000:3.0:1789477411.790216:0:3296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789477411.790221:0:3296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d59d6a400/0xafddb3c8f9281d65 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477411.790227:0:3296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d59d6a400/0xafddb3c8f9281d65 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789477411.842076:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:0.0:1789477411.847085:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783698304 00000100:00100000:0.0:1789477411.847107:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783698304 00000100:00100000:1.0:1789477411.847292:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 96 00000100:00100000:1.0:1789477411.847306:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d58070700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9bc33f26-0aab-4a14-832f-c58d566de1b0+32:10501:x1876402783698304:12345-192.168.201.23@tcp:101:bash.0 00010000:00010000:1.0:1789477411.847343:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789477411.847373:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f518800/0xafddb3c8f9281d7a lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa90d500d7b8f2bd8 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477411.847805:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f519800/0xafddb3c8f9281d81 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477411.847825:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f519800/0xafddb3c8f9281d81 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477411.847840:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f519800/0xafddb3c8f9281d81 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477411.847862:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f518a00/0xafddb3c8f9281d88 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477411.847893:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f518a00/0xafddb3c8f9281d88 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477411.847901:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f518a00/0xafddb3c8f9281d88 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1789477411.848618:0:5845:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x3:0x0], index 0: 0 00010000:00010000:1.0:1789477411.849470:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f518000/0xafddb3c8f9281d8f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477411.849625:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f518000/0xafddb3c8f9281d8f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477411.849638:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f518000/0xafddb3c8f9281d8f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477411.850175:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f519800/0xafddb3c8f9281d81 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477411.850187:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f519800/0xafddb3c8f9281d81 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477411.850196:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f519800/0xafddb3c8f9281d81 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477411.850204:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d0d7f519800 already unused, calling callback (ffffffffc1fd54f0) 00010000:00010000:1.0:1789477411.850210:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f519800/0xafddb3c8f9281d81 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477411.850220:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f519800/0xafddb3c8f9281d81 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477411.850257:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9d0d5b9f4000) 00010000:00010000:1.0:1789477411.850261:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789477411.850267:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f519800/0xafddb3c8f9281d81 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477411.850274:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f519800/0xafddb3c8f9281d81 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789477411.850292:0:5845:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000d0f9851f reply state 000000003ec1a54c transno 4294967377 ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f518a00/0xafddb3c8f9281d88 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789477411.850303:0:5845:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1789477411.850346:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f518800/0xafddb3c8f9281d7a lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2bd8 expref: 35 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477411.850363:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f518000/0xafddb3c8f9281d8f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2bd8 expref: 34 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477411.850372:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9d0d5b9f4700) 00010000:00010000:1.0:1789477411.850375:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789477411.850377:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d0d7f518000, rc 0) 00000100:00100000:1.0:1789477411.850789:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d58070700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9bc33f26-0aab-4a14-832f-c58d566de1b0+35:10501:x1876402783698304:12345-192.168.201.23@tcp:101:bash.0 Request processed in 3483us (8727us total) trans 4294967377 rc 0/0 00000100:00100000:1.0:1789477411.850799:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 96 00000100:00100000:3.0:1789477411.858042:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00010000:00010000:1.0:1789477411.858129:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f518a00/0xafddb3c8f9281d88 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477411.858145:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f518a00/0xafddb3c8f9281d88 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477411.858188:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f518a00/0xafddb3c8f9281d88 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477411.858196:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d0d7f518a00 already unused, calling callback (ffffffffc1fd54f0) 00010000:00010000:1.0:1789477411.858202:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f518a00/0xafddb3c8f9281d88 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477411.858211:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f518a00/0xafddb3c8f9281d88 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477411.858235:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9d0d5b9f4e00) 00010000:00010000:1.0:1789477411.858238:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789477411.858243:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f518a00/0xafddb3c8f9281d88 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477411.858250:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f518a00/0xafddb3c8f9281d88 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789477411.858829:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783698432 00000100:00100000:2.0:1789477411.858846:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783698432 00000100:00100000:2.0:1789477411.858955:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 35 00000100:00100000:2.0:1789477411.858971:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d74aaad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9bc33f26-0aab-4a14-832f-c58d566de1b0+7:2353:x1876402783698432:12345-192.168.201.23@tcp:101:bash.0 00010000:00010000:2.0:1789477411.858995:0:6697:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789477411.859018:0:6697:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000025858e8c/0xafddb3c8f9281d9d lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa90d500d7b8f2bdf expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789477411.859056:0:6697:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789477411.859085:0:6697:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=356s v=(0 0) 00010000:00010000:2.0:1789477411.859091:0:6697:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789477411.859103:0:6697:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000025858e8c/0xafddb3c8f9281d9d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2bdf expref: 8 pid: 6697 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477411.859127:0:6697:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000025858e8c/0xafddb3c8f9281d9d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2bdf expref: 8 pid: 6697 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477411.859143:0:6697:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d0d41646a00, rc 0) 00000100:00100000:2.0:1789477411.859251:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d74aaad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9bc33f26-0aab-4a14-832f-c58d566de1b0+8:2353:x1876402783698432:12345-192.168.201.23@tcp:101:bash.0 Request processed in 285us (1224us total) trans 0 rc 0/0 00000100:00100000:2.0:1789477411.859260:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 35 00000100:00080000:1.0:1789477411.859347:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789477411.862312:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:0.0:1789477411.862411:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783698560 00000100:00100000:0.0:1789477411.862425:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783698560 00000100:00100000:0.0:1789477411.862502:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 36 00000100:00100000:0.0:1789477411.862515:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d50b05180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9bc33f26-0aab-4a14-832f-c58d566de1b0+8:10501:x1876402783698560:12345-192.168.201.23@tcp:101:bash.0 00010000:00010000:0.0:1789477411.862538:0:6696:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789477411.862562:0:6696:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b30f7eb3/0xafddb3c8f9281da4 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa90d500d7b8f2be6 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477411.862639:0:6696:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000025858e8c/0xafddb3c8f9281d9d lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2bdf expref: 9 pid: 6697 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477411.862678:0:6696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789477411.862683:0:6696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789477411.862690:0:6696:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b30f7eb3/0xafddb3c8f9281da4 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2be6 expref: 9 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477411.862734:0:6696:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000025858e8c/0xafddb3c8f9281d9d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2bdf expref: 9 pid: 6697 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477411.862751:0:6696:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000025858e8c/0xafddb3c8f9281d9d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2bdf expref: 9 pid: 6697 timeout: 456 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789477411.862769:0:6696:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d7c64d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6696:1876402802590976:192.168.201.23@tcp:104: 00000100:00100000:0.0:1789477411.862885:0:6696:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d0d510abc00 going to sleep for 11 seconds 00000100:00100000:0.0:1789477411.869267:0:6696:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d7c64d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6696:1876402802590976:192.168.201.23@tcp:104: 00010000:00010000:0.0:1789477411.869326:0:6696:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000b30f7eb3/0xafddb3c8f9281da4 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2be6 expref: 9 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477411.869357:0:6696:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d0d50be5600, rc 0) 00000100:00100000:0.0:1789477411.869442:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d50b05180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9bc33f26-0aab-4a14-832f-c58d566de1b0+9:10501:x1876402783698560:12345-192.168.201.23@tcp:101:bash.0 Request processed in 6928us (7144us total) trans 0 rc 0/0 00000100:00100000:0.0:1789477411.869453:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 36 00000100:00100000:3.0:1789477411.870082:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:3.0:1789477411.870126:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783698688 00000100:00100000:3.0:1789477411.870135:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783698688 00010000:00010000:3.0:1789477411.870189:0:5830:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000025858e8c/0xafddb3c8f9281d9d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2bdf expref: 9 pid: 6697 timeout: 456 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789477411.870253:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 49 00000100:00100000:3.0:1789477411.870265:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d50a82850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9bc33f26-0aab-4a14-832f-c58d566de1b0+9:2354:x1876402783698688:12345-192.168.201.23@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789477411.870287:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789477411.870317:0:5830:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000025858e8c/0xafddb3c8f9281d9d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2bdf expref: 9 pid: 6697 timeout: 456 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477411.870331:0:5830:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000025858e8c/0xafddb3c8f9281d9d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2bdf expref: 9 pid: 6697 timeout: 456 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477411.870362:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000025858e8c/0xafddb3c8f9281d9d lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2bdf expref: 9 pid: 6697 timeout: 456 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477411.870383:0:5830:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789477411.870388:0:5830:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789477411.870399:0:5830:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000b30f7eb3/0xafddb3c8f9281da4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2be6 expref: 8 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477411.870413:0:5830:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b30f7eb3/0xafddb3c8f9281da4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2be6 expref: 8 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477411.870463:0:5830:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000b30f7eb3/0xafddb3c8f9281da4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2be6 expref: 8 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789477411.870496:0:5830:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d74aa9880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:5830:1876402802591104:192.168.201.23@tcp:105: 00000100:00100000:3.0:1789477411.870619:0:5830:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d0d44480540 going to sleep for 11 seconds 00000100:00100000:1.0:1789477411.874761:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:3.0:1789477411.874949:0:5830:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d74aa9880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:5830:1876402802591104:192.168.201.23@tcp:105: 00010000:00010000:3.0:1789477411.874981:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789477411.875045:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d50a82850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9bc33f26-0aab-4a14-832f-c58d566de1b0+8:2354:x1876402783698688:12345-192.168.201.23@tcp:103:ldlm_bl.0 Request processed in 4782us (4966us total) trans 0 rc 0/0 00000100:00100000:3.0:1789477411.875059:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 49 00000100:00100000:0.0:1789477411.875244:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783698944 00000100:00100000:0.0:1789477411.875253:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783698944 00000100:00100000:0.0:1789477411.875311:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 25 00000100:00100000:0.0:1789477411.875339:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d58070000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9bc33f26-0aab-4a14-832f-c58d566de1b0+34:10501:x1876402783698944:12345-192.168.201.23@tcp:35:bash.0 00000100:00100000:0.0:1789477411.875993:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d58070000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9bc33f26-0aab-4a14-832f-c58d566de1b0+35:10501:x1876402783698944:12345-192.168.201.23@tcp:35:bash.0 Request processed in 651us (1241us total) trans 4294967378 rc 0/0 00000100:00100000:0.0:1789477411.876002:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 25 00000100:00100000:2.0:1789477411.999469:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:1.0:1789477411.999827:0:6999:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783699072 00000100:00100000:1.0:1789477411.999843:0:6999:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783699072 00000100:00100000:1.0:1789477411.999926:0:6999:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 97 00000100:00100000:1.0:1789477411.999941:0:6999:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d50b04700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9bc33f26-0aab-4a14-832f-c58d566de1b0+35:10517:x1876402783699072:12345-192.168.201.23@tcp:101:lfs.0 00010000:00010000:1.0:1789477411.999985:0:6999:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789477412.000021:0:6999:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f519800/0xafddb3c8f9281dab lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa90d500d7b8f2bed expref: -99 pid: 6999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477412.000161:0:6999:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f518e00/0xafddb3c8f9281db2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477412.000189:0:6999:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f518e00/0xafddb3c8f9281db2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477412.000207:0:6999:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f518e00/0xafddb3c8f9281db2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789477412.000307:0:6999:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 7680 00000004:00200000:1.0:1789477412.000311:0:6999:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:1.0:1789477412.000342:0:6999:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f518e00/0xafddb3c8f9281db2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477412.000375:0:6999:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f519800/0xafddb3c8f9281dab lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2bed expref: 37 pid: 6999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477412.000396:0:6999:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f518e00/0xafddb3c8f9281db2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2bed expref: 36 pid: 6999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477412.000409:0:6999:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9d0d5b9f4000) 00010000:00010000:1.0:1789477412.000412:0:6999:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789477412.000417:0:6999:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d0d7f518e00, rc 0) 00000100:00100000:1.0:1789477412.000513:0:6999:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d50b04700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9bc33f26-0aab-4a14-832f-c58d566de1b0+36:10517:x1876402783699072:12345-192.168.201.23@tcp:101:lfs.0 Request processed in 576us (1063us total) trans 0 rc 0/0 00000100:00100000:1.0:1789477412.000522:0:6999:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 97 00000100:00100000:1.0:1789477412.009482:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:2.0:1789477412.009749:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783699328 00000100:00100000:2.0:1789477412.009762:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783699328 00000100:00100000:2.0:1789477412.009873:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 98 00000100:00100000:2.0:1789477412.009888:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d58071880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9bc33f26-0aab-4a14-832f-c58d566de1b0+36:10517:x1876402783699328:12345-192.168.201.23@tcp:101:lfs.0 00010000:00010000:2.0:1789477412.009921:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789477412.009953:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d41647000/0xafddb3c8f9281db9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa90d500d7b8f2bf4 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477412.010129:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d41647a00/0xafddb3c8f9281dc0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477412.010147:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d41647a00/0xafddb3c8f9281dc0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477412.010179:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d41647a00/0xafddb3c8f9281dc0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789477412.010195:0:5846:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:2.0:1789477412.010404:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d41647000/0xafddb3c8f9281db9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2bf4 expref: 39 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477412.010427:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d41647a00/0xafddb3c8f9281dc0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2bf4 expref: 38 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477412.010437:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9d0d5b9f4700) 00010000:00010000:2.0:1789477412.010440:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789477412.010443:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d0d41647a00, rc 0) 00000100:00100000:2.0:1789477412.010540:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d58071880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9bc33f26-0aab-4a14-832f-c58d566de1b0+38:10517:x1876402783699328:12345-192.168.201.23@tcp:101:lfs.0 Request processed in 656us (1085us total) trans 4294967379 rc 0/0 00000100:00100000:2.0:1789477412.010573:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 98 00000100:00080000:1.0:1789477412.010707:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789477412.013446:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:3.0:1789477412.013509:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:0.0:1789477412.013540:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783699456 00000100:00100000:0.0:1789477412.013566:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783699456 00000100:00100000:2.0:1789477412.013778:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783699712 00000100:00100000:2.0:1789477412.013786:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783699712 00000100:00100000:2.0:1789477412.013883:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 99 00000100:00100000:2.0:1789477412.013900:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d74aa9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9bc33f26-0aab-4a14-832f-c58d566de1b0+39:10517:x1876402783699712:12345-192.168.201.23@tcp:101:lfs.0 00010000:00010000:2.0:1789477412.013945:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789477412.013987:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d41646a00/0xafddb3c8f9281dce lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa90d500d7b8f2bfb expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477412.014183:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d41647800/0xafddb3c8f9281dd5 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477412.014210:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d41647800/0xafddb3c8f9281dd5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477412.014229:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d41647800/0xafddb3c8f9281dd5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789477412.014247:0:5844:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:2.0:1789477412.014439:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d41646a00/0xafddb3c8f9281dce lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2bfb expref: 42 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477412.014462:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d41647800/0xafddb3c8f9281dd5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2bfb expref: 41 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477412.014486:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9d0d5b9f4700) 00010000:00010000:2.0:1789477412.014489:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1789477412.014493:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d0d41647800, rc 0) 00000100:00100000:2.0:1789477412.014629:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d74aa9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9bc33f26-0aab-4a14-832f-c58d566de1b0+41:10517:x1876402783699712:12345-192.168.201.23@tcp:101:lfs.0 Request processed in 732us (1118us total) trans 4294967380 rc 0/0 00000100:00100000:2.0:1789477412.014638:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 99 00000100:00100000:0.0:1789477412.015072:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 6 00000100:00100000:0.0:1789477412.015082:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d74aaa300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9bc33f26-0aab-4a14-832f-c58d566de1b0+40:2353:x1876402783699456:12345-192.168.201.23@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789477412.015096:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789477412.015114:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d41647a00/0xafddb3c8f9281dc0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2bf4 expref: 40 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477412.015128:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9d0d5b9f4700) 00010000:00010000:0.0:1789477412.015132:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789477412.015174:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d74aaa300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9bc33f26-0aab-4a14-832f-c58d566de1b0+39:2353:x1876402783699456:12345-192.168.201.23@tcp:103:ldlm_bl.0 Request processed in 95us (1743us total) trans 0 rc 0/0 00000100:00100000:0.0:1789477412.015181:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 6 00000100:00100000:3.0:1789477412.019304:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:2.0:1789477412.019885:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783699840 00000100:00100000:2.0:1789477412.019900:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783699840 00000100:00100000:2.0:1789477412.019976:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 37 00000100:00100000:2.0:1789477412.019990:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d74aa9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9bc33f26-0aab-4a14-832f-c58d566de1b0+8:2353:x1876402783699840:12345-192.168.201.23@tcp:1:lfs.0 00010000:00010000:2.0:1789477412.020061:0:6697:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003a23395b/0xafddb3c8f9281de3 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477412.020091:0:6697:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000b30f7eb3/0xafddb3c8f9281da4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2be6 expref: 8 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477412.020102:0:6697:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x3:0x0].0x0 since=1s v=(0 0) 00010000:00010000:2.0:1789477412.020108:0:6697:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789477412.020114:0:6697:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003a23395b/0xafddb3c8f9281de3 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477412.020179:0:6697:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000b30f7eb3/0xafddb3c8f9281da4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2be6 expref: 8 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477412.020197:0:6697:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000b30f7eb3/0xafddb3c8f9281da4 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2be6 expref: 8 pid: 6696 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789477412.020215:0:6697:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d50b07800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6697:1876402802591232:192.168.201.23@tcp:104: 00000100:00100000:2.0:1789477412.020358:0:6697:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d0d47536240 going to sleep for 11 seconds 00000100:00100000:2.0:1789477412.030139:0:6697:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d50b07800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6697:1876402802591232:192.168.201.23@tcp:104: 00010000:00010000:2.0:1789477412.030200:0:6697:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000003a23395b/0xafddb3c8f9281de3 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789477412.035130:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:0.0:1789477412.036970:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783699968 00000100:00100000:0.0:1789477412.036999:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783699968 00002000:00100000:0.0:1789477412.037097:0:6701:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x3:0x0] (0->8) req@ffff9d0d6d464700 x1876402783699968/t0(0) o4->9bc33f26-0aab-4a14-832f-c58d566de1b0@192.168.201.23@tcp:583/0 lens 504/0 e 0 to 0 dl 1789477423 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789477412.037111:0:6701:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9d0d6d464700 with x1876402783699968 ext(0->8) 00010000:00010000:0.0:1789477412.037127:0:6701:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000b30f7eb3/0xafddb3c8f9281da4 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2be6 expref: 9 pid: 6696 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477412.037166:0:6701:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000b30f7eb3/0xafddb3c8f9281da4 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2be6 expref: 9 pid: 6696 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789477412.037200:0:6701:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff9d0d6d464700 00000100:00100000:0.0:1789477412.037464:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 1 00000100:00100000:0.0:1789477412.037490:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d6d464700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:9bc33f26-0aab-4a14-832f-c58d566de1b0+9:2355:x1876402783699968:12345-192.168.201.23@tcp:4:lfs.0 00000100:00100000:0.0:1789477412.038307:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d6d464700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:9bc33f26-0aab-4a14-832f-c58d566de1b0+11:2355:x1876402783699968:12345-192.168.201.23@tcp:4:lfs.0 Request processed in 826us (3192us total) trans 4294967302 rc 0/0 00000100:00100000:0.0:1789477412.038318:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 1 00002000:00100000:0.0:1789477412.038329:0:6701:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x3:0x0] (0->8) req@ffff9d0d6d464700 x1876402783699968/t4294967302(0) o4->9bc33f26-0aab-4a14-832f-c58d566de1b0@192.168.201.23@tcp:583/0 lens 504/448 e 0 to 0 dl 1789477423 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789477412.038349:0:6701:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9d0d6d464700 with x1876402783699968 ext(0->8) 00010000:00010000:0.0:1789477412.038357:0:6701:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000b30f7eb3/0xafddb3c8f9281da4 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2be6 expref: 11 pid: 6696 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477412.038374:0:6701:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000b30f7eb3/0xafddb3c8f9281da4 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2be6 expref: 11 pid: 6696 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789477412.038382:0:6701:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff9d0d6d464700 00000100:00100000:0.0:1789477412.050374:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:3.0:1789477412.050634:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783700096 00000100:00100000:3.0:1789477412.050666:0:6711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783700096 00010000:00010000:3.0:1789477412.050736:0:6711:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000b30f7eb3/0xafddb3c8f9281da4 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2be6 expref: 11 pid: 6696 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789477412.050784:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 50 00000100:00100000:3.0:1789477412.050796:0:6711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d7c64d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9bc33f26-0aab-4a14-832f-c58d566de1b0+11:2354:x1876402783700096:12345-192.168.201.23@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789477412.050820:0:6711:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1789477412.050847:0:6711:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:3.0:1789477412.050851:0:6711:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb mtime from disk: 0 -> 1789477411 00002000:00010000:3.0:1789477412.050853:0:6711:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb atime from disk: 0 -> 1789477411 00002000:00010000:3.0:1789477412.050856:0:6711:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb ctime from disk: 0 -> 1789477411 00010000:00010000:3.0:1789477412.050863:0:6711:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000b30f7eb3/0xafddb3c8f9281da4 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2be6 expref: 11 pid: 6696 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477412.050879:0:6711:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000b30f7eb3/0xafddb3c8f9281da4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2be6 expref: 11 pid: 6696 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477412.050927:0:6711:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b30f7eb3/0xafddb3c8f9281da4 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2be6 expref: 11 pid: 6696 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477412.050949:0:6711:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789477412.050953:0:6711:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789477412.050960:0:6711:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000003a23395b/0xafddb3c8f9281de3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477412.050971:0:6711:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003a23395b/0xafddb3c8f9281de3 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477412.051013:0:6711:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789477412.051083:0:6711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d7c64d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9bc33f26-0aab-4a14-832f-c58d566de1b0+10:2354:x1876402783700096:12345-192.168.201.23@tcp:103:ldlm_bl.0 Request processed in 288us (727us total) trans 0 rc 0/0 00000100:00100000:3.0:1789477412.051092:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 50 00010000:00010000:1.0:1789477412.051858:0:6697:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000003a23395b/0xafddb3c8f9281de3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477412.051893:0:6697:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003a23395b/0xafddb3c8f9281de3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477412.051931:0:6697:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003a23395b/0xafddb3c8f9281de3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477412.051942:0:6697:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003a23395b/0xafddb3c8f9281de3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477412.051952:0:6697:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003a23395b/0xafddb3c8f9281de3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477412.051960:0:6697:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d0d41647000 already unused, calling callback (ffffffffc15972a0) 00010000:00010000:1.0:1789477412.051966:0:6697:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003a23395b/0xafddb3c8f9281de3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477412.051976:0:6697:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003a23395b/0xafddb3c8f9281de3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477412.051995:0:6697:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003a23395b/0xafddb3c8f9281de3 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477412.052004:0:6697:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003a23395b/0xafddb3c8f9281de3 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789477412.052094:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d74aa9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9bc33f26-0aab-4a14-832f-c58d566de1b0+9:2353:x1876402783699840:12345-192.168.201.23@tcp:1:lfs.0 Request processed in 32105us (32804us total) trans 0 rc 0/0 00000100:00100000:1.0:1789477412.052104:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 37 00000100:00100000:3.0:1789477412.056918:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:1.0:1789477412.057142:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783700352 00000100:00100000:1.0:1789477412.057172:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783700352 00000100:00100000:1.0:1789477412.057625:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 26 00000100:00100000:1.0:1789477412.057640:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d5845c850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9bc33f26-0aab-4a14-832f-c58d566de1b0+39:10517:x1876402783700352:12345-192.168.201.23@tcp:35:lfs.0 00000004:00010000:1.0:1789477412.058138:0:5848:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0x7:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d41647800/0xafddb3c8f9281dd5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2bfb expref: 39 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789477412.058637:0:5848:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967381 00000001:00080000:1.0:1789477412.058698:0:5848:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967382 00000001:00080000:1.0:1789477412.059114:0:5848:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967383 00010000:00010000:1.0:1789477412.059195:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f519800/0xafddb3c8f9281dea lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477412.059216:0:5848:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f518000/0xafddb3c8f9281d8f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2bd8 expref: 43 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477412.059227:0:5848:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f519800/0xafddb3c8f9281dea lrc: 4/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477412.059279:0:5848:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f518000/0xafddb3c8f9281d8f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2bd8 expref: 43 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477412.059301:0:5848:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f518000/0xafddb3c8f9281d8f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2bd8 expref: 43 pid: 5845 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789477412.059335:0:5848:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d58072d80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5848:1876402802591360:192.168.201.23@tcp:104: 00000100:00100000:1.0:1789477412.059473:0:5848:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d0d7f762a80 going to sleep for 11 seconds 00000100:00100000:3.0:1789477412.068751:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:1.0:1789477412.069187:0:5848:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d58072d80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5848:1876402802591360:192.168.201.23@tcp:104: 00010000:00010000:1.0:1789477412.069233:0:5848:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f519800/0xafddb3c8f9281dea lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789477412.069496:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783700480 00000100:00100000:0.0:1789477412.069506:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783700480 00010000:00010000:0.0:1789477412.069558:0:5831:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f518000/0xafddb3c8f9281d8f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2bd8 expref: 44 pid: 5845 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789477412.069644:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 51 00000100:00100000:0.0:1789477412.069656:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d623c9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9bc33f26-0aab-4a14-832f-c58d566de1b0+44:2354:x1876402783700480:12345-192.168.201.23@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789477412.069693:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789477412.069702:0:5831:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f518000/0xafddb3c8f9281d8f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2bd8 expref: 44 pid: 5845 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477412.069716:0:5831:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f518000/0xafddb3c8f9281d8f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2bd8 expref: 44 pid: 5845 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477412.069747:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f518000/0xafddb3c8f9281d8f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2bd8 expref: 44 pid: 5845 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477412.069766:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9d0d5b9f4700) 00010000:00010000:0.0:1789477412.069771:0:5831:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f519800/0xafddb3c8f9281dea lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477412.069782:0:5831:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f519800/0xafddb3c8f9281dea lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477412.069790:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f519800/0xafddb3c8f9281dea lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477412.069814:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789477412.069896:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d623c9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9bc33f26-0aab-4a14-832f-c58d566de1b0+43:2354:x1876402783700480:12345-192.168.201.23@tcp:103:ldlm_bl.0 Request processed in 241us (1170us total) trans 0 rc 0/0 00000100:00100000:0.0:1789477412.069903:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 51 00010000:00010000:1.0:1789477412.070016:0:5848:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f519800/0xafddb3c8f9281dea lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477412.070025:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f519800/0xafddb3c8f9281dea lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789477412.070206:0:5848:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967384 00000001:00080000:1.0:1789477412.070495:0:5848:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967385 00000100:00100000:1.0:1789477412.070682:0:5848:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d58072d80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5848:1876402802591488:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1789477412.070774:0:5848:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789477412.070808:0:5848:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d0d585760c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789477412.073782:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802591488 00000100:00100000:2.0:1789477412.073808:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802591488 00000100:00100000:2.0:1789477412.073924:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1789477412.073939:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d58072a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:5848:x1876402802591488:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1789477412.074118:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d58072a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:5848:x1876402802591488:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 182us (3344us total) trans 0 rc 0/0 00000100:00100000:2.0:1789477412.074127:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:1.0:1789477412.075004:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789477412.075069:0:5848:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d58072d80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5848:1876402802591488:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:1.0:1789477412.076012:0:5848:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967386 00000100:00100000:1.0:1789477412.076119:0:5848:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d58072d80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5848:1876402802591616:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1789477412.076204:0:5848:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789477412.076239:0:5848:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d0d47741540 going to sleep for 11 seconds 00000100:00100000:2.0:1789477412.076491:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802591616 00000100:00100000:2.0:1789477412.076501:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802591616 00000100:00100000:2.0:1789477412.078715:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1789477412.078760:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d74cd9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:5848:x1876402802591616:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1789477412.079137:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d74cd9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+8:5848:x1876402802591616:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 404us (2931us total) trans 4294967303 rc 0/0 00000100:00100000:2.0:1789477412.079158:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1789477412.079295:0:5848:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d58072d80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5848:1876402802591616:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:1.0:1789477412.079401:0:5848:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967387 00010000:00010000:1.0:1789477412.079930:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f519800/0xafddb3c8f9281dea lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477412.079945:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f519800/0xafddb3c8f9281dea lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477412.079955:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f519800/0xafddb3c8f9281dea lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477412.079963:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d0d7f519800 already unused, calling callback (ffffffffc1fd54f0) 00010000:00010000:1.0:1789477412.079970:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f519800/0xafddb3c8f9281dea lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477412.079980:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f519800/0xafddb3c8f9281dea lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477412.080003:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9d0d5b9f4700) 00010000:00010000:1.0:1789477412.080007:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:1.0:1789477412.080012:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f519800/0xafddb3c8f9281dea lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477412.080018:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f519800/0xafddb3c8f9281dea lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1789477412.080307:0:5848:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x8:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:1.0:1789477412.080701:0:5848:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].3, 64 off8384 00000004:00080000:1.0:1789477412.080714:0:5848:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 357152135974ns, next at 358152133062ns, rc = 0 00000001:00080000:1.0:1789477412.080723:0:5848:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967388 00010000:00010000:1.0:1789477412.080790:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9d0d5b9f4700) 00010000:00010000:1.0:1789477412.080793:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1789477412.080804:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d41647800/0xafddb3c8f9281dd5 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2bfb expref: 47 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789477412.080990:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d5845c850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9bc33f26-0aab-4a14-832f-c58d566de1b0+46:10517:x1876402783700352:12345-192.168.201.23@tcp:35:lfs.0 Request processed in 23352us (24090us total) trans 4294967389 rc 0/0 00000100:00100000:1.0:1789477412.081001:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 26 00000020:00080000:1.0:1789477412.081007:0:5848:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:3.0:1789477412.090739:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:1.0:1789477412.091081:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783700608 00000100:00100000:1.0:1789477412.091097:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783700608 00000100:00100000:1.0:1789477412.091194:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 100 00000100:00100000:1.0:1789477412.091207:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d7536b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9bc33f26-0aab-4a14-832f-c58d566de1b0+46:10517:x1876402783700608:12345-192.168.201.23@tcp:101:lfs.0 00010000:00010000:1.0:1789477412.091245:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789477412.091291:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f519400/0xafddb3c8f9281df1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa90d500d7b8f2c02 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477412.091395:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f519400/0xafddb3c8f9281df1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2c02 expref: 47 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477412.091414:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f519400/0xafddb3c8f9281df1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2c02 expref: 47 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477412.091448:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9d0d5b9f4e00) 00010000:00010000:1.0:1789477412.091452:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789477412.091457:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d0d7f519400, rc 0) 00000100:00100000:1.0:1789477412.091534:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d7536b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9bc33f26-0aab-4a14-832f-c58d566de1b0+47:10517:x1876402783700608:12345-192.168.201.23@tcp:101:lfs.0 Request processed in 329us (812us total) trans 0 rc 0/0 00000100:00100000:1.0:1789477412.091542:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 100 00000100:00100000:3.0:1789477412.096600:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:0.0:1789477412.096722:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783700864 00000100:00100000:0.0:1789477412.096737:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783700864 00000100:00100000:0.0:1789477412.096815:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 27 00000100:00100000:0.0:1789477412.096829:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d7536aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9bc33f26-0aab-4a14-832f-c58d566de1b0+47:10517:x1876402783700864:12345-192.168.201.23@tcp:35:lfs.0 00000100:00100000:0.0:1789477412.097193:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d7536aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9bc33f26-0aab-4a14-832f-c58d566de1b0+48:10517:x1876402783700864:12345-192.168.201.23@tcp:35:lfs.0 Request processed in 366us (627us total) trans 4294967390 rc 0/0 00000100:00100000:0.0:1789477412.097202:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 27 00000100:00100000:2.0:1789477412.181223:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:3.0:1789477412.181381:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783700992 00000100:00100000:3.0:1789477412.181394:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783700992 00000100:00100000:3.0:1789477412.181484:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 101 00000100:00100000:3.0:1789477412.181497:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d50b07800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9bc33f26-0aab-4a14-832f-c58d566de1b0+48:10527:x1876402783700992:12345-192.168.201.23@tcp:34:lfs.0 00010000:00010000:3.0:1789477412.181660:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49ecba00/0xafddb3c8f9281df8 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477412.181707:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49ecba00/0xafddb3c8f9281df8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477412.181722:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49ecba00/0xafddb3c8f9281df8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477412.181742:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49eca000/0xafddb3c8f9281dff lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477412.181750:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49eca000/0xafddb3c8f9281dff lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477412.181757:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49eca000/0xafddb3c8f9281dff lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477412.181886:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49eca600/0xafddb3c8f9281e06 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477412.182115:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49eca600/0xafddb3c8f9281e06 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477412.182127:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49eca600/0xafddb3c8f9281e06 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789477412.182196:0:5844:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49eca600/0xafddb3c8f9281e06 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477412.182212:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49ecba00/0xafddb3c8f9281df8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477412.182220:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49ecba00/0xafddb3c8f9281df8 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477412.182239:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49ecba00/0xafddb3c8f9281df8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477412.182246:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d0d49ecba00 already unused, calling callback (ffffffffc1fd54f0) 00010000:00010000:3.0:1789477412.182252:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49ecba00/0xafddb3c8f9281df8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477412.182261:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49ecba00/0xafddb3c8f9281df8 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477412.182276:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9d0d5b9f4000) 00010000:00010000:3.0:1789477412.182279:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789477412.182285:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49ecba00/0xafddb3c8f9281df8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477412.182292:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49ecba00/0xafddb3c8f9281df8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477412.182313:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49eca000/0xafddb3c8f9281dff lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477412.182319:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49eca000/0xafddb3c8f9281dff lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477412.182326:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49eca000/0xafddb3c8f9281dff lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477412.182331:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d0d49eca000 already unused, calling callback (ffffffffc1fd54f0) 00010000:00010000:3.0:1789477412.182333:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49eca000/0xafddb3c8f9281dff lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477412.182348:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49eca000/0xafddb3c8f9281dff lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477412.182356:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9d0d44568e00) 00010000:00010000:3.0:1789477412.182358:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789477412.182360:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49eca000/0xafddb3c8f9281dff lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477412.182366:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49eca000/0xafddb3c8f9281dff lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477412.182384:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49eca600/0xafddb3c8f9281e06 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477412.182389:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49eca600/0xafddb3c8f9281e06 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477412.182395:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49eca600/0xafddb3c8f9281e06 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477412.182400:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d0d49eca600 already unused, calling callback (ffffffffc1fd54f0) 00010000:00010000:3.0:1789477412.182403:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49eca600/0xafddb3c8f9281e06 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477412.182409:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49eca600/0xafddb3c8f9281e06 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477412.182415:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9d0d5b9f4e00) 00010000:00010000:3.0:1789477412.182417:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789477412.182420:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49eca600/0xafddb3c8f9281e06 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477412.182435:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49eca600/0xafddb3c8f9281e06 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789477412.183255:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d50b07800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9bc33f26-0aab-4a14-832f-c58d566de1b0+48:10527:x1876402783700992:12345-192.168.201.23@tcp:34:lfs.0 Request processed in 1751us (2041us total) trans 0 rc 0/0 00000100:00100000:3.0:1789477412.183268:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 101 00000100:00100000:3.0:1789477412.234255:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:1.0:1789477412.235966:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783701248 00000100:00100000:1.0:1789477412.235986:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783701248 00000100:00100000:1.0:1789477412.236106:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 102 00000100:00100000:1.0:1789477412.236118:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d4e643480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9bc33f26-0aab-4a14-832f-c58d566de1b0+48:10530:x1876402783701248:12345-192.168.201.23@tcp:101:lfs.0 00010000:00010000:1.0:1789477412.236154:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789477412.236182:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f518400/0xafddb3c8f9281e0d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa90d500d7b8f2c09 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477412.236289:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f518200/0xafddb3c8f9281e14 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477412.236307:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f518200/0xafddb3c8f9281e14 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477412.236323:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f518200/0xafddb3c8f9281e14 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477412.236342:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f519200/0xafddb3c8f9281e1b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477412.236349:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f519200/0xafddb3c8f9281e1b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477412.236356:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f519200/0xafddb3c8f9281e1b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477412.237233:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f519000/0xafddb3c8f9281e22 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477412.237249:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f519000/0xafddb3c8f9281e22 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477412.237258:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f519000/0xafddb3c8f9281e22 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789477412.237286:0:5845:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:1.0:1789477412.237407:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f518200/0xafddb3c8f9281e14 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477412.237415:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f518200/0xafddb3c8f9281e14 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477412.237423:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f518200/0xafddb3c8f9281e14 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477412.237429:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d0d7f518200 already unused, calling callback (ffffffffc1fd54f0) 00010000:00010000:1.0:1789477412.237435:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f518200/0xafddb3c8f9281e14 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477412.237444:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f518200/0xafddb3c8f9281e14 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477412.237458:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9d0d5b9f4000) 00010000:00010000:1.0:1789477412.237462:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789477412.237476:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f518200/0xafddb3c8f9281e14 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477412.237483:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f518200/0xafddb3c8f9281e14 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477412.237879:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f519200/0xafddb3c8f9281e1b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477412.237886:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f519200/0xafddb3c8f9281e1b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477412.237904:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f519200/0xafddb3c8f9281e1b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477412.237909:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d0d7f519200 already unused, calling callback (ffffffffc1fd54f0) 00010000:00010000:1.0:1789477412.237913:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f519200/0xafddb3c8f9281e1b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477412.237920:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f519200/0xafddb3c8f9281e1b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477412.237929:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9d0d5b9f4700) 00010000:00010000:1.0:1789477412.237932:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789477412.237935:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f519200/0xafddb3c8f9281e1b lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477412.237941:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f519200/0xafddb3c8f9281e1b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477412.237996:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f518400/0xafddb3c8f9281e0d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2c09 expref: 51 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477412.238010:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f519000/0xafddb3c8f9281e22 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2c09 expref: 50 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477412.238018:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9d0d5b9f4e00) 00010000:00010000:1.0:1789477412.238020:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789477412.238023:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d0d7f519000, rc 0) 00000100:00100000:1.0:1789477412.238260:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d4e643480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9bc33f26-0aab-4a14-832f-c58d566de1b0+50:10530:x1876402783701248:12345-192.168.201.23@tcp:101:lfs.0 Request processed in 2142us (4018us total) trans 4294967391 rc 0/0 00000100:00100000:1.0:1789477412.238279:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 102 00000100:00100000:1.0:1789477412.244618:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:2.0:1789477412.244878:0:6999:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783701376 00000100:00100000:2.0:1789477412.244892:0:6999:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783701376 00000100:00100000:2.0:1789477412.244963:0:6999:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 103 00000100:00100000:2.0:1789477412.244982:0:6999:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d58070380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9bc33f26-0aab-4a14-832f-c58d566de1b0+50:10530:x1876402783701376:12345-192.168.201.23@tcp:54:lfs.0 00010000:00010000:2.0:1789477412.245092:0:6999:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d41647a00/0xafddb3c8f9281e30 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477412.245113:0:6999:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d41647a00/0xafddb3c8f9281e30 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477412.245154:0:6999:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d41647a00/0xafddb3c8f9281e30 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477412.245191:0:6999:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d41647a00/0xafddb3c8f9281e30 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477412.245199:0:6999:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d41647a00/0xafddb3c8f9281e30 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477412.245207:0:6999:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d41647a00/0xafddb3c8f9281e30 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477412.245213:0:6999:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d0d41647a00 already unused, calling callback (ffffffffc1fd54f0) 00010000:00010000:2.0:1789477412.245219:0:6999:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d41647a00/0xafddb3c8f9281e30 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477412.245227:0:6999:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d41647a00/0xafddb3c8f9281e30 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477412.245241:0:6999:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9d0d5b9f4e00) 00010000:00010000:2.0:1789477412.245244:0:6999:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789477412.245249:0:6999:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d41647a00/0xafddb3c8f9281e30 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477412.245255:0:6999:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d41647a00/0xafddb3c8f9281e30 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789477412.245903:0:6999:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d58070380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9bc33f26-0aab-4a14-832f-c58d566de1b0+50:10530:x1876402783701376:12345-192.168.201.23@tcp:54:lfs.0 Request processed in 925us (1294us total) trans 0 rc 0/0 00000100:00100000:2.0:1789477412.245913:0:6999:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 103 00000100:00100000:2.0:1789477412.256728:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:0.0:1789477412.256959:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783701632 00000100:00100000:0.0:1789477412.256972:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783701632 00000100:00100000:0.0:1789477412.257042:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 28 00000100:00100000:0.0:1789477412.257053:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d50b07100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9bc33f26-0aab-4a14-832f-c58d566de1b0+50:10530:x1876402783701632:12345-192.168.201.23@tcp:35:lfs.0 00000100:00100000:0.0:1789477412.257412:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d50b07100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9bc33f26-0aab-4a14-832f-c58d566de1b0+51:10530:x1876402783701632:12345-192.168.201.23@tcp:35:lfs.0 Request processed in 359us (699us total) trans 4294967392 rc 0/0 00000100:00100000:0.0:1789477412.257421:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 28 00000100:00100000:2.0:1789477412.275399:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d6d488a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1876402802591744:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789477412.275517:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789477412.276873:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802591744 00000100:00100000:3.0:1789477412.276891:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802591744 00000100:00100000:3.0:1789477412.276978:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1789477412.276990:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d74a8b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+8:3312:x1876402802591744:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789477412.277024:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 3407872 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789477412.277130:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d74a8b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+8:3312:x1876402802591744:12345-0@lo:13:osp-pre-0-0.0 Request processed in 142us (1612us total) trans 0 rc 0/0 00000100:00100000:3.0:1789477412.277138:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1789477412.277332:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d6d488a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1876402802591744:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789477412.329622:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:3.0:1789477412.329780:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783701888 00000100:00100000:3.0:1789477412.329792:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783701888 00000100:00100000:3.0:1789477412.329854:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 104 00000100:00100000:3.0:1789477412.329865:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d7c64ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9bc33f26-0aab-4a14-832f-c58d566de1b0+51:10540:x1876402783701888:12345-192.168.201.23@tcp:101:bash.0 00010000:00010000:3.0:1789477412.329901:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789477412.329906:0:5846:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1789477412.329942:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f518e00/0xafddb3c8f9281db2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2bed expref: 51 pid: 6999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477412.329966:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9d0d5b9f4000) 00010000:00010000:3.0:1789477412.329971:0:5846:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789477412.330008:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49eca600/0xafddb3c8f9281e37 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa90d500d7b8f2c10 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477412.330132:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49eca000/0xafddb3c8f9281e3e lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477412.330160:0:5846:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f519000/0xafddb3c8f9281e22 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2c09 expref: 51 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477412.330171:0:5846:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49eca000/0xafddb3c8f9281e3e lrc: 4/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477412.330211:0:5846:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f519000/0xafddb3c8f9281e22 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2c09 expref: 51 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477412.330227:0:5846:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f519000/0xafddb3c8f9281e22 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2c09 expref: 51 pid: 5845 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789477412.330243:0:5846:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d6d489f80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5846:1876402802591872:192.168.201.23@tcp:104: 00000100:00100000:3.0:1789477412.330363:0:5846:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d0d44480000 going to sleep for 11 seconds 00000100:00100000:3.0:1789477412.335224:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:2.0:1789477412.335348:0:5846:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d6d489f80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5846:1876402802591872:192.168.201.23@tcp:104: 00010000:00010000:2.0:1789477412.335389:0:5846:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49eca000/0xafddb3c8f9281e3e lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789477412.335483:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783702016 00000100:00100000:1.0:1789477412.335503:0:6711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783702016 00010000:00010000:1.0:1789477412.335551:0:6711:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f519000/0xafddb3c8f9281e22 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2c09 expref: 52 pid: 5845 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789477412.335627:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 52 00000100:00100000:1.0:1789477412.335637:0:6711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d6d48bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9bc33f26-0aab-4a14-832f-c58d566de1b0+52:2354:x1876402783702016:12345-192.168.201.23@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789477412.335670:0:6711:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789477412.335677:0:6711:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f519000/0xafddb3c8f9281e22 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2c09 expref: 52 pid: 5845 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477412.335690:0:6711:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f519000/0xafddb3c8f9281e22 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2c09 expref: 52 pid: 5845 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477412.335717:0:6711:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f519000/0xafddb3c8f9281e22 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2c09 expref: 52 pid: 5845 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477412.335944:0:6711:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9d0d5b9f4e00) 00010000:00010000:1.0:1789477412.335952:0:6711:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49eca000/0xafddb3c8f9281e3e lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477412.335964:0:6711:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49eca000/0xafddb3c8f9281e3e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477412.335973:0:6711:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49eca000/0xafddb3c8f9281e3e lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477412.336019:0:6711:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789477412.336088:0:6711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d6d48bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9bc33f26-0aab-4a14-832f-c58d566de1b0+51:2354:x1876402783702016:12345-192.168.201.23@tcp:103:ldlm_bl.0 Request processed in 451us (878us total) trans 0 rc 0/0 00000100:00100000:1.0:1789477412.336096:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 52 00010000:00010000:2.0:1789477412.336168:0:5846:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49eca000/0xafddb3c8f9281e3e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477412.336176:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49eca000/0xafddb3c8f9281e3e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789477412.336203:0:5846:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:2.0:1789477412.336394:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49eca600/0xafddb3c8f9281e37 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2c10 expref: 52 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477412.336420:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49eca000/0xafddb3c8f9281e3e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2c10 expref: 51 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477412.336429:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9d0d5b9f4e00) 00010000:00010000:2.0:1789477412.336432:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1789477412.336434:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d0d49eca000, rc 0) 00000100:00100000:2.0:1789477412.336461:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d7c64ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9bc33f26-0aab-4a14-832f-c58d566de1b0+51:10540:x1876402783701888:12345-192.168.201.23@tcp:101:bash.0 Request processed in 6598us (6897us total) trans 4294967393 rc 0/0 00000100:00100000:2.0:1789477412.336469:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 104 00000100:00100000:2.0:1789477412.340459:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:3.0:1789477412.340653:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783702272 00000100:00100000:3.0:1789477412.340666:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783702272 00000100:00100000:3.0:1789477412.340758:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 105 00000100:00100000:3.0:1789477412.340771:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d7f546680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9bc33f26-0aab-4a14-832f-c58d566de1b0+51:10540:x1876402783702272:12345-192.168.201.23@tcp:36:bash.0 00010000:00010000:3.0:1789477412.341171:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49ecba00/0xafddb3c8f9281e4c lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477412.341195:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49ecba00/0xafddb3c8f9281e4c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477412.341216:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49ecba00/0xafddb3c8f9281e4c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789477412.341280:0:5844:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967394 00000004:00010000:3.0:1789477412.341305:0:5844:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000faa40c60 reply state 00000000416bdf00 transno 4294967395 ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49ecba00/0xafddb3c8f9281e4c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789477412.341317:0:5844:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789477412.341442:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d7f546680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9bc33f26-0aab-4a14-832f-c58d566de1b0+54:10540:x1876402783702272:12345-192.168.201.23@tcp:36:bash.0 Request processed in 672us (998us total) trans 4294967395 rc 0/0 00000100:00100000:3.0:1789477412.341450:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 105 00000020:00080000:3.0:1789477412.341456:0:5844:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1789477412.346466:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:1.0:1789477412.346561:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783702400 00000100:00100000:1.0:1789477412.346606:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783702400 00000100:00100000:1.0:1789477412.346684:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 106 00000100:00100000:1.0:1789477412.346696:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d6d48a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9bc33f26-0aab-4a14-832f-c58d566de1b0+54:10540:x1876402783702400:12345-192.168.201.23@tcp:101:bash.0 00010000:00010000:1.0:1789477412.346731:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789477412.346767:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f519000/0xafddb3c8f9281e53 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa90d500d7b8f2c17 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477412.346884:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f519200/0xafddb3c8f9281e5a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477412.346903:0:5845:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49eca000/0xafddb3c8f9281e3e lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2c10 expref: 55 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477412.346911:0:5845:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49ecba00/0xafddb3c8f9281e4c lrc: 2/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477412.346920:0:5845:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f519200/0xafddb3c8f9281e5a lrc: 5/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477412.346941:0:5845:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49ecba00/0xafddb3c8f9281e4c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477412.346983:0:5845:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49eca000/0xafddb3c8f9281e3e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2c10 expref: 55 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477412.347017:0:5845:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49eca000/0xafddb3c8f9281e3e lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2c10 expref: 55 pid: 5846 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789477412.347034:0:5845:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d58070000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5845:1876402802592000:192.168.201.23@tcp:104: 00000100:00100000:1.0:1789477412.347153:0:5845:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d0d47741c00 going to sleep for 11 seconds 00010000:00010000:2.0:1789477412.348713:0:3296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49ecba00/0xafddb3c8f9281e4c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000020 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477412.348761:0:3296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49ecba00/0xafddb3c8f9281e4c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000020 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477412.348769:0:3296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49ecba00/0xafddb3c8f9281e4c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477412.348776:0:3296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d0d49ecba00 already unused, calling callback (ffffffffc1fd54f0) 00010000:00010000:2.0:1789477412.348781:0:3296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49ecba00/0xafddb3c8f9281e4c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477412.348790:0:3296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49ecba00/0xafddb3c8f9281e4c lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000020 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477412.348812:0:3296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9d0d5b9f4e00) 00010000:00010000:2.0:1789477412.348815:0:3296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789477412.348819:0:3296:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f519200/0xafddb3c8f9281e5a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477412.348829:0:3296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49ecba00/0xafddb3c8f9281e4c lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000020 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477412.348836:0:3296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49ecba00/0xafddb3c8f9281e4c lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000020 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789477412.350941:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:0.0:1789477412.351093:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783702528 00000100:00100000:0.0:1789477412.351105:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783702528 00010000:00010000:0.0:1789477412.351162:0:5831:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49eca000/0xafddb3c8f9281e3e lrc: 5/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2c10 expref: 55 pid: 5846 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789477412.351207:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 53 00000100:00100000:0.0:1789477412.351219:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d6d489500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9bc33f26-0aab-4a14-832f-c58d566de1b0+55:2354:x1876402783702528:12345-192.168.201.23@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789477412.351236:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789477412.351244:0:5831:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49eca000/0xafddb3c8f9281e3e lrc: 5/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2c10 expref: 55 pid: 5846 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477412.351259:0:5831:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49eca000/0xafddb3c8f9281e3e lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2c10 expref: 55 pid: 5846 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477412.351307:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9d0d5b9f4e00) 00010000:00010000:0.0:1789477412.351313:0:5831:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f519200/0xafddb3c8f9281e5a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477412.351324:0:5831:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f519200/0xafddb3c8f9281e5a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477412.351333:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f519200/0xafddb3c8f9281e5a lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477412.351354:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789477412.351426:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d6d489500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9bc33f26-0aab-4a14-832f-c58d566de1b0+55:2354:x1876402783702528:12345-192.168.201.23@tcp:103:ldlm_bl.0 Request processed in 209us (498us total) trans 0 rc 0/0 00000100:00100000:0.0:1789477412.351434:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 53 00010000:00010000:1.0:1789477412.352129:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49eca000/0xafddb3c8f9281e3e lrc: 0/0,0 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2c10 expref: 54 pid: 5846 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789477412.352168:0:5845:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d58070000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5845:1876402802592000:192.168.201.23@tcp:104: 00010000:00010000:1.0:1789477412.352202:0:5845:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f519200/0xafddb3c8f9281e5a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477412.352212:0:5845:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f519200/0xafddb3c8f9281e5a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477412.352219:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f519200/0xafddb3c8f9281e5a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789477412.352286:0:5845:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:1.0:1789477412.352293:0:5845:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1789477412.352315:0:5845:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f519200/0xafddb3c8f9281e5a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477412.352351:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f519000/0xafddb3c8f9281e53 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2c17 expref: 54 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477412.352368:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f519200/0xafddb3c8f9281e5a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2c17 expref: 53 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477412.352390:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9d0d5b9f4e00) 00010000:00010000:1.0:1789477412.352393:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789477412.352396:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d0d7f519200, rc 0) 00000100:00100000:1.0:1789477412.352446:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d6d48a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9bc33f26-0aab-4a14-832f-c58d566de1b0+53:10540:x1876402783702400:12345-192.168.201.23@tcp:101:bash.0 Request processed in 5753us (6000us total) trans 0 rc 0/0 00000100:00100000:1.0:1789477412.352455:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 106 00000100:00100000:3.0:1789477412.356715:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:0.0:1789477412.357319:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783702784 00000100:00100000:0.0:1789477412.357333:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783702784 00000100:00100000:0.0:1789477412.357447:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 29 00000100:00100000:0.0:1789477412.357459:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d6d48ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9bc33f26-0aab-4a14-832f-c58d566de1b0+53:10540:x1876402783702784:12345-192.168.201.23@tcp:35:bash.0 00000100:00100000:0.0:1789477412.357970:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d6d48ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9bc33f26-0aab-4a14-832f-c58d566de1b0+54:10540:x1876402783702784:12345-192.168.201.23@tcp:35:bash.0 Request processed in 511us (1266us total) trans 4294967396 rc 0/0 00000100:00100000:0.0:1789477412.357979:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 29 00000100:00100000:0.0:1789477412.421958:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:3.0:1789477412.422062:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783702912 00000100:00100000:3.0:1789477412.422075:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783702912 00000100:00100000:3.0:1789477412.422283:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 107 00000100:00100000:3.0:1789477412.422297:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d7c64ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9bc33f26-0aab-4a14-832f-c58d566de1b0+54:10546:x1876402783702912:12345-192.168.201.23@tcp:101:lfs.0 00010000:00010000:3.0:1789477412.422331:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789477412.422359:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49eca000/0xafddb3c8f9281e61 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa90d500d7b8f2c1e expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477412.422468:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49ecba00/0xafddb3c8f9281e68 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477412.422485:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49ecba00/0xafddb3c8f9281e68 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477412.422515:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49ecba00/0xafddb3c8f9281e68 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789477412.422629:0:5844:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 7680 00000004:00200000:3.0:1789477412.422633:0:5844:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:3.0:1789477412.422667:0:5844:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49ecba00/0xafddb3c8f9281e68 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477412.422695:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49eca000/0xafddb3c8f9281e61 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2c1e expref: 56 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477412.422722:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49ecba00/0xafddb3c8f9281e68 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2c1e expref: 55 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477412.422732:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9d0d5b9f4000) 00010000:00010000:3.0:1789477412.422735:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789477412.422739:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d0d49ecba00, rc 0) 00000100:00100000:3.0:1789477412.422812:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d7c64ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9bc33f26-0aab-4a14-832f-c58d566de1b0+55:10546:x1876402783702912:12345-192.168.201.23@tcp:101:lfs.0 Request processed in 518us (870us total) trans 0 rc 0/0 00000100:00100000:3.0:1789477412.422820:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 107 00000100:00100000:2.0:1789477412.428213:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:3.0:1789477412.428638:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783703040 00000100:00100000:3.0:1789477412.428709:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783703040 00000100:00100000:3.0:1789477412.428817:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 108 00000100:00100000:3.0:1789477412.428830:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d74f86a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9bc33f26-0aab-4a14-832f-c58d566de1b0+55:10546:x1876402783703040:12345-192.168.201.23@tcp:101:lfs.0 00010000:00010000:3.0:1789477412.428859:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789477412.428890:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49eca600/0xafddb3c8f9281e6f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa90d500d7b8f2c25 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477412.429023:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49ecbc00/0xafddb3c8f9281e76 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477412.429045:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49ecbc00/0xafddb3c8f9281e76 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477412.429060:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49ecbc00/0xafddb3c8f9281e76 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477412.429079:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d59d6a400/0xafddb3c8f9281e7d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477412.429087:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d59d6a400/0xafddb3c8f9281e7d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477412.429105:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d59d6a400/0xafddb3c8f9281e7d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477412.429408:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d59d6a800/0xafddb3c8f9281e84 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477412.429420:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d59d6a800/0xafddb3c8f9281e84 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477412.429428:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d59d6a800/0xafddb3c8f9281e84 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789477412.429551:0:5846:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:3.0:1789477412.429557:0:5846:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1789477412.429612:0:5846:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d59d6a800/0xafddb3c8f9281e84 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477412.429641:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d59d6a800/0xafddb3c8f9281e84 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477412.429762:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49ecbc00/0xafddb3c8f9281e76 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477412.429771:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49ecbc00/0xafddb3c8f9281e76 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477412.429778:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49ecbc00/0xafddb3c8f9281e76 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477412.429784:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d0d49ecbc00 already unused, calling callback (ffffffffc1fd54f0) 00010000:00010000:3.0:1789477412.429790:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49ecbc00/0xafddb3c8f9281e76 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477412.429798:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49ecbc00/0xafddb3c8f9281e76 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477412.429813:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9d0d5b9f4000) 00010000:00010000:3.0:1789477412.429816:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789477412.429821:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49ecbc00/0xafddb3c8f9281e76 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477412.429828:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49ecbc00/0xafddb3c8f9281e76 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477412.429848:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d59d6a400/0xafddb3c8f9281e7d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477412.429854:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d59d6a400/0xafddb3c8f9281e7d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477412.429866:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d59d6a400/0xafddb3c8f9281e7d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477412.429871:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d0d59d6a400 already unused, calling callback (ffffffffc1fd54f0) 00010000:00010000:3.0:1789477412.429874:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d59d6a400/0xafddb3c8f9281e7d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477412.429880:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d59d6a400/0xafddb3c8f9281e7d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477412.429888:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9d0d44568e00) 00010000:00010000:3.0:1789477412.429890:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789477412.429892:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d59d6a400/0xafddb3c8f9281e7d lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477412.429899:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d59d6a400/0xafddb3c8f9281e7d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477412.429936:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49eca600/0xafddb3c8f9281e6f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2c25 expref: 57 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477412.429950:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d59d6a800/0xafddb3c8f9281e84 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2c25 expref: 56 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477412.429958:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9d0d5b9f4e00) 00010000:00010000:3.0:1789477412.429960:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789477412.429963:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d0d59d6a800, rc 0) 00000100:00100000:3.0:1789477412.430050:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d74f86a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9bc33f26-0aab-4a14-832f-c58d566de1b0+56:10546:x1876402783703040:12345-192.168.201.23@tcp:101:lfs.0 Request processed in 1222us (1850us total) trans 0 rc 0/0 00000100:00100000:3.0:1789477412.430067:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 108 00000100:00100000:0.0:1789477412.440943:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:0.0:1789477412.441084:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:1.0:1789477412.441981:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783703424 00000100:00100000:1.0:1789477412.441998:0:6711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783703424 00000100:00100000:1.0:1789477412.442083:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 7 00000100:00100000:1.0:1789477412.442103:0:6711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d7c64e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9bc33f26-0aab-4a14-832f-c58d566de1b0+56:2355:x1876402783703424:12345-192.168.201.23@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789477412.442121:0:6711:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789477412.442163:0:6711:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d59d6a800/0xafddb3c8f9281e84 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2c25 expref: 56 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477412.442198:0:6711:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9d0d5b9f4e00) 00010000:00010000:1.0:1789477412.442203:0:6711:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789477412.442324:0:6711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d7c64e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9bc33f26-0aab-4a14-832f-c58d566de1b0+55:2355:x1876402783703424:12345-192.168.201.23@tcp:103:ldlm_bl.0 Request processed in 230us (1238us total) trans 0 rc 0/0 00000100:00100000:1.0:1789477412.442340:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 7 00000100:00100000:2.0:1789477412.442933:0:6999:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783703296 00000100:00100000:2.0:1789477412.442944:0:6999:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783703296 00000100:00100000:2.0:1789477412.442992:0:6999:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 109 00000100:00100000:2.0:1789477412.443000:0:6999:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d7c64d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9bc33f26-0aab-4a14-832f-c58d566de1b0+55:10546:x1876402783703296:12345-192.168.201.23@tcp:101:lfs.0 00010000:00010000:2.0:1789477412.443025:0:6999:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789477412.443067:0:6999:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d41647800/0xafddb3c8f9281e8b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa90d500d7b8f2c2c expref: -99 pid: 6999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477412.443963:0:6999:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d41646a00/0xafddb3c8f9281e92 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477412.443991:0:6999:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f519200/0xafddb3c8f9281e5a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2c17 expref: 56 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477412.444001:0:6999:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d41646a00/0xafddb3c8f9281e92 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477412.444076:0:6999:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f519200/0xafddb3c8f9281e5a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2c17 expref: 56 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477412.444177:0:6999:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f519200/0xafddb3c8f9281e5a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2c17 expref: 56 pid: 5845 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789477412.444195:0:6999:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d6d481500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6999:1876402802592128:192.168.201.23@tcp:104: 00000100:00100000:2.0:1789477412.444441:0:6999:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d0d47536240 going to sleep for 11 seconds 00000100:00100000:2.0:1789477412.451508:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:1.0:1789477412.451625:0:6999:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d6d481500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6999:1876402802592128:192.168.201.23@tcp:104: 00010000:00010000:1.0:1789477412.451671:0:6999:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d41646a00/0xafddb3c8f9281e92 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789477412.451897:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783703552 00000100:00100000:3.0:1789477412.451906:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783703552 00010000:00010000:3.0:1789477412.451953:0:5831:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f519200/0xafddb3c8f9281e5a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2c17 expref: 57 pid: 5845 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789477412.452001:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 54 00000100:00100000:3.0:1789477412.452011:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d50a80c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9bc33f26-0aab-4a14-832f-c58d566de1b0+57:2354:x1876402783703552:12345-192.168.201.23@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789477412.452029:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789477412.452037:0:5831:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f519200/0xafddb3c8f9281e5a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2c17 expref: 57 pid: 5845 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477412.452049:0:5831:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f519200/0xafddb3c8f9281e5a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2c17 expref: 57 pid: 5845 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477412.452076:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f519200/0xafddb3c8f9281e5a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2c17 expref: 57 pid: 5845 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477412.452103:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9d0d5b9f4e00) 00010000:00010000:3.0:1789477412.452109:0:5831:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d41646a00/0xafddb3c8f9281e92 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477412.452120:0:5831:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d41646a00/0xafddb3c8f9281e92 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477412.452129:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d41646a00/0xafddb3c8f9281e92 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477412.452184:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789477412.452941:0:6999:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d41646a00/0xafddb3c8f9281e92 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477412.452970:0:6999:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d41646a00/0xafddb3c8f9281e92 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789477412.452996:0:6999:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:1.0:1789477412.453221:0:6999:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d41647800/0xafddb3c8f9281e8b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2c2c expref: 58 pid: 6999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477412.453251:0:6999:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d41646a00/0xafddb3c8f9281e92 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2c2c expref: 57 pid: 6999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477412.453262:0:6999:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9d0d5b9f4e00) 00010000:00010000:1.0:1789477412.453265:0:6999:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1789477412.453267:0:6999:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d0d41646a00, rc 0) 00000100:00100000:3.0:1789477412.455084:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d50a80c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9bc33f26-0aab-4a14-832f-c58d566de1b0+57:2354:x1876402783703552:12345-192.168.201.23@tcp:103:ldlm_bl.0 Request processed in 3058us (3583us total) trans 0 rc 0/0 00000100:00100000:3.0:1789477412.455110:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 54 00000100:00100000:1.0:1789477412.455361:0:6999:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d7c64d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9bc33f26-0aab-4a14-832f-c58d566de1b0+56:10546:x1876402783703296:12345-192.168.201.23@tcp:101:lfs.0 Request processed in 12360us (14428us total) trans 4294967397 rc 0/0 00000100:00100000:1.0:1789477412.455370:0:6999:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 109 00000100:00100000:2.0:1789477412.466303:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:1.0:1789477412.466546:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783703808 00000100:00100000:1.0:1789477412.466561:0:6711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783703808 00000100:00100000:2.0:1789477412.472454:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 8 00000100:00100000:2.0:1789477412.472483:0:6711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d6d482d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9bc33f26-0aab-4a14-832f-c58d566de1b0+56:10546:x1876402783703808:12345-192.168.201.23@tcp:103:lfs.0 00010000:00010000:2.0:1789477412.472503:0:6711:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789477412.472538:0:6711:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f519400/0xafddb3c8f9281df1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2c02 expref: 56 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477412.472618:0:6711:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9d0d5b9f4e00) 00010000:00010000:2.0:1789477412.472625:0:6711:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789477412.472712:0:6711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d6d482d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9bc33f26-0aab-4a14-832f-c58d566de1b0+55:10546:x1876402783703808:12345-192.168.201.23@tcp:103:lfs.0 Request processed in 240us (6425us total) trans 0 rc 0/0 00000100:00100000:2.0:1789477412.472721:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 8 00000100:00100000:0.0:1789477412.479548:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:1.0:1789477412.479714:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783703936 00000100:00100000:1.0:1789477412.479727:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783703936 00000100:00100000:1.0:1789477412.479806:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 110 00000100:00100000:1.0:1789477412.479818:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d7c64f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9bc33f26-0aab-4a14-832f-c58d566de1b0+55:10546:x1876402783703936:12345-192.168.201.23@tcp:58:lfs.0 00010000:00010000:1.0:1789477412.479984:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f519000/0xafddb3c8f9281ea0 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477412.480007:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f519000/0xafddb3c8f9281ea0 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477412.480032:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f519000/0xafddb3c8f9281ea0 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1789477412.480318:0:5845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].2, 136 off8464 00000100:00100000:1.0:1789477412.480425:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d7c64f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9bc33f26-0aab-4a14-832f-c58d566de1b0+55:10546:x1876402783703936:12345-192.168.201.23@tcp:58:lfs.0 Request processed in 607us (890us total) trans 0 rc 0/0 00000100:00100000:1.0:1789477412.480434:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 110 00000100:00100000:3.0:1789477412.483557:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:1.0:1789477412.483679:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783704064 00000100:00100000:1.0:1789477412.483693:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783704064 00000100:00100000:1.0:1789477412.483769:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 111 00000100:00100000:1.0:1789477412.483782:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d6d48bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9bc33f26-0aab-4a14-832f-c58d566de1b0+55:10546:x1876402783704064:12345-192.168.201.23@tcp:101:lfs.0 00010000:00010000:1.0:1789477412.483811:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789477412.483837:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f518200/0xafddb3c8f9281ea7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa90d500d7b8f2c33 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477412.483921:0:5844:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f519000/0xafddb3c8f9281ea0 lrc: 2/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477412.483935:0:5844:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f518200/0xafddb3c8f9281ea7 lrc: 4/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2c33 expref: 56 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477412.483959:0:5844:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f519000/0xafddb3c8f9281ea0 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477412.483974:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f518200/0xafddb3c8f9281ea7 lrc: 3/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2c33 expref: 56 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477412.483991:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9d0d5b9f4e00) 00010000:00010000:1.0:1789477412.484010:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789477412.484015:0:5844:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f518200/0xafddb3c8f9281ea7 lrc: 3/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2c33 expref: 56 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477412.484023:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d0d7f518200, rc 0) 00000100:00100000:1.0:1789477412.484119:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d6d48bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9bc33f26-0aab-4a14-832f-c58d566de1b0+56:10546:x1876402783704064:12345-192.168.201.23@tcp:101:lfs.0 Request processed in 339us (581us total) trans 0 rc 0/0 00000100:00100000:1.0:1789477412.484127:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 111 00010000:00010000:2.0:1789477412.528031:0:6710:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1789477412.849424:0:11717:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1789477412.849437:0:11717:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1789477412.849521:0:11717:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 3 count 3 00000040:00080000:3.0:1789477412.849530:0:11717:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1789477412.849896:0:11717:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d6d489500 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11717:1876402802592256:192.168.201.23@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1789477412.850041:0:11717:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d0d44480180 going to sleep for 11 seconds 00000100:00100000:3.0:1789477412.857019:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:3.0:1789477412.857069:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783704192 00000100:00100000:3.0:1789477412.857081:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783704192 00000100:00100000:3.0:1789477412.857160:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 112 00000100:00100000:3.0:1789477412.857173:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d6d488e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9bc33f26-0aab-4a14-832f-c58d566de1b0+57:10547:x1876402783704192:12345-192.168.201.23@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1789477412.857220:0:5846:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1789477412.857371:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d6d488e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9bc33f26-0aab-4a14-832f-c58d566de1b0+57:10547:x1876402783704192:12345-192.168.201.23@tcp:53:lhsmtool_posix.0 Request processed in 200us (367us total) trans 0 rc 0/0 00000100:00100000:3.0:1789477412.857380:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 112 00000100:00100000:2.0:1789477412.857603:0:11717:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d6d489500 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11717:1876402802592256:192.168.201.23@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1789477412.870741:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:1.0:1789477412.871453:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783704320 00000100:00100000:1.0:1789477412.871468:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783704320 00000100:00100000:1.0:1789477412.871558:0:6999:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 113 00000100:00100000:1.0:1789477412.871571:0:6999:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d6d489180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9bc33f26-0aab-4a14-832f-c58d566de1b0+56:10547:x1876402783704320:12345-192.168.201.23@tcp:34:lhsmtool_posix.0 00010000:00010000:1.0:1789477412.871711:0:6999:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f519e00/0xafddb3c8f9281eae lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477412.871743:0:6999:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f519e00/0xafddb3c8f9281eae lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477412.871758:0:6999:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f519e00/0xafddb3c8f9281eae lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477412.872159:0:6999:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f518600/0xafddb3c8f9281eb5 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477412.872185:0:6999:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f518600/0xafddb3c8f9281eb5 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477412.872199:0:6999:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f518600/0xafddb3c8f9281eb5 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477412.872238:0:6999:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f518c00/0xafddb3c8f9281ebc lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477412.872261:0:6999:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f518c00/0xafddb3c8f9281ebc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477412.872269:0:6999:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f518c00/0xafddb3c8f9281ebc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789477412.872328:0:6999:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:1.0:1789477412.872333:0:6999:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1789477412.872347:0:6999:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f518c00/0xafddb3c8f9281ebc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477412.872360:0:6999:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f519e00/0xafddb3c8f9281eae lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477412.872367:0:6999:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f519e00/0xafddb3c8f9281eae lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477412.872375:0:6999:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f519e00/0xafddb3c8f9281eae lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477412.872381:0:6999:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d0d7f519e00 already unused, calling callback (ffffffffc1fd54f0) 00010000:00010000:1.0:1789477412.872386:0:6999:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f519e00/0xafddb3c8f9281eae lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477412.872394:0:6999:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f519e00/0xafddb3c8f9281eae lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477412.872406:0:6999:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9d0d48f9be00) 00010000:00010000:1.0:1789477412.872410:0:6999:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789477412.872415:0:6999:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f519e00/0xafddb3c8f9281eae lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477412.872432:0:6999:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f519e00/0xafddb3c8f9281eae lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477412.872450:0:6999:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f518600/0xafddb3c8f9281eb5 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477412.872455:0:6999:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f518600/0xafddb3c8f9281eb5 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477412.872461:0:6999:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f518600/0xafddb3c8f9281eb5 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477412.872466:0:6999:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d0d7f518600 already unused, calling callback (ffffffffc1fd54f0) 00010000:00010000:1.0:1789477412.872470:0:6999:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f518600/0xafddb3c8f9281eb5 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477412.872475:0:6999:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f518600/0xafddb3c8f9281eb5 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477412.872483:0:6999:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x77a79f1b (ffff9d0d5b9f4700) 00010000:00010000:1.0:1789477412.872486:0:6999:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789477412.872488:0:6999:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f518600/0xafddb3c8f9281eb5 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477412.872494:0:6999:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f518600/0xafddb3c8f9281eb5 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477412.872511:0:6999:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f518c00/0xafddb3c8f9281ebc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477412.872517:0:6999:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f518c00/0xafddb3c8f9281ebc lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477412.872529:0:6999:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f518c00/0xafddb3c8f9281ebc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477412.872534:0:6999:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d0d7f518c00 already unused, calling callback (ffffffffc1fd54f0) 00010000:00010000:1.0:1789477412.872537:0:6999:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f518c00/0xafddb3c8f9281ebc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477412.872544:0:6999:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f518c00/0xafddb3c8f9281ebc lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477412.872553:0:6999:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9d0d5b9f4e00) 00010000:00010000:1.0:1789477412.872555:0:6999:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789477412.872558:0:6999:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f518c00/0xafddb3c8f9281ebc lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477412.872564:0:6999:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f518c00/0xafddb3c8f9281ebc lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789477412.873206:0:6999:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d6d489180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9bc33f26-0aab-4a14-832f-c58d566de1b0+56:10547:x1876402783704320:12345-192.168.201.23@tcp:34:lhsmtool_posix.0 Request processed in 1631us (2488us total) trans 0 rc 0/0 00000100:00100000:1.0:1789477412.873218:0:6999:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 113 00000100:00100000:0.0:1789477412.880989:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:3.0:1789477412.882350:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783704576 00000100:00100000:3.0:1789477412.882370:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783704576 00000100:00100000:3.0:1789477412.882446:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 114 00000100:00100000:3.0:1789477412.882471:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d7c64dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9bc33f26-0aab-4a14-832f-c58d566de1b0+56:10547:x1876402783704576:12345-192.168.201.23@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789477412.882515:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789477412.882543:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d59d6a400/0xafddb3c8f9281ec3 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa90d500d7b8f2c3a expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477412.882801:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d59d6b600/0xafddb3c8f9281eca lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477412.882823:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d59d6b600/0xafddb3c8f9281eca lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477412.882838:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d59d6b600/0xafddb3c8f9281eca lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789477412.882852:0:5846:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:3.0:1789477412.882972:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d59d6b600/0xafddb3c8f9281eca lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477412.882993:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d59d6b600/0xafddb3c8f9281eca lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477412.883001:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d59d6b600/0xafddb3c8f9281eca lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477412.883008:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d0d59d6b600 already unused, calling callback (ffffffffc1fd54f0) 00010000:00010000:3.0:1789477412.883014:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d59d6b600/0xafddb3c8f9281eca lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477412.883022:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d59d6b600/0xafddb3c8f9281eca lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477412.883039:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9d0d5b9f4e00) 00010000:00010000:3.0:1789477412.883050:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1789477412.883056:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d59d6b600/0xafddb3c8f9281eca lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477412.883063:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d59d6b600/0xafddb3c8f9281eca lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477412.883118:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d59d6a400/0xafddb3c8f9281ec3 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2c3a expref: 58 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477412.883130:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9d0d48f9be00) 00010000:00010000:3.0:1789477412.883143:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789477412.883148:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d59d6a400/0xafddb3c8f9281ec3 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2c3a expref: 58 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477412.883160:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d0d59d6a400, rc 0) 00000100:00100000:3.0:1789477412.883247:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d7c64dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9bc33f26-0aab-4a14-832f-c58d566de1b0+57:10547:x1876402783704576:12345-192.168.201.23@tcp:101:lhsmtool_posix.0 Request processed in 780us (2275us total) trans 4294967398 rc 301/301 00000100:00100000:3.0:1789477412.883256:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 114 00000100:00100000:3.0:1789477412.886091:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:2.0:1789477412.895152:0:6999:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783704704 00000100:00100000:2.0:1789477412.895176:0:6999:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783704704 00000100:00100000:2.0:1789477412.895254:0:6999:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 115 00000100:00100000:2.0:1789477412.895267:0:6999:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d6d48a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9bc33f26-0aab-4a14-832f-c58d566de1b0+57:10547:x1876402783704704:12345-192.168.201.23@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1789477412.895335:0:6999:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1789477412.895507:0:6999:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d6d48a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9bc33f26-0aab-4a14-832f-c58d566de1b0+57:10547:x1876402783704704:12345-192.168.201.23@tcp:53:lhsmtool_posix.0 Request processed in 242us (9432us total) trans 0 rc 0/0 00000100:00100000:2.0:1789477412.895516:0:6999:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 115 00000100:00100000:0.0:1789477412.901431:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:3.0:1789477412.901911:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783704960 00000100:00100000:3.0:1789477412.901926:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783704960 00000100:00100000:3.0:1789477412.902006:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 116 00000100:00100000:3.0:1789477412.902019:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d7c64ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9bc33f26-0aab-4a14-832f-c58d566de1b0+57:10547:x1876402783704960:12345-192.168.201.23@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789477412.902047:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789477412.902052:0:5846:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1789477412.902089:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49ecba00/0xafddb3c8f9281e68 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2c1e expref: 57 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477412.902143:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9d0d5b9f4000) 00010000:00010000:3.0:1789477412.902149:0:5846:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789477412.902167:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d59d6b400/0xafddb3c8f9281ed8 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa90d500d7b8f2c41 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789477412.909487:0:6730:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967302 is committed 00000001:00080000:1.0:1789477412.909513:0:6730:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967300 is committed 00000001:00080000:1.0:1789477412.909525:0:6730:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967303 is committed 00000004:00080000:2.0:1789477412.914065:0:5846:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x4:0x0], index 1: 0 00010000:00010000:2.0:1789477412.916151:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d41647a00/0xafddb3c8f9281edf lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477412.916182:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d41647a00/0xafddb3c8f9281edf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477412.916199:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d41647a00/0xafddb3c8f9281edf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477412.916323:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d59d6b400/0xafddb3c8f9281ed8 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2c41 expref: 59 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477412.916384:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d41647a00/0xafddb3c8f9281edf lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2c41 expref: 58 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477412.916395:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9d0d50919400) 00010000:00010000:2.0:1789477412.916399:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789477412.916403:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d0d41647a00, rc 0) 00000100:00100000:2.0:1789477412.917863:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d7c64ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9bc33f26-0aab-4a14-832f-c58d566de1b0+58:10547:x1876402783704960:12345-192.168.201.23@tcp:101:lhsmtool_posix.0 Request processed in 15833us (16435us total) trans 4294967399 rc 0/0 00000100:00100000:2.0:1789477412.917876:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 116 00000100:00100000:2.0:1789477412.921168:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:1.0:1789477412.921348:0:6999:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783705216 00000100:00100000:1.0:1789477412.921361:0:6999:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783705216 00000100:00100000:1.0:1789477412.921444:0:6999:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 117 00000100:00100000:1.0:1789477412.921467:0:6999:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d6d480e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9bc33f26-0aab-4a14-832f-c58d566de1b0+58:10547:x1876402783705216:12345-192.168.201.23@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1789477412.921562:0:6999:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789477412.921641:0:6999:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d41647a00/0xafddb3c8f9281edf lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2c41 expref: 58 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477412.921662:0:6999:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9d0d50919400) 00010000:00010000:1.0:1789477412.921677:0:6999:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789477412.921705:0:6999:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f518c00/0xafddb3c8f9281eed lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477412.922632:0:6999:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f518c00/0xafddb3c8f9281eed lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477412.922654:0:6999:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f518c00/0xafddb3c8f9281eed lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477412.922680:0:6999:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f518600/0xafddb3c8f9281ef4 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0xf9ed102c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477412.922688:0:6999:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f518600/0xafddb3c8f9281ef4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0xf9ed102c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477412.922695:0:6999:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f518600/0xafddb3c8f9281ef4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0xf9ed102c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477412.922807:0:6999:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f518c00/0xafddb3c8f9281eed lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477412.922816:0:6999:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f518c00/0xafddb3c8f9281eed lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477412.922823:0:6999:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f518c00/0xafddb3c8f9281eed lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477412.922829:0:6999:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d0d7f518c00 already unused, calling callback (ffffffffc1fd54f0) 00010000:00010000:1.0:1789477412.922845:0:6999:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f518c00/0xafddb3c8f9281eed lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477412.922854:0:6999:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f518c00/0xafddb3c8f9281eed lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477412.922865:0:6999:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9d0d5b9f4000) 00010000:00010000:1.0:1789477412.922868:0:6999:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789477412.922872:0:6999:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f518c00/0xafddb3c8f9281eed lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477412.922879:0:6999:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f518c00/0xafddb3c8f9281eed lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477412.922891:0:6999:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f518600/0xafddb3c8f9281ef4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0xf9ed102c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477412.922896:0:6999:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f518600/0xafddb3c8f9281ef4 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xf9ed102c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477412.922902:0:6999:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f518600/0xafddb3c8f9281ef4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xf9ed102c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477412.922908:0:6999:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d0d7f518600 already unused, calling callback (ffffffffc1fd54f0) 00010000:00010000:1.0:1789477412.922911:0:6999:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f518600/0xafddb3c8f9281ef4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xf9ed102c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477412.922916:0:6999:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f518600/0xafddb3c8f9281ef4 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xf9ed102c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477412.922922:0:6999:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0xf9ed102c (ffff9d0d5b9f4700) 00010000:00010000:1.0:1789477412.922924:0:6999:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789477412.922930:0:6999:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f518600/0xafddb3c8f9281ef4 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0xf9ed102c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477412.922937:0:6999:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f518600/0xafddb3c8f9281ef4 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0xf9ed102c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789477412.923046:0:6999:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d6d480e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9bc33f26-0aab-4a14-832f-c58d566de1b0+57:10547:x1876402783705216:12345-192.168.201.23@tcp:36:lhsmtool_posix.0 Request processed in 1588us (1888us total) trans 0 rc -2/-2 00000100:00100000:1.0:1789477412.923054:0:6999:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 117 00000100:00100000:3.0:1789477412.928244:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:0.0:1789477412.928357:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783705344 00000100:00100000:0.0:1789477412.928371:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783705344 00000100:00100000:0.0:1789477412.928460:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 118 00000100:00100000:0.0:1789477412.928473:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d6d48b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9bc33f26-0aab-4a14-832f-c58d566de1b0+57:10547:x1876402783705344:12345-192.168.201.23@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789477412.928515:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789477412.928548:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be5a00/0xafddb3c8f9281efb lrc: 2/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa90d500d7b8f2c48 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477412.928618:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be5200/0xafddb3c8f9281f02 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477412.928636:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be5200/0xafddb3c8f9281f02 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477412.928652:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be5200/0xafddb3c8f9281f02 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477412.928797:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be5a00/0xafddb3c8f9281efb lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2c48 expref: 59 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477412.928819:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be5200/0xafddb3c8f9281f02 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2c48 expref: 58 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477412.928830:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9d0d596ae500) 00010000:00010000:0.0:1789477412.928833:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1789477412.928837:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d0d50be5200, rc 0) 00000100:00100000:0.0:1789477412.928918:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d6d48b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9bc33f26-0aab-4a14-832f-c58d566de1b0+58:10547:x1876402783705344:12345-192.168.201.23@tcp:101:lhsmtool_posix.0 Request processed in 447us (689us total) trans 0 rc 0/0 00000100:00100000:0.0:1789477412.928926:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 118 00000100:00100000:0.0:1789477412.932212:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:2.0:1789477412.932299:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783705600 00000100:00100000:2.0:1789477412.932314:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783705600 00000100:00100000:2.0:1789477412.932397:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 119 00000100:00100000:2.0:1789477412.932412:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d7c64c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9bc33f26-0aab-4a14-832f-c58d566de1b0+58:10547:x1876402783705600:12345-192.168.201.23@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1789477412.932556:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d41647800/0xafddb3c8f9281f09 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477412.932630:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d41647800/0xafddb3c8f9281f09 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477412.932806:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d41647800/0xafddb3c8f9281f09 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1789477412.933171:0:5844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].5, 88 off8560 00000004:00080000:2.0:1789477412.933185:0:5844:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 358004606401ns, next at 359004601807ns, rc = 0 00000004:00010000:2.0:1789477412.933300:0:5844:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000dd7d3094 reply state 000000007badf454 transno 4294967400 ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d41647800/0xafddb3c8f9281f09 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789477412.933332:0:5844:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789477412.935163:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d7c64c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9bc33f26-0aab-4a14-832f-c58d566de1b0+60:10547:x1876402783705600:12345-192.168.201.23@tcp:36:lhsmtool_posix.0 Request processed in 2728us (2942us total) trans 4294967400 rc 0/0 00000100:00100000:2.0:1789477412.935180:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 119 00010000:00010000:0.0:1789477412.938857:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d41647800/0xafddb3c8f9281f09 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477412.938880:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d41647800/0xafddb3c8f9281f09 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477412.938889:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d41647800/0xafddb3c8f9281f09 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477412.938896:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d0d41647800 already unused, calling callback (ffffffffc1fd54f0) 00010000:00010000:0.0:1789477412.938903:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d41647800/0xafddb3c8f9281f09 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477412.938913:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d41647800/0xafddb3c8f9281f09 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477412.938937:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9d0d596ae500) 00010000:00010000:0.0:1789477412.938941:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1789477412.938946:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d41647800/0xafddb3c8f9281f09 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477412.938952:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d41647800/0xafddb3c8f9281f09 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789477412.948977:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:1.0:1789477412.950322:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783705728 00000100:00100000:1.0:1789477412.950343:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783705728 00000100:00100000:1.0:1789477412.950441:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 120 00000100:00100000:1.0:1789477412.950455:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d7c64f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9bc33f26-0aab-4a14-832f-c58d566de1b0+59:10547:x1876402783705728:12345-192.168.201.23@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789477412.950494:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789477412.950536:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f518600/0xafddb3c8f9281f10 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa90d500d7b8f2c4f expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477412.950677:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f518600/0xafddb3c8f9281f10 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2c4f expref: 60 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477412.950697:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f518600/0xafddb3c8f9281f10 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2c4f expref: 60 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477412.950734:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9d0d596ae500) 00010000:00010000:1.0:1789477412.950738:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789477412.950742:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d0d7f518600, rc 0) 00000100:00100000:1.0:1789477412.950828:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d7c64f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9bc33f26-0aab-4a14-832f-c58d566de1b0+60:10547:x1876402783705728:12345-192.168.201.23@tcp:101:lhsmtool_posix.0 Request processed in 376us (1865us total) trans 0 rc 0/0 00000100:00100000:1.0:1789477412.950836:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 120 00000100:00100000:2.0:1789477412.969677:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:3.0:1789477412.969830:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783705856 00000100:00100000:3.0:1789477412.969845:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783705856 00000100:00100000:3.0:1789477412.969944:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 38 00000100:00100000:3.0:1789477412.969958:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d6d481180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9bc33f26-0aab-4a14-832f-c58d566de1b0+8:2354:x1876402783705856:12345-192.168.201.23@tcp:2:lhsmtool_posix.0 00000100:00100000:3.0:1789477412.970485:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d6d481180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9bc33f26-0aab-4a14-832f-c58d566de1b0+9:2354:x1876402783705856:12345-192.168.201.23@tcp:2:lhsmtool_posix.0 Request processed in 528us (824us total) trans 4294967307 rc 0/0 00000100:00100000:3.0:1789477412.970494:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 38 00000100:00080000:1.0:1789477412.970594:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789477412.994223:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:1.0:1789477412.994391:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783706112 00000100:00100000:1.0:1789477412.994406:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783706112 00000100:00100000:1.0:1789477412.994499:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 30 00000100:00100000:1.0:1789477412.994513:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d6d489c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9bc33f26-0aab-4a14-832f-c58d566de1b0+60:10547:x1876402783706112:12345-192.168.201.23@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1789477412.994983:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d6d489c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9bc33f26-0aab-4a14-832f-c58d566de1b0+61:10547:x1876402783706112:12345-192.168.201.23@tcp:35:lhsmtool_posix.0 Request processed in 471us (770us total) trans 4294967401 rc 0/0 00000100:00100000:1.0:1789477412.994992:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 30 00000100:00100000:0.0:1789477412.999921:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:3.0:1789477413.000205:0:6999:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783706368 00000100:00100000:3.0:1789477413.000219:0:6999:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783706368 00000100:00100000:3.0:1789477413.001639:0:6999:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 121 00000100:00100000:3.0:1789477413.001669:0:6999:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d7c64c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9bc33f26-0aab-4a14-832f-c58d566de1b0+61:10547:x1876402783706368:12345-192.168.201.23@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1789477413.002712:0:6999:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d7c64c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9bc33f26-0aab-4a14-832f-c58d566de1b0+61:10547:x1876402783706368:12345-192.168.201.23@tcp:57:lhsmtool_posix.0 Request processed in 1051us (2797us total) trans 0 rc 0/0 00000100:00100000:3.0:1789477413.002726:0:6999:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 121 00000100:00100000:2.0:1789477413.006553:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:3.0:1789477413.006793:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783706496 00000100:00100000:3.0:1789477413.006805:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783706496 00000100:00100000:3.0:1789477413.006883:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 122 00000100:00100000:3.0:1789477413.006896:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d6d482680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9bc33f26-0aab-4a14-832f-c58d566de1b0+61:10547:x1876402783706496:12345-192.168.201.23@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789477413.006944:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789477413.006971:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d59d6a400/0xafddb3c8f9281f17 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa90d500d7b8f2c56 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477413.007077:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d59d6b600/0xafddb3c8f9281f1e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477413.007095:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d59d6b600/0xafddb3c8f9281f1e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477413.007108:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d59d6b600/0xafddb3c8f9281f1e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789477413.007164:0:5846:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1789477413.007185:0:5846:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d59d6b600/0xafddb3c8f9281f1e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477413.007215:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d59d6a400/0xafddb3c8f9281f17 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2c56 expref: 63 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477413.007242:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d59d6b600/0xafddb3c8f9281f1e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2c56 expref: 62 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477413.007253:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9d0d596ae500) 00010000:00010000:3.0:1789477413.007256:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1789477413.007261:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d0d59d6b600, rc 0) 00000100:00100000:3.0:1789477413.007343:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d6d482680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9bc33f26-0aab-4a14-832f-c58d566de1b0+62:10547:x1876402783706496:12345-192.168.201.23@tcp:101:lhsmtool_posix.0 Request processed in 449us (802us total) trans 0 rc 0/0 00000100:00100000:3.0:1789477413.007351:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 122 00000100:00100000:0.0:1789477413.016289:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:1.0:1789477413.016422:0:8241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783706624 00000100:00100000:1.0:1789477413.016436:0:8241:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783706624 00000100:00100000:1.0:1789477413.016529:0:8241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 39 00000100:00100000:1.0:1789477413.016541:0:8241:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d7c64c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9bc33f26-0aab-4a14-832f-c58d566de1b0+9:2355:x1876402783706624:12345-192.168.201.23@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789477413.016566:0:8241:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789477413.016638:0:8241:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006b2f4150/0xafddb3c8f9281f25 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa90d500d7b8f2c5d expref: -99 pid: 8241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789477413.016677:0:8241:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6aa94224, blocks: 0x1 00010000:00010000:1.0:1789477413.016703:0:8241:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=358s v=(0 0) 00010000:00010000:1.0:1789477413.016708:0:8241:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789477413.016719:0:8241:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006b2f4150/0xafddb3c8f9281f25 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2c5d expref: 10 pid: 8241 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477413.016743:0:8241:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000006b2f4150/0xafddb3c8f9281f25 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2c5d expref: 10 pid: 8241 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477413.016759:0:8241:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d0d7f518c00, rc 0) 00000100:00100000:1.0:1789477413.016850:0:8241:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d7c64c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9bc33f26-0aab-4a14-832f-c58d566de1b0+10:2355:x1876402783706624:12345-192.168.201.23@tcp:101:lhsmtool_posix.0 Request processed in 311us (585us total) trans 0 rc 0/0 00000100:00100000:1.0:1789477413.016858:0:8241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 39 00000100:00100000:0.0:1789477413.044890:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:3.0:1789477413.047243:0:6999:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783706880 00000100:00100000:3.0:1789477413.047273:0:6999:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783706880 00000100:00100000:3.0:1789477413.047365:0:6999:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 123 00000100:00100000:3.0:1789477413.047378:0:6999:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d7c64d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9bc33f26-0aab-4a14-832f-c58d566de1b0+62:10547:x1876402783706880:12345-192.168.201.23@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1789477413.047660:0:6999:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d7c64d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9bc33f26-0aab-4a14-832f-c58d566de1b0+62:10547:x1876402783706880:12345-192.168.201.23@tcp:57:lhsmtool_posix.0 Request processed in 284us (2785us total) trans 0 rc 0/0 00000100:00100000:3.0:1789477413.047669:0:6999:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 123 00000100:00100000:3.0:1789477413.068388:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:2.0:1789477413.068664:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783707008 00000100:00100000:2.0:1789477413.068680:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783707008 00000100:00100000:2.0:1789477413.068761:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 40 00000100:00100000:2.0:1789477413.068772:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d75413c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9bc33f26-0aab-4a14-832f-c58d566de1b0+10:10547:x1876402783707008:12345-192.168.201.23@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789477413.068797:0:6696:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789477413.068821:0:6696:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002c59c798/0xafddb3c8f9281f2c lrc: 2/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa90d500d7b8f2c64 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477413.068862:0:6696:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000006b2f4150/0xafddb3c8f9281f25 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2c5d expref: 11 pid: 8241 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477413.068872:0:6696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789477413.068877:0:6696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789477413.068882:0:6696:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002c59c798/0xafddb3c8f9281f2c lrc: 4/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2c64 expref: 11 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477413.068933:0:6696:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000006b2f4150/0xafddb3c8f9281f25 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2c5d expref: 11 pid: 8241 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477413.068950:0:6696:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000006b2f4150/0xafddb3c8f9281f25 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2c5d expref: 11 pid: 8241 timeout: 458 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789477413.068990:0:6696:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d6d483100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6696:1876402802592384:192.168.201.23@tcp:104: 00000100:00100000:2.0:1789477413.069155:0:6696:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d0d7c1ae780 going to sleep for 11 seconds 00000100:00100000:2.0:1789477413.073731:0:6696:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d6d483100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6696:1876402802592384:192.168.201.23@tcp:104: 00010000:00010000:2.0:1789477413.073788:0:6696:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000002c59c798/0xafddb3c8f9281f2c lrc: 3/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2c64 expref: 11 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477413.073827:0:6696:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d0d41647a00, rc 0) 00000100:00100000:2.0:1789477413.073954:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d75413c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9bc33f26-0aab-4a14-832f-c58d566de1b0+11:10547:x1876402783707008:12345-192.168.201.23@tcp:101:lhsmtool_posix.0 Request processed in 5181us (5581us total) trans 0 rc 0/0 00000100:00100000:2.0:1789477413.073965:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 40 00000100:00100000:0.0:1789477413.080752:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:1.0:1789477413.081145:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783707136 00000100:00100000:1.0:1789477413.081158:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783707136 00010000:00010000:1.0:1789477413.081211:0:5829:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000006b2f4150/0xafddb3c8f9281f25 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2c5d expref: 11 pid: 8241 timeout: 458 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789477413.081274:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 55 00000100:00100000:1.0:1789477413.081285:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d7c64f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9bc33f26-0aab-4a14-832f-c58d566de1b0+11:2355:x1876402783707136:12345-192.168.201.23@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789477413.081304:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789477413.081333:0:5829:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000006b2f4150/0xafddb3c8f9281f25 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2c5d expref: 11 pid: 8241 timeout: 458 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477413.081350:0:5829:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000006b2f4150/0xafddb3c8f9281f25 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2c5d expref: 11 pid: 8241 timeout: 458 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477413.081379:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006b2f4150/0xafddb3c8f9281f25 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2c5d expref: 11 pid: 8241 timeout: 458 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477413.081400:0:5829:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789477413.081405:0:5829:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789477413.081416:0:5829:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000002c59c798/0xafddb3c8f9281f2c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2c64 expref: 10 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477413.081428:0:5829:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002c59c798/0xafddb3c8f9281f2c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2c64 expref: 10 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477413.081493:0:5829:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000002c59c798/0xafddb3c8f9281f2c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2c64 expref: 10 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789477413.081510:0:5829:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d58070000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5829:1876402802592512:192.168.201.23@tcp:105: 00000100:00100000:1.0:1789477413.081661:0:5829:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d0d47741a80 going to sleep for 11 seconds 00000100:00100000:2.0:1789477413.104975:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:1.0:1789477413.105027:0:5829:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d58070000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5829:1876402802592512:192.168.201.23@tcp:105: 00010000:00010000:1.0:1789477413.105070:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789477413.105162:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d7c64f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9bc33f26-0aab-4a14-832f-c58d566de1b0+10:2355:x1876402783707136:12345-192.168.201.23@tcp:103:ldlm_bl.0 Request processed in 23876us (24422us total) trans 0 rc 0/0 00000100:00100000:1.0:1789477413.105176:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 55 00000100:00100000:3.0:1789477413.105374:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783707264 00000100:00100000:3.0:1789477413.105384:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783707264 00002000:00100000:3.0:1789477413.105562:0:6700:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x4:0x0] (0->12) req@ffff9d0d6d481180 x1876402783707264/t0(0) o4->9bc33f26-0aab-4a14-832f-c58d566de1b0@192.168.201.23@tcp:584/0 lens 504/0 e 0 to 0 dl 1789477424 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789477413.105601:0:6700:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9d0d6d481180 with x1876402783707264 ext(0->12) 00002000:00010000:3.0:1789477413.105606:0:6700:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9d0d6d481180 00000100:00100000:3.0:1789477413.105633:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 2 00000100:00100000:3.0:1789477413.105642:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d6d481180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:9bc33f26-0aab-4a14-832f-c58d566de1b0+10:2355:x1876402783707264:12345-192.168.201.23@tcp:4:lhsmtool_posix.0 00000100:00100000:3.0:1789477413.106367:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d6d481180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:9bc33f26-0aab-4a14-832f-c58d566de1b0+12:2355:x1876402783707264:12345-192.168.201.23@tcp:4:lhsmtool_posix.0 Request processed in 720us (1399us total) trans 4294967308 rc 0/0 00000100:00100000:3.0:1789477413.106377:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 2 00002000:00100000:3.0:1789477413.106386:0:6700:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x4:0x0] (0->12) req@ffff9d0d6d481180 x1876402783707264/t4294967308(0) o4->9bc33f26-0aab-4a14-832f-c58d566de1b0@192.168.201.23@tcp:584/0 lens 504/448 e 0 to 0 dl 1789477424 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789477413.106407:0:6700:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9d0d6d481180 with x1876402783707264 ext(0->12) 00002000:00010000:3.0:1789477413.106412:0:6700:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9d0d6d481180 00000100:00100000:0.0:1789477413.130777:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:3.0:1789477413.131346:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783707392 00000100:00100000:3.0:1789477413.131362:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783707392 00000100:00100000:2.0:1789477413.131676:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 124 00000100:00100000:2.0:1789477413.131688:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d7c64c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9bc33f26-0aab-4a14-832f-c58d566de1b0+62:10547:x1876402783707392:12345-192.168.201.23@tcp:44:lhsmtool_posix.0 00000001:00080000:1.0:1789477413.222865:0:5868:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967396 is committed 00000001:00080000:1.0:1789477413.225522:0:5868:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967401 is committed 00000004:00080000:1.0:1789477413.225559:0:5868:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3 committed 00000020:00080000:1.0:1789477413.225611:0:5868:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9d0d47741cc0 refcount 2 committed 0 result 0 batchid 3 00000020:00080000:1.0:1789477413.225618:0:5868:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9d0d47713e00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9d0d47741900 00000020:00080000:1.0:1789477413.225622:0:5868:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9d0d47713300 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9d0d7f68e400 00000020:00080000:1.0:1789477413.225670:0:5868:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9d0d50acbb40 refcount 2 committed 0 result 0 batchid 2 00000020:00080000:1.0:1789477413.225675:0:5868:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9d0d47713f00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9d0d50acba80 00000020:00080000:1.0:1789477413.225679:0:5868:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9d0d47713400 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9d0d74abb000 00000004:00080000:1.0:1789477413.225698:0:5868:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 6 committed 00000020:00080000:1.0:1789477413.225741:0:5868:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 1 batchid updated 00000004:00080000:1.0:1789477413.225761:0:5868:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 5 committed 00000020:00080000:1.0:1789477413.225788:0:5879:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 3 committed batchid 1 00000100:00100000:3.0:1789477413.225966:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d6d48aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1876402802592640:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1789477413.226062:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00080000:1.0:1789477413.226103:0:5879:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000100:00100000:3.0:1789477413.226170:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d6d488380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1876402802592768:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1789477413.226192:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789477413.226237:0:8241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802592640 00000100:00100000:3.0:1789477413.226246:0:8241:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802592640 00000100:00100000:1.0:1789477413.226249:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802592768 00000100:00100000:1.0:1789477413.226256:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802592768 00000100:00100000:1.0:1789477413.226493:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1789477413.226505:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d6d488700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3310:x1876402802592768:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1789477413.226631:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d7c64c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9bc33f26-0aab-4a14-832f-c58d566de1b0+15:10547:x1876402783707392:12345-192.168.201.23@tcp:44:lhsmtool_posix.0 Request processed in 94940us (95866us total) trans 0 rc 0/0 00000100:00100000:2.0:1789477413.226641:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 124 00002000:00010000:1.0:1789477413.226720:0:6697:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:1.0:1789477413.226725:0:6697:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb mtime from disk: 0 -> 1789477412 00002000:00010000:1.0:1789477413.226728:0:6697:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1789477413.226730:0:6697:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb ctime from disk: 1789477412 -> 1789477412 00002000:00010000:1.0:1789477413.226733:0:6697:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:1.0:1789477413.226782:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d6d488700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+8:3310:x1876402802592768:12345-0@lo:2:osp-syn-1-0.0 Request processed in 277us (587us total) trans 4294967309 rc 0/0 00000100:00100000:1.0:1789477413.226789:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1789477413.226805:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1789477413.226813:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d6d48b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3313:x1876402802592640:12345-0@lo:6:osp-syn-1-0.0 00000100:00080000:3.0:1789477413.227073:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000004:00080000:3.0:1789477413.227111:0:3310:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9d0d6d488380/2, rc 0, transno 4294967309 00000100:00100000:3.0:1789477413.227117:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d6d488380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1876402802592768:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1789477413.227213:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789477413.227224:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d7c64d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1876402802592896:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1789477413.227260:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789477413.227463:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802592896 00000100:00100000:0.0:1789477413.227483:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802592896 00000100:00100000:0.0:1789477413.227529:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1789477413.227539:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d6d483100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3310:x1876402802592896:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1789477413.227558:0:6696:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:3 count 1 00002000:00010000:0.0:1789477413.227624:0:6696:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x3:0x0] initial LVB size: 9, mtime: 0x6aa94223, atime: 0x6aa94223, ctime: 0x6aa94223, blocks: 0xb 00010000:00010000:0.0:1789477413.227634:0:6696:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000050199876/0xafddb3c8f9281f33 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477413.227658:0:6696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=358s v=(0 0) 00010000:00010000:0.0:1789477413.227663:0:6696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789477413.227671:0:6696:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000050199876/0xafddb3c8f9281f33 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477413.227691:0:6696:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000050199876/0xafddb3c8f9281f33 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477413.227703:0:6696:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000050199876/0xafddb3c8f9281f33 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477413.227712:0:6696:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000050199876/0xafddb3c8f9281f33 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477413.227740:0:6696:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789477413.227767:0:5833:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789477413.227776:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000050199876/0xafddb3c8f9281f33 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477413.227787:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d0d50be5a00 already unused, calling callback (ffffffffc15972a0) 00010000:00010000:3.0:1789477413.227793:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000050199876/0xafddb3c8f9281f33 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477413.227804:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000050199876/0xafddb3c8f9281f33 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477413.227826:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000050199876/0xafddb3c8f9281f33 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477413.227834:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000050199876/0xafddb3c8f9281f33 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477413.227856:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789477413.227864:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789477413.227866:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:1.0:1789477413.227990:0:6697:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:3 count 1 00010000:00010000:1.0:1789477413.228012:0:6697:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006b2f4150/0xafddb3c8f9281f3a lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477413.228029:0:6697:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000009f89a1db/0xafddb3c8f9281cf5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2bc3 expref: 11 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477413.228038:0:6697:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x3:0x0].0x0 since=2s v=(0 0) 00010000:00010000:1.0:1789477413.228041:0:6697:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789477413.228045:0:6697:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006b2f4150/0xafddb3c8f9281f3a lrc: 4/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477413.228170:0:6697:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000009f89a1db/0xafddb3c8f9281cf5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2bc3 expref: 11 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477413.228189:0:6697:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000009f89a1db/0xafddb3c8f9281cf5 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2bc3 expref: 11 pid: 6694 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789477413.228203:0:6697:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d58070000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6697:1876402802593024:192.168.201.23@tcp:104: 00000100:00100000:0.0:1789477413.229313:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d6d483100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3310:x1876402802592896:12345-0@lo:6:osp-syn-0-0.0 Request processed in 1770us (2045us total) trans 4294967304 rc 0/0 00000100:00100000:0.0:1789477413.229326:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1789477413.229462:0:6697:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d0d47741f00 going to sleep for 11 seconds 00000100:00100000:3.0:1789477413.238221:0:3310:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967303 gen 2 00000004:00080000:3.0:1789477413.238238:0:3310:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967300 committed transno 4294967303 00000004:00080000:3.0:1789477413.238273:0:3310:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9d0d50411180, transno 4294967301 00000004:00080000:3.0:1789477413.238298:0:3310:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967303 committed transno 4294967303 00000100:00100000:3.0:1789477413.238323:0:3310:0:(client.c:3169:ptlrpc_free_committed()) @@@ stopping search req@ffff9d0d7c64d500 x1876402802592896/t4294967304(4294967304) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1789477429 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:3.0:1789477413.238338:0:3310:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9d0d7c64d500/2, rc 0, transno 4294967304 00000100:00100000:3.0:1789477413.238345:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d7c64d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1876402802592896:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1789477413.239887:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:3.0:1789477413.239949:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783707520 00000100:00100000:3.0:1789477413.239962:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783707520 00000100:00100000:3.0:1789477413.240038:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 44 00000100:00100000:3.0:1789477413.240051:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d58072d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9bc33f26-0aab-4a14-832f-c58d566de1b0+12:2354:x1876402783707520:12345-192.168.201.23@tcp:16:lhsmtool_posix.0 00000100:00100000:3.0:1789477413.246926:0:6697:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d58070000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6697:1876402802593024:192.168.201.23@tcp:104: 00010000:00010000:3.0:1789477413.246977:0:6697:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000006b2f4150/0xafddb3c8f9281f3a lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789477413.250812:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:2.0:1789477413.251038:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783707648 00000100:00100000:2.0:1789477413.251053:0:6711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783707648 00010000:00010000:2.0:1789477413.251107:0:6711:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000009f89a1db/0xafddb3c8f9281cf5 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2bc3 expref: 13 pid: 6694 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789477413.251191:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 56 00000100:00100000:2.0:1789477413.251204:0:6711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d58072680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9bc33f26-0aab-4a14-832f-c58d566de1b0+13:2354:x1876402783707648:12345-192.168.201.23@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789477413.251224:0:6711:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789477413.251231:0:6711:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000009f89a1db/0xafddb3c8f9281cf5 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2bc3 expref: 13 pid: 6694 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477413.251247:0:6711:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000009f89a1db/0xafddb3c8f9281cf5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2bc3 expref: 13 pid: 6694 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477413.251288:0:6711:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009f89a1db/0xafddb3c8f9281cf5 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2bc3 expref: 13 pid: 6694 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477413.251311:0:6711:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789477413.251317:0:6711:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789477413.251324:0:6711:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000006b2f4150/0xafddb3c8f9281f3a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477413.251336:0:6711:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006b2f4150/0xafddb3c8f9281f3a lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477413.251371:0:6711:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789477413.251456:0:6711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d58072680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9bc33f26-0aab-4a14-832f-c58d566de1b0+12:2354:x1876402783707648:12345-192.168.201.23@tcp:103:ldlm_bl.0 Request processed in 247us (651us total) trans 0 rc 0/0 00000100:00100000:2.0:1789477413.251465:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 56 00010000:00010000:3.0:1789477413.252709:0:6697:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000006b2f4150/0xafddb3c8f9281f3a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477413.252731:0:6697:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006b2f4150/0xafddb3c8f9281f3a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477413.252744:0:6697:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006b2f4150/0xafddb3c8f9281f3a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477413.252768:0:6697:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006b2f4150/0xafddb3c8f9281f3a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477413.252797:0:6697:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789477413.252821:0:5832:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789477413.252831:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006b2f4150/0xafddb3c8f9281f3a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477413.252843:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d0d7f518c00 already unused, calling callback (ffffffffc15972a0) 00010000:00010000:2.0:1789477413.252848:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006b2f4150/0xafddb3c8f9281f3a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477413.252858:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006b2f4150/0xafddb3c8f9281f3a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477413.252879:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006b2f4150/0xafddb3c8f9281f3a lrc: 1/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477413.252887:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006b2f4150/0xafddb3c8f9281f3a lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477413.252912:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789477413.252914:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789477413.252916:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789477413.253629:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d6d48b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+8:3313:x1876402802592640:12345-0@lo:6:osp-syn-1-0.0 Request processed in 26763us (27515us total) trans 4294967310 rc 0/0 00000100:00100000:3.0:1789477413.253643:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000004:00080000:0.0:1789477413.253676:0:3313:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9d0d6d48aa00/2, rc 0, transno 4294967310 00000100:00100000:0.0:1789477413.253700:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d6d48aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1876402802592640:0@lo:6:osp-syn-1-0.0 00000001:00080000:2.0:1789477413.357547:0:7678:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967305 is committed 00000001:00080000:2.0:1789477413.357572:0:7678:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967309 is committed 00000100:00100000:1.0:1789477413.358264:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d58072d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9bc33f26-0aab-4a14-832f-c58d566de1b0+11:2354:x1876402783707520:12345-192.168.201.23@tcp:16:lhsmtool_posix.0 Request processed in 118203us (118377us total) trans 0 rc 0/0 00000100:00100000:1.0:1789477413.358280:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 44 00000001:00080000:2.0:1789477413.358557:0:7678:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967306 is committed 00000001:00080000:2.0:1789477413.358596:0:7678:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967308 is committed 00000100:00100000:1.0:1789477413.362177:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:3.0:1789477413.362266:0:6999:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783707904 00000100:00100000:3.0:1789477413.362281:0:6999:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783707904 00000100:00100000:3.0:1789477413.362359:0:6999:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 125 00000100:00100000:3.0:1789477413.362372:0:6999:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d58070000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9bc33f26-0aab-4a14-832f-c58d566de1b0+15:10547:x1876402783707904:12345-192.168.201.23@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1789477413.362745:0:6999:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789477413.362784:0:6999:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d59d6b600/0xafddb3c8f9281f1e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2c56 expref: 15 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477413.362815:0:6999:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9d0d596ae500) 00010000:00010000:3.0:1789477413.362821:0:6999:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789477413.362861:0:6999:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d59d6a400/0xafddb3c8f9281f41 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477413.362879:0:6999:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d59d6a400/0xafddb3c8f9281f41 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477413.362892:0:6999:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d59d6a400/0xafddb3c8f9281f41 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789477413.364074:0:6999:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000095def937 reply state 000000003e069cd1 transno 4294967402 ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d59d6a400/0xafddb3c8f9281f41 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789477413.364117:0:6999:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789477413.364330:0:6999:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d58070000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9bc33f26-0aab-4a14-832f-c58d566de1b0+16:10547:x1876402783707904:12345-192.168.201.23@tcp:36:lhsmtool_posix.0 Request processed in 1956us (2162us total) trans 4294967402 rc 0/0 00000100:00100000:3.0:1789477413.364340:0:6999:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 125 00000100:00100000:0.0:1789477413.368044:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:1.0:1789477413.368412:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783708032 00000100:00100000:1.0:1789477413.368433:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783708032 00000100:00100000:1.0:1789477413.368543:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 45 00000100:00100000:1.0:1789477413.368560:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d7c64e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9bc33f26-0aab-4a14-832f-c58d566de1b0+6:2352:x1876402783708032:12345-192.168.201.23@tcp:2:lhsmtool_posix.0 00002000:00010000:1.0:1789477413.369047:0:6696:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:1.0:1789477413.369053:0:6696:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb mtime from disk: 1789477412 -> 1789477411 00002000:00010000:1.0:1789477413.369056:0:6696:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb atime from disk: 0 -> 1789477411 00002000:00010000:1.0:1789477413.369058:0:6696:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb ctime from disk: 1789477412 -> 1789477411 00002000:00010000:1.0:1789477413.369060:0:6696:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:1.0:1789477413.369266:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d7c64e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9bc33f26-0aab-4a14-832f-c58d566de1b0+7:2352:x1876402783708032:12345-192.168.201.23@tcp:2:lhsmtool_posix.0 Request processed in 706us (1237us total) trans 4294967311 rc 0/0 00000100:00100000:1.0:1789477413.369298:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 45 00010000:00010000:2.0:1789477413.369700:0:3296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d59d6a400/0xafddb3c8f9281f41 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477413.369720:0:3296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d59d6a400/0xafddb3c8f9281f41 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477413.369750:0:3296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d59d6a400/0xafddb3c8f9281f41 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477413.369759:0:3296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d0d59d6a400 already unused, calling callback (ffffffffc1fd54f0) 00010000:00010000:2.0:1789477413.369767:0:3296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d59d6a400/0xafddb3c8f9281f41 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477413.369780:0:3296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d59d6a400/0xafddb3c8f9281f41 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477413.369817:0:3296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9d0d596ae500) 00010000:00010000:2.0:1789477413.369821:0:3296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789477413.369831:0:3296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d59d6a400/0xafddb3c8f9281f41 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477413.369838:0:3296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d59d6a400/0xafddb3c8f9281f41 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789477413.378663:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:1.0:1789477413.379063:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783708288 00000100:00100000:1.0:1789477413.379079:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783708288 00000100:00100000:1.0:1789477413.379168:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 126 00000100:00100000:1.0:1789477413.379182:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d6d481c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9bc33f26-0aab-4a14-832f-c58d566de1b0+15:10547:x1876402783708288:12345-192.168.201.23@tcp:55:lhsmtool_posix.0 00010000:00010000:1.0:1789477413.379284:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f519200/0xafddb3c8f9281f48 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477413.379305:0:5845:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be5200/0xafddb3c8f9281f02 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2c48 expref: 15 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477413.379317:0:5845:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f519200/0xafddb3c8f9281f48 lrc: 4/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477413.379367:0:5845:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be5200/0xafddb3c8f9281f02 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2c48 expref: 15 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477413.379382:0:5845:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be5200/0xafddb3c8f9281f02 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2c48 expref: 15 pid: 5845 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789477413.379399:0:5845:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d7f738a80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5845:1876402802593152:192.168.201.23@tcp:104: 00000100:00100000:1.0:1789477413.379630:0:5845:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d0d47741c00 going to sleep for 11 seconds 00000100:00100000:0.0:1789477413.395012:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:1.0:1789477413.395213:0:5845:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d7f738a80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5845:1876402802593152:192.168.201.23@tcp:104: 00010000:00010000:1.0:1789477413.395254:0:5845:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f519200/0xafddb3c8f9281f48 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789477413.400743:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783708416 00000100:00100000:3.0:1789477413.400770:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783708416 00010000:00010000:2.0:1789477413.401856:0:5831:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be5200/0xafddb3c8f9281f02 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2c48 expref: 16 pid: 5845 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789477413.401997:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 57 00000100:00100000:2.0:1789477413.402011:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d7c64fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9bc33f26-0aab-4a14-832f-c58d566de1b0+16:2355:x1876402783708416:12345-192.168.201.23@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789477413.402032:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789477413.402040:0:5831:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be5200/0xafddb3c8f9281f02 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2c48 expref: 16 pid: 5845 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477413.402083:0:5831:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be5200/0xafddb3c8f9281f02 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2c48 expref: 16 pid: 5845 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477413.402113:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be5200/0xafddb3c8f9281f02 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2c48 expref: 16 pid: 5845 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477413.402149:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9d0d596ae500) 00010000:00010000:2.0:1789477413.402156:0:5831:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f519200/0xafddb3c8f9281f48 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477413.402167:0:5831:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f519200/0xafddb3c8f9281f48 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477413.402177:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f519200/0xafddb3c8f9281f48 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477413.402219:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789477413.402304:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d7c64fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9bc33f26-0aab-4a14-832f-c58d566de1b0+15:2355:x1876402783708416:12345-192.168.201.23@tcp:103:ldlm_bl.0 Request processed in 296us (7310us total) trans 0 rc 0/0 00000100:00100000:2.0:1789477413.402313:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 57 00010000:00010000:0.0:1789477413.403200:0:5845:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f519200/0xafddb3c8f9281f48 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477413.403216:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f519200/0xafddb3c8f9281f48 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477413.403255:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f519200/0xafddb3c8f9281f48 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477413.403264:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f519200/0xafddb3c8f9281f48 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477413.403271:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f519200/0xafddb3c8f9281f48 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477413.403278:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d0d7f519200 already unused, calling callback (ffffffffc1fd54f0) 00010000:00010000:0.0:1789477413.403283:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f519200/0xafddb3c8f9281f48 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477413.403292:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f519200/0xafddb3c8f9281f48 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477413.403306:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9d0d596ae500) 00010000:00010000:0.0:1789477413.403309:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:0.0:1789477413.403314:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f519200/0xafddb3c8f9281f48 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477413.403321:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f519200/0xafddb3c8f9281f48 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789477413.403435:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d6d481c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9bc33f26-0aab-4a14-832f-c58d566de1b0+14:10547:x1876402783708288:12345-192.168.201.23@tcp:55:lhsmtool_posix.0 Request processed in 24249us (24782us total) trans 0 rc -22/-22 00000100:00100000:0.0:1789477413.403454:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 126 00000100:00100000:0.0:1789477413.415369:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:3.0:1789477413.415780:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783708544 00000100:00100000:3.0:1789477413.415795:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783708544 00000100:00100000:3.0:1789477413.415870:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 46 00000100:00100000:3.0:1789477413.415883:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d6d3d5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9bc33f26-0aab-4a14-832f-c58d566de1b0+7:2354:x1876402783708544:12345-192.168.201.23@tcp:1:lhsmtool_posix.0 00010000:00010000:3.0:1789477413.415948:0:6697:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000a29b55f4/0xafddb3c8f9281f4f lrc: 3/1,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477413.415977:0:6697:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000002c59c798/0xafddb3c8f9281f2c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2c64 expref: 7 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477413.415989:0:6697:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789477413.415994:0:6697:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789477413.416000:0:6697:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a29b55f4/0xafddb3c8f9281f4f lrc: 4/1,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477413.416055:0:6697:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000002c59c798/0xafddb3c8f9281f2c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2c64 expref: 7 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477413.416073:0:6697:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000002c59c798/0xafddb3c8f9281f2c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2c64 expref: 7 pid: 6696 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789477413.416122:0:6697:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d6d488000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6697:1876402802593280:192.168.201.23@tcp:104: 00000100:00100000:3.0:1789477413.416262:0:6697:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d0d4639a540 going to sleep for 11 seconds 00000100:00100000:3.0:1789477413.420963:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:1.0:1789477413.421148:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783708672 00000100:00100000:1.0:1789477413.421183:0:6711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783708672 00010000:00010000:1.0:1789477413.421249:0:6711:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000002c59c798/0xafddb3c8f9281f2c lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2c64 expref: 8 pid: 6696 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789477413.421303:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 58 00000100:00100000:1.0:1789477413.421316:0:6711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d6d489880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9bc33f26-0aab-4a14-832f-c58d566de1b0+8:2355:x1876402783708672:12345-192.168.201.23@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789477413.421341:0:6711:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789477413.421380:0:6711:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000002c59c798/0xafddb3c8f9281f2c lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2c64 expref: 8 pid: 6696 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477413.421396:0:6711:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000002c59c798/0xafddb3c8f9281f2c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2c64 expref: 8 pid: 6696 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477413.421437:0:6711:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789477413.421442:0:6711:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789477413.421460:0:6711:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000a29b55f4/0xafddb3c8f9281f4f lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477413.421473:0:6711:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a29b55f4/0xafddb3c8f9281f4f lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477413.421509:0:6711:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789477413.421621:0:6711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d6d489880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9bc33f26-0aab-4a14-832f-c58d566de1b0+8:2355:x1876402783708672:12345-192.168.201.23@tcp:103:ldlm_bl.0 Request processed in 306us (676us total) trans 0 rc 0/0 00000100:00100000:1.0:1789477413.421639:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 58 00010000:00010000:0.0:1789477413.423853:0:6697:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002c59c798/0xafddb3c8f9281f2c lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2c64 expref: 7 pid: 6696 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789477413.423890:0:6697:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d6d488000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6697:1876402802593280:192.168.201.23@tcp:104: 00010000:00010000:0.0:1789477413.423921:0:6697:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000a29b55f4/0xafddb3c8f9281f4f lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477413.423934:0:6697:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000a29b55f4/0xafddb3c8f9281f4f lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477413.423942:0:6697:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a29b55f4/0xafddb3c8f9281f4f lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477413.423992:0:6697:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000a29b55f4/0xafddb3c8f9281f4f lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477413.424001:0:6697:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a29b55f4/0xafddb3c8f9281f4f lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477413.424011:0:6697:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a29b55f4/0xafddb3c8f9281f4f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477413.424047:0:6697:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d0d59d6b600 already unused, calling callback (ffffffffc15972a0) 00010000:00010000:0.0:1789477413.424052:0:6697:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a29b55f4/0xafddb3c8f9281f4f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477413.424062:0:6697:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a29b55f4/0xafddb3c8f9281f4f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477413.424088:0:6697:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a29b55f4/0xafddb3c8f9281f4f lrc: 2/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477413.424097:0:6697:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a29b55f4/0xafddb3c8f9281f4f lrc: 0/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789477413.424234:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d6d3d5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9bc33f26-0aab-4a14-832f-c58d566de1b0+6:2354:x1876402783708544:12345-192.168.201.23@tcp:1:lhsmtool_posix.0 Request processed in 8353us (8882us total) trans 0 rc 0/0 00000100:00100000:0.0:1789477413.424245:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 46 00000100:00100000:3.0:1789477413.428917:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:0.0:1789477413.429116:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783708928 00000100:00100000:0.0:1789477413.429140:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783708928 00000100:00100000:0.0:1789477413.429206:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 127 00000100:00100000:0.0:1789477413.429219:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d6d48b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9bc33f26-0aab-4a14-832f-c58d566de1b0+14:10547:x1876402783708928:12345-192.168.201.23@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1789477413.429334:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be5800/0xafddb3c8f9281f56 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477413.429357:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be5800/0xafddb3c8f9281f56 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477413.429393:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be5800/0xafddb3c8f9281f56 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477413.429701:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be4a00/0xafddb3c8f9281f5d lrc: 3/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477413.429713:0:5844:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f518600/0xafddb3c8f9281f10 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2c4f expref: 15 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477413.429722:0:5844:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be4a00/0xafddb3c8f9281f5d lrc: 4/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477413.429767:0:5844:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f518600/0xafddb3c8f9281f10 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2c4f expref: 15 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477413.429786:0:5844:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f518600/0xafddb3c8f9281f10 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2c4f expref: 15 pid: 5845 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789477413.429802:0:5844:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d6d3d5c00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5844:1876402802593408:192.168.201.23@tcp:104: 00000100:00100000:0.0:1789477413.429927:0:5844:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d0d75453b40 going to sleep for 11 seconds 00000100:00100000:0.0:1789477413.437167:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:2.0:1789477413.437288:0:5844:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d6d3d5c00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5844:1876402802593408:192.168.201.23@tcp:104: 00010000:00010000:2.0:1789477413.437337:0:5844:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be4a00/0xafddb3c8f9281f5d lrc: 3/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789477413.437439:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783709056 00000100:00100000:1.0:1789477413.437464:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783709056 00010000:00010000:1.0:1789477413.437571:0:5829:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f518600/0xafddb3c8f9281f10 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2c4f expref: 16 pid: 5845 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789477413.437669:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 59 00000100:00100000:1.0:1789477413.437682:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d7f545c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9bc33f26-0aab-4a14-832f-c58d566de1b0+16:2354:x1876402783709056:12345-192.168.201.23@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789477413.437704:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789477413.437714:0:5829:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f518600/0xafddb3c8f9281f10 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2c4f expref: 16 pid: 5845 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477413.437729:0:5829:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f518600/0xafddb3c8f9281f10 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2c4f expref: 16 pid: 5845 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477413.437764:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f518600/0xafddb3c8f9281f10 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2c4f expref: 16 pid: 5845 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477413.437787:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9d0d596ae500) 00010000:00010000:1.0:1789477413.437794:0:5829:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be4a00/0xafddb3c8f9281f5d lrc: 3/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477413.437807:0:5829:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be4a00/0xafddb3c8f9281f5d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477413.437817:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be4a00/0xafddb3c8f9281f5d lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477413.437849:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789477413.437934:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d7f545c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9bc33f26-0aab-4a14-832f-c58d566de1b0+15:2354:x1876402783709056:12345-192.168.201.23@tcp:103:ldlm_bl.0 Request processed in 253us (784us total) trans 0 rc 0/0 00000100:00100000:1.0:1789477413.437942:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 59 00010000:00010000:0.0:1789477413.439206:0:5844:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be4a00/0xafddb3c8f9281f5d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477413.439227:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be4a00/0xafddb3c8f9281f5d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789477413.439508:0:5844:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967403 00000001:00080000:0.0:1789477413.440081:0:5844:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967404 00000001:00080000:0.0:1789477413.440167:0:5844:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967405 00000100:00100000:0.0:1789477413.440294:0:5844:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d7f545f80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5844:1876402802593536:0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1789477413.440393:0:5844:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789477413.440685:0:5844:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d0d50a28540 going to sleep for 11 seconds 00000100:00100000:3.0:1789477413.441161:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802593536 00000100:00100000:3.0:1789477413.441175:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802593536 00000100:00100000:3.0:1789477413.441302:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1789477413.441315:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d7f544000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5844:x1876402802593536:12345-0@lo:1000:mdt00_000.0 00000100:00100000:3.0:1789477413.441454:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d7f544000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5844:x1876402802593536:12345-0@lo:1000:mdt00_000.0 Request processed in 142us (1061us total) trans 0 rc 0/0 00000100:00100000:3.0:1789477413.441463:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1789477413.441543:0:5844:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967309 gen 2 00000004:00080000:0.0:1789477413.441551:0:5844:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967305 committed transno 4294967309 00000004:00080000:0.0:1789477413.441610:0:5844:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9d0d6d488380, transno 4294967309 00000100:00100000:0.0:1789477413.441644:0:5844:0:(client.c:3169:ptlrpc_free_committed()) @@@ stopping search req@ffff9d0d6d48aa00 x1876402802592640/t4294967310(4294967310) o6->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1789477429 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789477413.441659:0:5844:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d7f545f80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5844:1876402802593536:0@lo:1000:mdt00_000.0 00000001:00080000:0.0:1789477413.442968:0:5844:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967406 00000100:00100000:0.0:1789477413.443062:0:5844:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d7f545f80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5844:1876402802593664:0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1789477413.443154:0:5844:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789477413.443605:0:5844:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d0d51503f00 going to sleep for 11 seconds 00000100:00100000:2.0:1789477413.443746:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802593664 00000100:00100000:2.0:1789477413.443757:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802593664 00000100:00100000:2.0:1789477413.443809:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1789477413.443820:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d58073800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5844:x1876402802593664:12345-0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1789477413.444104:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d58073800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:5844:x1876402802593664:12345-0@lo:1000:mdt00_000.0 Request processed in 285us (950us total) trans 4294967312 rc 0/0 00000100:00100000:2.0:1789477413.444113:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1789477413.444228:0:5844:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d7f545f80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5844:1876402802593664:0@lo:1000:mdt00_000.0 00010000:00010000:0.0:1789477413.444278:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be4a00/0xafddb3c8f9281f5d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477413.444292:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be4a00/0xafddb3c8f9281f5d lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477413.444300:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be4a00/0xafddb3c8f9281f5d lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477413.444307:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d0d50be4a00 already unused, calling callback (ffffffffc1fd54f0) 00010000:00010000:0.0:1789477413.444312:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be4a00/0xafddb3c8f9281f5d lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477413.444321:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be4a00/0xafddb3c8f9281f5d lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477413.444347:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9d0d596ae500) 00010000:00010000:0.0:1789477413.444350:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789477413.444355:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be4a00/0xafddb3c8f9281f5d lrc: 2/0,0 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477413.444362:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be4a00/0xafddb3c8f9281f5d lrc: 0/0,0 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477413.444399:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f519000/0xafddb3c8f9281ea0 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477413.444405:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f519000/0xafddb3c8f9281ea0 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477413.444411:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f519000/0xafddb3c8f9281ea0 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477413.444417:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d0d7f519000 already unused, calling callback (ffffffffc1fd54f0) 00010000:00010000:0.0:1789477413.444420:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f519000/0xafddb3c8f9281ea0 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477413.444426:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f519000/0xafddb3c8f9281ea0 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477413.444433:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9d0d5b9f4e00) 00010000:00010000:0.0:1789477413.444435:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789477413.444443:0:5844:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f518200/0xafddb3c8f9281ea7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2c33 expref: 18 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477413.444455:0:5844:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f518200/0xafddb3c8f9281ea7 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2c33 expref: 18 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477413.444472:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f518200/0xafddb3c8f9281ea7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2c33 expref: 18 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477413.444934:0:5844:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f518200/0xafddb3c8f9281ea7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2c33 expref: 18 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789477413.444951:0:5844:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d6d467480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5844:1876402802593792:192.168.201.23@tcp:105: 00000100:00100000:0.0:1789477413.452938:0:5844:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d0d754530c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789477413.476077:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:2.0:1789477413.476269:0:5844:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d6d467480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5844:1876402802593792:192.168.201.23@tcp:105: 00010000:00010000:2.0:1789477413.476318:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f519000/0xafddb3c8f9281ea0 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477413.476331:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f519000/0xafddb3c8f9281ea0 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477413.476391:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d41647a00/0xafddb3c8f9281f64 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477413.476409:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d41647a00/0xafddb3c8f9281f64 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477413.476425:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d41647a00/0xafddb3c8f9281f64 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477413.476440:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d41647a00/0xafddb3c8f9281f64 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477413.476447:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d41647a00/0xafddb3c8f9281f64 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477413.476454:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d41647a00/0xafddb3c8f9281f64 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477413.476460:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d0d41647a00 already unused, calling callback (ffffffffc1fd54f0) 00010000:00010000:2.0:1789477413.476465:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d41647a00/0xafddb3c8f9281f64 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477413.476503:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d41647a00/0xafddb3c8f9281f64 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477413.476519:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9d0d5b9f4e00) 00010000:00010000:2.0:1789477413.476522:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789477413.476526:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d41647a00/0xafddb3c8f9281f64 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477413.476533:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d41647a00/0xafddb3c8f9281f64 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477413.476545:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be5800/0xafddb3c8f9281f56 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477413.476551:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be5800/0xafddb3c8f9281f56 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477413.476558:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be5800/0xafddb3c8f9281f56 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477413.476564:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d0d50be5800 already unused, calling callback (ffffffffc1fd54f0) 00010000:00010000:2.0:1789477413.476567:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be5800/0xafddb3c8f9281f56 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477413.476573:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be5800/0xafddb3c8f9281f56 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477413.476649:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9d0d5b9f4e00) 00010000:00010000:2.0:1789477413.476651:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1789477413.476655:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be5800/0xafddb3c8f9281f56 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477413.476672:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be5800/0xafddb3c8f9281f56 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789477413.476992:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d6d48b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9bc33f26-0aab-4a14-832f-c58d566de1b0+18:10547:x1876402783708928:12345-192.168.201.23@tcp:57:lhsmtool_posix.0 Request processed in 47774us (48091us total) trans 4294967407 rc 0/0 00000100:00100000:2.0:1789477413.477005:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 127 00000020:00080000:2.0:1789477413.477012:0:5844:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000100:00100000:1.0:1789477413.477161:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783709184 00000100:00100000:1.0:1789477413.477173:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783709184 00000100:00100000:1.0:1789477413.477249:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 31 00000100:00100000:1.0:1789477413.477260:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d6d464e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9bc33f26-0aab-4a14-832f-c58d566de1b0+18:10546:x1876402783709184:12345-192.168.201.23@tcp:49:lfs.0 00000100:00100000:1.0:1789477413.477390:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d6d464e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9bc33f26-0aab-4a14-832f-c58d566de1b0+18:10546:x1876402783709184:12345-192.168.201.23@tcp:49:lfs.0 Request processed in 132us (1332us total) trans 0 rc 0/0 00000100:00100000:1.0:1789477413.477397:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 31 00000040:00080000:0.0:1789477413.478050:0:11717:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1789477413.478059:0:11717:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1789477413.478641:0:11717:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:0.0:1789477413.478652:0:11717:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1789477413.481079:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:1.0:1789477413.481140:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:2.0:1789477413.481217:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783709696 00000100:00100000:2.0:1789477413.481231:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783709696 00000100:00100000:2.0:1789477413.481304:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 32 00000100:00100000:2.0:1789477413.481316:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d5845e850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9bc33f26-0aab-4a14-832f-c58d566de1b0+18:10547:x1876402783709696:12345-192.168.201.23@tcp:35:lhsmtool_posix.0 00000004:00080000:2.0:1789477413.482239:0:5848:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x9:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:2.0:1789477413.482370:0:5848:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967408 00010000:00010000:2.0:1789477413.482431:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d41647000/0xafddb3c8f9281f6b lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477413.482454:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d41647000/0xafddb3c8f9281f6b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477413.482470:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d41647000/0xafddb3c8f9281f6b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477413.482481:0:5848:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d41647000/0xafddb3c8f9281f6b lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477413.482488:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d41647000/0xafddb3c8f9281f6b lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477413.482495:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d41647000/0xafddb3c8f9281f6b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477413.482538:0:5848:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1789477413.482695:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d5845e850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9bc33f26-0aab-4a14-832f-c58d566de1b0+20:10547:x1876402783709696:12345-192.168.201.23@tcp:35:lhsmtool_posix.0 Request processed in 1376us (1549us total) trans 4294967409 rc 0/0 00000100:00100000:2.0:1789477413.482706:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 32 00000020:00080000:2.0:1789477413.482712:0:5848:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1789477413.483055:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783709440 00000100:00100000:3.0:1789477413.483065:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783709440 00000100:00100000:3.0:1789477413.483120:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 128 00000100:00100000:3.0:1789477413.483141:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d7f738a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9bc33f26-0aab-4a14-832f-c58d566de1b0+20:10546:x1876402783709440:12345-192.168.201.23@tcp:58:lfs.0 00000040:00080000:3.0:1789477413.483374:0:5846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].3, 136 off8600 00000100:00100000:3.0:1789477413.483428:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d7f738a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9bc33f26-0aab-4a14-832f-c58d566de1b0+20:10546:x1876402783709440:12345-192.168.201.23@tcp:58:lfs.0 Request processed in 289us (2364us total) trans 0 rc 0/0 00000100:00100000:3.0:1789477413.483435:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 128 00010000:00010000:1.0:1789477413.485058:0:6710:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789477413.485077:0:6710:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d41647000/0xafddb3c8f9281f6b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477413.485091:0:6710:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d0d41647000 already unused, calling callback (ffffffffc15972a0) 00010000:00010000:1.0:1789477413.485096:0:6710:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d41647000/0xafddb3c8f9281f6b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477413.485107:0:6710:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d41647000/0xafddb3c8f9281f6b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477413.485141:0:6710:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9d0d50919000) 00010000:00010000:1.0:1789477413.485145:0:6710:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1789477413.485151:0:6710:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d41647000/0xafddb3c8f9281f6b lrc: 1/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477413.485158:0:6710:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d41647000/0xafddb3c8f9281f6b lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477413.485193:0:6710:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789477413.485195:0:6710:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789477413.485219:0:6710:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789477413.532215:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:1.0:1789477413.532356:0:6999:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783709824 00000100:00100000:1.0:1789477413.532371:0:6999:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783709824 00000100:00100000:1.0:1789477413.532462:0:6999:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 129 00000100:00100000:1.0:1789477413.532477:0:6999:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d6d48ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9bc33f26-0aab-4a14-832f-c58d566de1b0+20:10549:x1876402783709824:12345-192.168.201.23@tcp:101:lfs.0 00010000:00010000:1.0:1789477413.532526:0:6999:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789477413.532565:0:6999:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f518600/0xafddb3c8f9281f72 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa90d500d7b8f2c6b expref: -99 pid: 6999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477413.532707:0:6999:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f518a00/0xafddb3c8f9281f79 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477413.532726:0:6999:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f518a00/0xafddb3c8f9281f79 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477413.532740:0:6999:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f518a00/0xafddb3c8f9281f79 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477413.532757:0:6999:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f518800/0xafddb3c8f9281f80 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477413.532765:0:6999:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f518800/0xafddb3c8f9281f80 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477413.532772:0:6999:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f518800/0xafddb3c8f9281f80 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477413.533175:0:6999:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f519000/0xafddb3c8f9281f87 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477413.533189:0:6999:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d41646a00/0xafddb3c8f9281e92 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2c2c expref: 21 pid: 6999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477413.533213:0:6999:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f519000/0xafddb3c8f9281f87 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477413.533258:0:6999:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d41646a00/0xafddb3c8f9281e92 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2c2c expref: 21 pid: 6999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477413.533276:0:6999:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d41646a00/0xafddb3c8f9281e92 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2c2c expref: 21 pid: 6999 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789477413.533293:0:6999:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d7f73a680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6999:1876402802593920:192.168.201.23@tcp:104: 00000100:00100000:1.0:1789477413.533422:0:6999:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d0d47741c00 going to sleep for 11 seconds 00000100:00100000:1.0:1789477413.539149:0:6999:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d7f73a680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6999:1876402802593920:192.168.201.23@tcp:104: 00010000:00010000:1.0:1789477413.539197:0:6999:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f519000/0xafddb3c8f9281f87 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789477413.541199:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:2.0:1789477413.541324:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783710080 00000100:00100000:2.0:1789477413.541338:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783710080 00000100:00100000:2.0:1789477413.541409:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 33 00000100:00100000:2.0:1789477413.541421:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d6d489c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9bc33f26-0aab-4a14-832f-c58d566de1b0+22:5604:x1876402783710080:12345-192.168.201.23@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1789477413.542518:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d6d489c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9bc33f26-0aab-4a14-832f-c58d566de1b0+23:5604:x1876402783710080:12345-192.168.201.23@tcp:35:ldlm_bl.0 Request processed in 1090us (1322us total) trans 4294967410 rc 0/0 00000100:00100000:3.0:1789477413.542532:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 33 00000100:00100000:0.0:1789477413.546029:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:3.0:1789477413.546199:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783710208 00000100:00100000:3.0:1789477413.546213:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783710208 00010000:00010000:3.0:1789477413.546269:0:5830:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d41646a00/0xafddb3c8f9281e92 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2c2c expref: 23 pid: 6999 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789477413.546322:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 60 00000100:00100000:3.0:1789477413.546335:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d50a80450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9bc33f26-0aab-4a14-832f-c58d566de1b0+23:2354:x1876402783710208:12345-192.168.201.23@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789477413.546354:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789477413.546362:0:5830:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d41646a00/0xafddb3c8f9281e92 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2c2c expref: 23 pid: 6999 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477413.546378:0:5830:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d41646a00/0xafddb3c8f9281e92 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2c2c expref: 23 pid: 6999 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477413.546405:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d41646a00/0xafddb3c8f9281e92 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2c2c expref: 23 pid: 6999 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477413.546427:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9d0d5b9f4e00) 00010000:00010000:3.0:1789477413.546433:0:5830:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f519000/0xafddb3c8f9281f87 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477413.546457:0:5830:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f519000/0xafddb3c8f9281f87 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477413.546466:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f519000/0xafddb3c8f9281f87 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477413.546501:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789477413.546643:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d50a80450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9bc33f26-0aab-4a14-832f-c58d566de1b0+22:2354:x1876402783710208:12345-192.168.201.23@tcp:103:ldlm_bl.0 Request processed in 309us (628us total) trans 0 rc 0/0 00000100:00100000:3.0:1789477413.546669:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 60 00010000:00010000:1.0:1789477413.548494:0:6999:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f519000/0xafddb3c8f9281f87 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477413.548518:0:6999:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f519000/0xafddb3c8f9281f87 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789477413.548887:0:6999:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:1.0:1789477413.548894:0:6999:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1789477413.548928:0:6999:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f519000/0xafddb3c8f9281f87 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477413.548949:0:6999:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f519000/0xafddb3c8f9281f87 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477413.548987:0:6999:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f518a00/0xafddb3c8f9281f79 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477413.548995:0:6999:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f518a00/0xafddb3c8f9281f79 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477413.549005:0:6999:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f518a00/0xafddb3c8f9281f79 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477413.549012:0:6999:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d0d7f518a00 already unused, calling callback (ffffffffc1fd54f0) 00010000:00010000:1.0:1789477413.549018:0:6999:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f518a00/0xafddb3c8f9281f79 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477413.549026:0:6999:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f518a00/0xafddb3c8f9281f79 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477413.549046:0:6999:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9d0d5b9f4000) 00010000:00010000:1.0:1789477413.549049:0:6999:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789477413.549055:0:6999:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f518a00/0xafddb3c8f9281f79 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477413.549062:0:6999:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f518a00/0xafddb3c8f9281f79 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477413.549079:0:6999:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f518800/0xafddb3c8f9281f80 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477413.549086:0:6999:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f518800/0xafddb3c8f9281f80 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477413.549093:0:6999:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f518800/0xafddb3c8f9281f80 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477413.549104:0:6999:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d0d7f518800 already unused, calling callback (ffffffffc1fd54f0) 00010000:00010000:1.0:1789477413.549107:0:6999:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f518800/0xafddb3c8f9281f80 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477413.549114:0:6999:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f518800/0xafddb3c8f9281f80 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477413.549135:0:6999:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9d0d5b9f4900) 00010000:00010000:1.0:1789477413.549138:0:6999:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789477413.549141:0:6999:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f518800/0xafddb3c8f9281f80 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477413.549148:0:6999:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f518800/0xafddb3c8f9281f80 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477413.549200:0:6999:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f518600/0xafddb3c8f9281f72 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2c6b expref: 22 pid: 6999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477413.549217:0:6999:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f519000/0xafddb3c8f9281f87 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2c6b expref: 21 pid: 6999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477413.549225:0:6999:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9d0d5b9f4e00) 00010000:00010000:1.0:1789477413.549228:0:6999:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789477413.549231:0:6999:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d0d7f519000, rc 0) 00000100:00100000:1.0:1789477413.549340:0:6999:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d6d48ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9bc33f26-0aab-4a14-832f-c58d566de1b0+21:10549:x1876402783709824:12345-192.168.201.23@tcp:101:lfs.0 Request processed in 16864us (17137us total) trans 0 rc 0/0 00000100:00100000:1.0:1789477413.549352:0:6999:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 129 00010000:00010000:3.0:1789477413.552076:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789477413.857960:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:3.0:1789477413.858020:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:1.0:1789477413.858126:0:8241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783710464 00000100:00100000:1.0:1789477413.858161:0:8241:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783710464 00000100:00100000:1.0:1789477413.858251:0:8241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 65 00000100:00100000:1.0:1789477413.858267:0:8241:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d6d489880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9bc33f26-0aab-4a14-832f-c58d566de1b0+5:2354:x1876402783710464:12345-192.168.201.23@tcp:400:kworker.0 00000100:00100000:1.0:1789477413.858369:0:8241:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d6d489880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9bc33f26-0aab-4a14-832f-c58d566de1b0+5:2354:x1876402783710464:12345-192.168.201.23@tcp:400:kworker.0 Request processed in 104us (425us total) trans 0 rc 0/0 00000100:00100000:1.0:1789477413.858378:0:8241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 65 00000100:00080000:2.0:1789477413.861254:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789477413.867999:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:2.0:1789477413.868167:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783710592 00000100:00100000:2.0:1789477413.868181:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783710592 00000100:00100000:2.0:1789477413.868270:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 138 00000100:00100000:2.0:1789477413.868284:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d6d488380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cf70c55a-e056-446b-8936-49e7cd31fc79+5:2354:x1876402783710592:12345-192.168.201.23@tcp:400:kworker.0 00000100:00100000:2.0:1789477413.868395:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d6d488380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cf70c55a-e056-446b-8936-49e7cd31fc79+5:2354:x1876402783710592:12345-192.168.201.23@tcp:400:kworker.0 Request processed in 114us (411us total) trans 0 rc 0/0 00000100:00100000:2.0:1789477413.868403:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 138 00000100:00080000:3.0:1789477413.869899:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789477413.874330:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783710336 00000100:00100000:1.0:1789477413.874355:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783710336 00000100:00100000:1.0:1789477413.874510:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 289 00000100:00100000:1.0:1789477413.874525:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d44521850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5c82dded-6a10-4ce8-abd1-52bd956b9523+13:2354:x1876402783710336:12345-192.168.201.23@tcp:400:kworker.0 00000100:00100000:1.0:1789477413.874883:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d44521850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5c82dded-6a10-4ce8-abd1-52bd956b9523+13:2354:x1876402783710336:12345-192.168.201.23@tcp:400:kworker.0 Request processed in 178us (16678us total) trans 0 rc 0/0 00000100:00100000:1.0:1789477413.874895:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 289 00000040:00080000:0.0:1789477414.511955:0:11717:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1789477414.511969:0:11717:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1789477414.512038:0:11717:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:0.0:1789477414.512045:0:11717:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1789477414.512229:0:11717:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d6d464e00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11717:1876402802594048:192.168.201.23@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1789477414.512353:0:11717:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d0d75453b40 going to sleep for 11 seconds 00000100:00100000:1.0:1789477414.516086:0:11717:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d6d464e00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11717:1876402802594048:192.168.201.23@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1789477414.517358:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:3.0:1789477414.518314:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783710720 00000100:00100000:3.0:1789477414.518330:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783710720 00000100:00100000:3.0:1789477414.520650:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 130 00000100:00100000:3.0:1789477414.520675:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d7f73a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9bc33f26-0aab-4a14-832f-c58d566de1b0+21:10560:x1876402783710720:12345-192.168.201.23@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1789477414.520771:0:5844:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1789477414.520941:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d7f73a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9bc33f26-0aab-4a14-832f-c58d566de1b0+21:10560:x1876402783710720:12345-192.168.201.23@tcp:53:lhsmtool_posix.0 Request processed in 274us (3590us total) trans 0 rc 0/0 00000100:00100000:3.0:1789477414.520950:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 130 00000100:00080000:0.0:1789477414.521287:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789477414.527902:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:3.0:1789477414.528002:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783710976 00000100:00100000:3.0:1789477414.528015:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783710976 00000100:00100000:3.0:1789477414.528096:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 131 00000100:00100000:3.0:1789477414.528119:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d6d467480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9bc33f26-0aab-4a14-832f-c58d566de1b0+21:10560:x1876402783710976:12345-192.168.201.23@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789477414.528148:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789477414.528181:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d59d6be00/0xafddb3c8f9281f8e lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa90d500d7b8f2c72 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477414.528318:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d59d6b400/0xafddb3c8f9281f95 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477414.528337:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d59d6b400/0xafddb3c8f9281f95 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477414.528387:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d59d6b400/0xafddb3c8f9281f95 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789477414.528403:0:5846:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:3.0:1789477414.528604:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d59d6be00/0xafddb3c8f9281f8e lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2c72 expref: 24 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477414.528637:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d59d6b400/0xafddb3c8f9281f95 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2c72 expref: 23 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477414.528648:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9d0d5b9f4e00) 00010000:00010000:3.0:1789477414.528651:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789477414.528656:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d0d59d6b400, rc 0) 00000100:00100000:3.0:1789477414.528742:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d6d467480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9bc33f26-0aab-4a14-832f-c58d566de1b0+23:10560:x1876402783710976:12345-192.168.201.23@tcp:101:lhsmtool_posix.0 Request processed in 635us (855us total) trans 4294967411 rc 0/0 00000100:00100000:3.0:1789477414.528752:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 131 00000100:00100000:3.0:1789477414.535417:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:0.0:1789477414.536965:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:1.0:1789477414.537069:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783711360 00000100:00100000:1.0:1789477414.537083:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783711360 00000100:00100000:1.0:1789477414.537189:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 9 00000100:00100000:1.0:1789477414.537202:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d6d464e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9bc33f26-0aab-4a14-832f-c58d566de1b0+23:2354:x1876402783711360:12345-192.168.201.23@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789477414.537221:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789477414.537254:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d59d6b400/0xafddb3c8f9281f95 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2c72 expref: 23 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477414.537284:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9d0d5b9f4e00) 00010000:00010000:1.0:1789477414.537301:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789477414.537388:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d6d464e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9bc33f26-0aab-4a14-832f-c58d566de1b0+22:2354:x1876402783711360:12345-192.168.201.23@tcp:103:ldlm_bl.0 Request processed in 188us (433us total) trans 0 rc 0/0 00000100:00100000:1.0:1789477414.537396:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 9 00000100:00100000:2.0:1789477414.537956:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783711232 00000100:00100000:2.0:1789477414.537965:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783711232 00000100:00100000:2.0:1789477414.538009:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 132 00000100:00100000:2.0:1789477414.538017:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d6d488000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9bc33f26-0aab-4a14-832f-c58d566de1b0+22:10560:x1876402783711232:12345-192.168.201.23@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1789477414.538127:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d41647800/0xafddb3c8f9281fa3 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477414.538145:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d41647800/0xafddb3c8f9281fa3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477414.538177:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d41647800/0xafddb3c8f9281fa3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477414.538462:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d41647800/0xafddb3c8f9281fa3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477414.538472:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d41647800/0xafddb3c8f9281fa3 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477414.538479:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d41647800/0xafddb3c8f9281fa3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477414.538485:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d0d41647800 already unused, calling callback (ffffffffc1fd54f0) 00010000:00010000:2.0:1789477414.538491:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d41647800/0xafddb3c8f9281fa3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477414.538499:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d41647800/0xafddb3c8f9281fa3 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477414.538512:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9d0d5b9f4e00) 00010000:00010000:2.0:1789477414.538516:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1789477414.538520:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d41647800/0xafddb3c8f9281fa3 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477414.538526:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d41647800/0xafddb3c8f9281fa3 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789477414.539072:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d6d488000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9bc33f26-0aab-4a14-832f-c58d566de1b0+23:10560:x1876402783711232:12345-192.168.201.23@tcp:57:lhsmtool_posix.0 Request processed in 1052us (3664us total) trans 4294967412 rc 0/0 00000100:00100000:2.0:1789477414.539083:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 132 00000040:00080000:2.0:1789477414.539270:0:11717:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1789477414.539277:0:11717:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1789477414.540351:0:11717:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:2.0:1789477414.540534:0:11717:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1789477414.543865:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:0.0:1789477414.543953:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783711616 00000100:00100000:0.0:1789477414.543968:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783711616 00000100:00100000:0.0:1789477414.544046:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 34 00000100:00100000:0.0:1789477414.544089:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d6d489500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9bc33f26-0aab-4a14-832f-c58d566de1b0+23:10560:x1876402783711616:12345-192.168.201.23@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1789477414.544468:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d6d489500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9bc33f26-0aab-4a14-832f-c58d566de1b0+24:10560:x1876402783711616:12345-192.168.201.23@tcp:35:lhsmtool_posix.0 Request processed in 382us (775us total) trans 4294967413 rc 0/0 00000100:00100000:0.0:1789477414.544477:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 34 00010000:00010000:2.0:1789477414.578433:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1789477414.794147:0:12087:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1789477414.794161:0:12087:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1789477414.794212:0:12087:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:2.0:1789477414.794217:0:12087:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1789477414.831786:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789477414.831825:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d6d482a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1876402802594176:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789477414.831925:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789477414.834541:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802594176 00000100:00100000:3.0:1789477414.834564:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802594176 00000100:00100000:3.0:1789477414.834797:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1789477414.834810:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d6d480380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3313:x1876402802594176:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789477414.834848:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3856662528 00000100:00100000:3.0:1789477414.834982:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d6d480380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3313:x1876402802594176:12345-0@lo:13:osp-pre-1-0.0 Request processed in 174us (3056us total) trans 0 rc 0/0 00000100:00100000:3.0:1789477414.834992:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1789477414.835118:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d6d482a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1876402802594176:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789477414.836899:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d7c64f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3312:1876402802594688:0@lo:400:kworker.0 00000100:00100000:3.0:1789477414.836985:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789477414.837044:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1789477414.837051:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d6d489f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:07d5e05c-913f-419f-adbc-d3cf15e9cd51:3312:1876402802594304:0@lo:400:kworker.0 00000100:00100000:3.0:1789477414.837084:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789477414.837120:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d7c64fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3312:1876402802594816:0@lo:400:kworker.0 00000100:00100000:3.0:1789477414.837147:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789477414.837184:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d6d488a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3310:1876402802594432:0@lo:400:kworker.0 00000100:00100000:3.0:1789477414.837210:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789477414.837233:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789477414.837239:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d58072680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1876402802594560:0@lo:400:kworker.0 00000100:00100000:3.0:1789477414.837269:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789477414.837305:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802594688 00000100:00100000:3.0:1789477414.837314:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802594688 00000100:00100000:3.0:1789477414.837376:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802594816 00000100:00100000:3.0:1789477414.837379:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802594816 00000100:00100000:3.0:1789477414.837392:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802594432 00000100:00100000:3.0:1789477414.837394:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802594432 00000100:00100000:3.0:1789477414.837409:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:0.0:1789477414.837557:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:0.0:1789477414.837569:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d74aaa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1876402802594816:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789477414.838869:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d7f545c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1876402802594688:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789477414.839109:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802594560 00000100:00100000:1.0:1789477414.839122:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802594560 00000100:00100000:1.0:1789477414.839210:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1789477414.839222:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d74aaad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3310:x1876402802594560:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789477414.839814:0:5844:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 4 min 3 max 116 00000100:00100000:2.0:1789477414.839830:0:5844:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_004' 00000100:00100000:2.0:1789477414.839853:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802594304 00000100:00100000:2.0:1789477414.839859:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802594304 00000100:00100000:2.0:1789477414.839910:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 290 00000100:00100000:2.0:1789477414.839919:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d44521050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:07d5e05c-913f-419f-adbc-d3cf15e9cd51+19:3312:x1876402802594304:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789477414.844233:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d74aaad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3310:x1876402802594560:12345-0@lo:400:kworker.0 Request processed in 2189us (4138us total) trans 0 rc 0/0 00000100:00100000:1.0:1789477414.844264:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1789477414.851890:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d58072680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1876402802594560:0@lo:400:kworker.0 00000100:00100000:3.0:1789477414.855719:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d7f545c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1876402802594688:12345-0@lo:400:kworker.0 Request processed in 18175us (18608us total) trans 0 rc 0/0 00000100:00100000:3.0:1789477414.855739:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:3.0:1789477414.855802:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:3.0:1789477414.855818:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d74aa8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1876402802594432:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789477414.855915:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d74aa8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1876402802594432:12345-0@lo:400:kworker.0 Request processed in 105us (18704us total) trans 0 rc 0/0 00000100:00100000:3.0:1789477414.855922:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00080000:3.0:1789477414.856060:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789477414.856068:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789477414.856140:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d7c64f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3312:1876402802594688:0@lo:400:kworker.0 00000100:00100000:3.0:1789477414.856194:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d6d488a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3310:1876402802594432:0@lo:400:kworker.0 00000100:00100000:0.0:1789477414.865771:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d74aaa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1876402802594816:12345-0@lo:400:kworker.0 Request processed in 28188us (28605us total) trans 0 rc 0/0 00000100:00100000:0.0:1789477414.865790:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:0.0:1789477414.865909:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d7c64fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3312:1876402802594816:0@lo:400:kworker.0 00000100:00100000:2.0:1789477414.874735:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d44521050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:07d5e05c-913f-419f-adbc-d3cf15e9cd51+19:3312:x1876402802594304:12345-0@lo:400:kworker.0 Request processed in 34801us (37634us total) trans 0 rc 0/0 00000100:00100000:2.0:1789477414.874755:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 290 00000100:00100000:3.0:1789477414.876830:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d6d489f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:07d5e05c-913f-419f-adbc-d3cf15e9cd51:3312:1876402802594304:0@lo:400:kworker.0 00000100:00100000:1.0:1789477415.067684:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:3.0:1789477415.067793:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783711872 00000100:00100000:3.0:1789477415.067809:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783711872 00000100:00100000:3.0:1789477415.067889:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 133 00000100:00100000:3.0:1789477415.067902:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d58072680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9bc33f26-0aab-4a14-832f-c58d566de1b0+24:10573:x1876402783711872:12345-192.168.201.23@tcp:101:lfs.0 00010000:00010000:3.0:1789477415.067940:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789477415.067971:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d59d6be00/0xafddb3c8f9281faa lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa90d500d7b8f2c79 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477415.068122:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d59d6a800/0xafddb3c8f9281fb1 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477415.068141:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d59d6a800/0xafddb3c8f9281fb1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477415.068158:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d59d6a800/0xafddb3c8f9281fb1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789477415.068173:0:5846:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:3.0:1789477415.068341:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d59d6be00/0xafddb3c8f9281faa lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2c79 expref: 27 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477415.068372:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d59d6a800/0xafddb3c8f9281fb1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2c79 expref: 26 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477415.068383:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9d0d5b9f4e00) 00010000:00010000:3.0:1789477415.068387:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1789477415.068392:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d0d59d6a800, rc 0) 00000100:00100000:3.0:1789477415.068751:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d58072680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9bc33f26-0aab-4a14-832f-c58d566de1b0+26:10573:x1876402783711872:12345-192.168.201.23@tcp:101:lfs.0 Request processed in 850us (1081us total) trans 4294967414 rc 0/0 00000100:00100000:3.0:1789477415.075326:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 133 00000100:00100000:3.0:1789477415.086793:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:1.0:1789477415.086996:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783712000 00000100:00100000:1.0:1789477415.087011:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783712000 00000100:00100000:1.0:1789477415.087104:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 134 00000100:00100000:1.0:1789477415.087117:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d74aa9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9bc33f26-0aab-4a14-832f-c58d566de1b0+26:10573:x1876402783712000:12345-192.168.201.23@tcp:54:lfs.0 00010000:00010000:1.0:1789477415.087248:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f519e00/0xafddb3c8f9281fbf lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477415.087271:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f519e00/0xafddb3c8f9281fbf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477415.087286:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f519e00/0xafddb3c8f9281fbf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477415.087323:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f519e00/0xafddb3c8f9281fbf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477415.087331:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f519e00/0xafddb3c8f9281fbf lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477415.087557:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f519e00/0xafddb3c8f9281fbf lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477415.087564:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d0d7f519e00 already unused, calling callback (ffffffffc1fd54f0) 00010000:00010000:1.0:1789477415.087569:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f519e00/0xafddb3c8f9281fbf lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477415.087599:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f519e00/0xafddb3c8f9281fbf lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477415.087615:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9d0d5b9f4e00) 00010000:00010000:1.0:1789477415.087619:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1789477415.087624:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f519e00/0xafddb3c8f9281fbf lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477415.087632:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f519e00/0xafddb3c8f9281fbf lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789477415.087735:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d74aa9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9bc33f26-0aab-4a14-832f-c58d566de1b0+26:10573:x1876402783712000:12345-192.168.201.23@tcp:54:lfs.0 Request processed in 619us (960us total) trans 0 rc 0/0 00000100:00100000:1.0:1789477415.087744:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 134 00000100:00100000:3.0:1789477415.300029:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:1.0:1789477415.303321:0:8241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783712128 00000100:00100000:1.0:1789477415.303345:0:8241:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783712128 00000100:00100000:1.0:1789477415.303467:0:8241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 47 00000100:00100000:1.0:1789477415.303481:0:8241:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d74aaa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9bc33f26-0aab-4a14-832f-c58d566de1b0+6:2355:x1876402783712128:12345-192.168.201.23@tcp:101:cat.0 00010000:00010000:1.0:1789477415.303519:0:8241:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00080000:2.0:1789477415.303542:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1789477415.303557:0:8241:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000085790ca8/0xafddb3c8f9281fc6 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa90d500d7b8f2c80 expref: -99 pid: 8241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789477415.303656:0:8241:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x4:0x0] initial LVB size: 13, mtime: 0x6aa94223, atime: 0x6aa94223, ctime: 0x6aa94223, blocks: 0xb 00010000:00010000:1.0:1789477415.303683:0:8241:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=360s v=(0 0) 00010000:00010000:1.0:1789477415.303688:0:8241:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789477415.303701:0:8241:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000085790ca8/0xafddb3c8f9281fc6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2c80 expref: 7 pid: 8241 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477415.303727:0:8241:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000085790ca8/0xafddb3c8f9281fc6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2c80 expref: 7 pid: 8241 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477415.303742:0:8241:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d0d7f519e00, rc 0) 00000100:00100000:1.0:1789477415.303839:0:8241:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d74aaa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9bc33f26-0aab-4a14-832f-c58d566de1b0+7:2355:x1876402783712128:12345-192.168.201.23@tcp:101:cat.0 Request processed in 361us (3824us total) trans 0 rc 0/0 00000100:00100000:1.0:1789477415.303846:0:8241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 47 00000100:00100000:1.0:1789477415.315430:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:0.0:1789477415.316060:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783712256 00000100:00100000:0.0:1789477415.316078:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783712256 00002000:00100000:0.0:1789477415.316170:0:6701:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x4:0x0] (0->4095) req@ffff9d0d7c3e6300 x1876402783712256/t0(0) o3->9bc33f26-0aab-4a14-832f-c58d566de1b0@192.168.201.23@tcp:586/0 lens 488/0 e 0 to 0 dl 1789477426 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789477415.316182:0:6701:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9d0d7c3e6300 with x1876402783712256 ext(0->4095) 00002000:00010000:0.0:1789477415.316189:0:6701:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9d0d7c3e6300 00000100:00100000:0.0:1789477415.316222:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 3 00000100:00100000:0.0:1789477415.316234:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d7c3e6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:9bc33f26-0aab-4a14-832f-c58d566de1b0+7:2352:x1876402783712256:12345-192.168.201.23@tcp:3:cat.0 00000100:00100000:0.0:1789477415.319351:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d7c3e6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:9bc33f26-0aab-4a14-832f-c58d566de1b0+7:2352:x1876402783712256:12345-192.168.201.23@tcp:3:cat.0 Request processed in 3102us (3921us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1789477415.319371:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 3 00002000:00100000:0.0:1789477415.319387:0:6701:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x4:0x0] (0->4095) req@ffff9d0d7c3e6300 x1876402783712256/t0(0) o3->9bc33f26-0aab-4a14-832f-c58d566de1b0@192.168.201.23@tcp:586/0 lens 488/4536 e 0 to 0 dl 1789477426 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789477415.319424:0:6701:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9d0d7c3e6300 with x1876402783712256 ext(0->4095) 00002000:00010000:0.0:1789477415.319433:0:6701:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9d0d7c3e6300 00010000:00010000:3.0:1789477415.599995:0:6710:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789477416.627616:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789477417.391967:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789477417.391991:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d74e8b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1876402802594944:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789477417.392071:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789477417.392149:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802594944 00000100:00100000:0.0:1789477417.392157:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802594944 00000100:00100000:0.0:1789477417.392226:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1789477417.392237:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d74e88a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3311:x1876402802594944:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789477417.392280:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789477417.392327:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d74e88a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3311:x1876402802594944:12345-0@lo:13:osp-pre-0-0.0 Request processed in 92us (255us total) trans 0 rc 0/0 00000100:00100000:0.0:1789477417.392334:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1789477417.392395:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d74e8b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1876402802594944:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1789477417.392608:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1789477417.650707:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1789477418.076727:0:6730:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967304 is committed 00000001:00080000:1.0:1789477418.467042:0:5868:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967413 is committed 00000020:00080000:1.0:1789477418.467070:0:5868:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9d0d51503480 refcount 2 committed 0 result 0 batchid 4 00000020:00080000:1.0:1789477418.467075:0:5868:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9d0d58021200 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9d0d51503b40 00000020:00080000:1.0:1789477418.467080:0:5868:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9d0d58021800 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9d0d74aba800 00000020:00080000:1.0:1789477418.468497:0:5868:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 3 batchid updated 00000001:00080000:1.0:1789477418.468521:0:5868:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967414 is committed 00000020:00080000:2.0:1789477418.468652:0:5879:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 4 committed batchid 3 00000020:00080000:2.0:1789477418.468897:0:5879:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 3 00000001:00080000:2.0:1789477418.513455:0:7678:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967311 is committed 00000001:00080000:2.0:1789477418.513472:0:7678:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967312 is committed 00010000:00010000:3.0:1789477418.676832:0:6710:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789477418.974731:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:2.0:1789477418.974773:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:2.0:1789477418.974805:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:2.0:1789477418.974824:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:2.0:1789477418.974842:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:2.0:1789477418.974867:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783712768 00000100:00100000:2.0:1789477418.974875:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783712768 00000100:00100000:2.0:1789477418.974934:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783712640 00000100:00100000:2.0:1789477418.974938:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783712640 00000100:00100000:2.0:1789477418.974962:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 67 00000100:00100000:2.0:1789477418.974970:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d6d480700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9bc33f26-0aab-4a14-832f-c58d566de1b0+6:2352:x1876402783712768:12345-192.168.201.23@tcp:400:kworker.0 00000100:00100000:2.0:1789477418.975065:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d6d480700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9bc33f26-0aab-4a14-832f-c58d566de1b0+6:2352:x1876402783712768:12345-192.168.201.23@tcp:400:kworker.0 Request processed in 94us (289us total) trans 0 rc 0/0 00000100:00100000:2.0:1789477418.975193:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 67 00000100:00100000:1.0:1789477418.975303:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 68 00000100:00100000:1.0:1789477418.975313:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d6d480000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9bc33f26-0aab-4a14-832f-c58d566de1b0+5:2352:x1876402783712640:12345-192.168.201.23@tcp:400:kworker.0 00000100:00100000:3.0:1789477418.975342:0:12091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783712512 00000100:00100000:1.0:1789477418.975343:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d6d480000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9bc33f26-0aab-4a14-832f-c58d566de1b0+5:2352:x1876402783712640:12345-192.168.201.23@tcp:400:kworker.0 Request processed in 33us (517us total) trans 0 rc 0/0 00000100:00100000:3.0:1789477418.975355:0:12091:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783712512 00000100:00100000:1.0:1789477418.975356:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 68 00000100:00100000:3.0:1789477418.975383:0:12091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783712896 00000100:00100000:3.0:1789477418.975386:0:12091:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783712896 00000100:00100000:1.0:1789477418.975388:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 142 00000100:00100000:1.0:1789477418.975395:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d6d483480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9bc33f26-0aab-4a14-832f-c58d566de1b0+13:2352:x1876402783712512:12345-192.168.201.23@tcp:400:kworker.0 00000100:00100000:3.0:1789477418.975408:0:12091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 143 00000100:00100000:3.0:1789477418.975414:0:12091:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d6d481880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:cf70c55a-e056-446b-8936-49e7cd31fc79+5:2352:x1876402783712896:12345-192.168.201.23@tcp:400:kworker.0 00000100:00100000:1.0:1789477418.975422:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d6d483480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9bc33f26-0aab-4a14-832f-c58d566de1b0+13:2352:x1876402783712512:12345-192.168.201.23@tcp:400:kworker.0 Request processed in 27us (700us total) trans 0 rc 0/0 00000100:00100000:1.0:1789477418.975428:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 142 00000100:00100000:3.0:1789477418.975435:0:12091:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d6d481880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:cf70c55a-e056-446b-8936-49e7cd31fc79+5:2352:x1876402783712896:12345-192.168.201.23@tcp:400:kworker.0 Request processed in 22us (592us total) trans 0 rc 0/0 00000100:00100000:3.0:1789477418.975440:0:12091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 143 00000100:00080000:2.0:1789477418.975487:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789477418.975491:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789477418.975493:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789477418.975713:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783712384 00000100:00100000:0.0:1789477418.975718:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783712384 00000100:00100000:0.0:1789477418.975749:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 291 00000100:00100000:0.0:1789477418.975755:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d595f4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5c82dded-6a10-4ce8-abd1-52bd956b9523+13:2352:x1876402783712384:12345-192.168.201.23@tcp:400:kworker.0 00000100:00100000:0.0:1789477418.975780:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d595f4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5c82dded-6a10-4ce8-abd1-52bd956b9523+13:2352:x1876402783712384:12345-192.168.201.23@tcp:400:kworker.0 Request processed in 25us (973us total) trans 0 rc 0/0 00000100:00100000:0.0:1789477418.975785:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 291 00010000:00010000:1.0:1789477419.699318:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789477419.951791:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d6d489f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1876402802595072:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789477419.951865:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789477419.952086:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802595072 00000100:00100000:3.0:1789477419.952094:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802595072 00000100:00100000:3.0:1789477419.952168:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1789477419.952178:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d6d488a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1876402802595072:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789477419.952227:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789477419.952558:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d6d488a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1876402802595072:12345-0@lo:13:osp-pre-1-0.0 Request processed in 95us (405us total) trans 0 rc 0/0 00000100:00100000:3.0:1789477419.952566:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00080000:3.0:1789477419.952614:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789477419.952629:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d74e8b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:07d5e05c-913f-419f-adbc-d3cf15e9cd51:3312:1876402802595200:0@lo:400:kworker.0 00000100:00100000:3.0:1789477419.952666:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789477419.952689:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d50411180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3312:1876402802595712:0@lo:400:kworker.0 00000100:00100000:3.0:1789477419.952714:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789477419.952739:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789477419.952745:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d7f700380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3312:1876402802595328:0@lo:400:kworker.0 00000100:00100000:3.0:1789477419.952767:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789477419.952792:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802595712 00000100:00100000:3.0:1789477419.952796:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802595712 00000100:00100000:3.0:1789477419.952829:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802595328 00000100:00100000:3.0:1789477419.952832:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802595328 00000100:00100000:3.0:1789477419.952851:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:3.0:1789477419.952858:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d7c64fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1876402802595712:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789477419.952895:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d7c64fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1876402802595712:12345-0@lo:400:kworker.0 Request processed in 38us (179us total) trans 0 rc 0/0 00000100:00100000:3.0:1789477419.952901:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:3.0:1789477419.952914:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:3.0:1789477419.952920:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d7c64f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1876402802595328:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789477419.952954:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d7c64f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1876402802595328:12345-0@lo:400:kworker.0 Request processed in 34us (186us total) trans 0 rc 0/0 00000100:00100000:3.0:1789477419.952960:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00080000:3.0:1789477419.952974:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789477419.952991:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d7f703100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1876402802595456:0@lo:400:kworker.0 00000100:00100000:3.0:1789477419.953031:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789477419.953053:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789477419.953059:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d7f702a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3310:1876402802595584:0@lo:400:kworker.0 00000100:00100000:3.0:1789477419.953080:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789477419.953119:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802595456 00000100:00100000:3.0:1789477419.953123:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802595456 00000100:00100000:3.0:1789477419.953156:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1789477419.953162:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d623ca680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3310:x1876402802595456:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789477419.953192:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d623ca680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3310:x1876402802595456:12345-0@lo:400:kworker.0 Request processed in 31us (161us total) trans 0 rc 0/0 00000100:00100000:3.0:1789477419.953198:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1789477419.953212:0:6999:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802595584 00000100:00100000:3.0:1789477419.953215:0:6999:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802595584 00000100:00100000:3.0:1789477419.953234:0:6999:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:3.0:1789477419.953240:0:6999:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d623cb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1876402802595584:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789477419.953264:0:6999:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d623cb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1876402802595584:12345-0@lo:400:kworker.0 Request processed in 25us (184us total) trans 0 rc 0/0 00000100:00100000:3.0:1789477419.954045:0:6999:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00080000:3.0:1789477419.954170:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789477419.954174:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789477419.954224:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d7f700380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3312:1876402802595328:0@lo:400:kworker.0 00000100:00100000:3.0:1789477419.954249:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d50411180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3312:1876402802595712:0@lo:400:kworker.0 00000100:00100000:3.0:1789477419.954563:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d7f702a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3310:1876402802595584:0@lo:400:kworker.0 00000100:00100000:3.0:1789477419.954574:0:3310:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967304 gen 2 00000004:00080000:3.0:1789477419.954644:0:3310:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9d0d7c64d500, transno 4294967304 00000100:00100000:3.0:1789477419.954699:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d7f703100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1876402802595456:0@lo:400:kworker.0 00000100:00100000:3.0:1789477419.954731:0:3311:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967312 gen 2 00000004:00080000:3.0:1789477419.954735:0:3311:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9d0d6d48aa00, transno 4294967310 00000100:00100000:0.0:1789477419.954735:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802595200 00000100:00100000:0.0:1789477419.954741:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802595200 00000004:00080000:3.0:1789477419.954746:0:3311:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967312 committed transno 4294967312 00000100:00100000:3.0:1789477419.954768:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d6d489f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1876402802595072:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789477419.954773:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 292 00000100:00100000:0.0:1789477419.954787:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d44520850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:07d5e05c-913f-419f-adbc-d3cf15e9cd51+19:3312:x1876402802595200:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789477419.954858:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d44520850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:07d5e05c-913f-419f-adbc-d3cf15e9cd51+19:3312:x1876402802595200:12345-0@lo:400:kworker.0 Request processed in 73us (2191us total) trans 0 rc 0/0 00000100:00100000:0.0:1789477419.954865:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 292 00000100:00100000:3.0:1789477419.956315:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d74e8b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:07d5e05c-913f-419f-adbc-d3cf15e9cd51:3312:1876402802595200:0@lo:400:kworker.0 00010000:00010000:2.0:1789477420.719778:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1789477420.720981:0:11717:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1789477420.720989:0:11717:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789477420.721058:0:11717:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:1.0:1789477420.721065:0:11717:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:3.0:1789477421.744069:0:6710:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789477422.244114:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:3.0:1789477422.244221:0:12091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783713024 00000100:00100000:3.0:1789477422.244235:0:12091:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783713024 00000100:00080000:0.0:1789477422.244382:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789477422.244772:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 135 00000100:00100000:0.0:1789477422.244803:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d6d483800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9bc33f26-0aab-4a14-832f-c58d566de1b0+13:10234:x1876402783713024:12345-192.168.201.23@tcp:60:lhsmtool_posix.0 00000100:00100000:0.0:1789477422.244937:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d6d483800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9bc33f26-0aab-4a14-832f-c58d566de1b0+13:10234:x1876402783713024:12345-192.168.201.23@tcp:60:lhsmtool_posix.0 Request processed in 150us (840us total) trans 0 rc 0/0 00000100:00100000:0.0:1789477422.244945:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 135 00000100:00100000:3.0:1789477422.252305:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:1.0:1789477422.252632:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783713280 00000100:00100000:1.0:1789477422.252642:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783713280 00000100:00100000:1.0:1789477422.252707:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 35 00000100:00100000:1.0:1789477422.252719:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d623c9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9bc33f26-0aab-4a14-832f-c58d566de1b0+13:10234:x1876402783713280:12345-192.168.201.23@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1789477422.253745:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d623c9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9bc33f26-0aab-4a14-832f-c58d566de1b0+14:10234:x1876402783713280:12345-192.168.201.23@tcp:35:lhsmtool_posix.0 Request processed in 1025us (1447us total) trans 4294967415 rc 0/0 00000100:00100000:1.0:1789477422.253755:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 35 00000100:00100000:3.0:1789477422.475396:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:2.0:1789477422.476372:0:6999:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783713408 00000100:00100000:2.0:1789477422.476385:0:6999:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783713408 00000100:00100000:2.0:1789477422.476477:0:6999:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 136 00000100:00100000:2.0:1789477422.476489:0:6999:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d623ca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cf70c55a-e056-446b-8936-49e7cd31fc79+5:11025:x1876402783713408:12345-192.168.201.23@tcp:101:lsof.0 00010000:00010000:2.0:1789477422.476512:0:6999:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789477422.476535:0:6999:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d41647800/0xafddb3c8f9281fcd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa90d500d7b8f2c87 expref: -99 pid: 6999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477422.476628:0:6999:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d41647a00/0xafddb3c8f9281fd4 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477422.476661:0:6999:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d41647a00/0xafddb3c8f9281fd4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477422.476675:0:6999:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d41647a00/0xafddb3c8f9281fd4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789477422.476869:0:6999:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:2.0:1789477422.476874:0:6999:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:2.0:1789477422.476997:0:6999:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d41647a00/0xafddb3c8f9281fd4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477422.477024:0:6999:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d41647800/0xafddb3c8f9281fcd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2c87 expref: 7 pid: 6999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477422.477042:0:6999:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d41647a00/0xafddb3c8f9281fd4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2c87 expref: 6 pid: 6999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477422.477051:0:6999:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9d0d596ae000) 00010000:00010000:2.0:1789477422.477064:0:6999:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789477422.477068:0:6999:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d0d41647a00, rc 0) 00000100:00080000:0.0:1789477422.477229:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789477422.477324:0:6999:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d623ca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cf70c55a-e056-446b-8936-49e7cd31fc79+6:11025:x1876402783713408:12345-192.168.201.23@tcp:101:lsof.0 Request processed in 835us (1937us total) trans 0 rc 0/0 00000100:00100000:2.0:1789477422.477331:0:6999:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 136 00000100:00100000:1.0:1789477422.511818:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d50413480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1876402802595840:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789477422.511896:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789477422.513521:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802595840 00000100:00100000:3.0:1789477422.513532:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802595840 00000100:00100000:3.0:1789477422.513663:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1789477422.513675:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d7c3e6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1876402802595840:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789477422.513712:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789477422.513785:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d7c3e6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1876402802595840:12345-0@lo:13:osp-pre-0-0.0 Request processed in 111us (1888us total) trans 0 rc 0/0 00000100:00100000:3.0:1789477422.513793:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1789477422.513887:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d50413480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1876402802595840:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1789477422.514709:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1789477422.770176:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1789477423.603930:0:5868:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967415 is committed 00000020:00080000:1.0:1789477423.603959:0:5868:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 4 batchid updated 00000020:00080000:2.0:1789477423.604018:0:5879:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000020:00080000:2.0:1789477423.604030:0:5879:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00010000:00010000:2.0:1789477423.791751:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789477424.100826:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:2.0:1789477424.100900:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:2.0:1789477424.100958:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:2.0:1789477424.101000:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:2.0:1789477424.101037:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:2.0:1789477424.101074:0:12091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783714048 00000100:00100000:2.0:1789477424.101088:0:12091:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783714048 00000100:00100000:2.0:1789477424.101161:0:12091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783713664 00000100:00100000:2.0:1789477424.101165:0:12091:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783713664 00000100:00100000:2.0:1789477424.101196:0:12091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 147 00000100:00100000:2.0:1789477424.101208:0:12091:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d6d481f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:cf70c55a-e056-446b-8936-49e7cd31fc79+6:2352:x1876402783714048:12345-192.168.201.23@tcp:400:kworker.0 00000100:00100000:2.0:1789477424.101321:0:12091:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d6d481f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:cf70c55a-e056-446b-8936-49e7cd31fc79+6:2352:x1876402783714048:12345-192.168.201.23@tcp:400:kworker.0 Request processed in 114us (361us total) trans 0 rc 0/0 00000100:00100000:2.0:1789477424.101330:0:12091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 147 00000100:00100000:2.0:1789477424.101350:0:12091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 148 00000100:00100000:2.0:1789477424.101357:0:12091:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d6d483b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9bc33f26-0aab-4a14-832f-c58d566de1b0+13:2352:x1876402783713664:12345-192.168.201.23@tcp:400:kworker.0 00000100:00100000:2.0:1789477424.101390:0:12091:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d6d483b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9bc33f26-0aab-4a14-832f-c58d566de1b0+13:2352:x1876402783713664:12345-192.168.201.23@tcp:400:kworker.0 Request processed in 33us (389us total) trans 0 rc 0/0 00000100:00100000:2.0:1789477424.101396:0:12091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 148 00000100:00100000:2.0:1789477424.101419:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783713792 00000100:00100000:2.0:1789477424.101423:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783713792 00000100:00100000:2.0:1789477424.101452:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783713920 00000100:00100000:2.0:1789477424.101455:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783713920 00000100:00100000:2.0:1789477424.101478:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 70 00000100:00100000:2.0:1789477424.101485:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d6d480a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9bc33f26-0aab-4a14-832f-c58d566de1b0+5:2352:x1876402783713792:12345-192.168.201.23@tcp:400:kworker.0 00000100:00100000:2.0:1789477424.101513:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d6d480a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9bc33f26-0aab-4a14-832f-c58d566de1b0+5:2352:x1876402783713792:12345-192.168.201.23@tcp:400:kworker.0 Request processed in 28us (613us total) trans 0 rc 0/0 00000100:00100000:2.0:1789477424.101533:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 70 00000100:00100000:2.0:1789477424.101546:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 71 00000100:00100000:2.0:1789477424.101552:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d6d482300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9bc33f26-0aab-4a14-832f-c58d566de1b0+6:2352:x1876402783713920:12345-192.168.201.23@tcp:400:kworker.0 00000100:00100000:2.0:1789477424.101639:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d6d482300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9bc33f26-0aab-4a14-832f-c58d566de1b0+6:2352:x1876402783713920:12345-192.168.201.23@tcp:400:kworker.0 Request processed in 86us (599us total) trans 0 rc 0/0 00000100:00100000:2.0:1789477424.101646:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 71 00000100:00080000:0.0:1789477424.101924:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789477424.101930:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789477424.101944:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789477424.102017:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783713536 00000100:00100000:3.0:1789477424.102023:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783713536 00000100:00100000:3.0:1789477424.102073:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 293 00000100:00100000:3.0:1789477424.102081:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d44522850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5c82dded-6a10-4ce8-abd1-52bd956b9523+13:2352:x1876402783713536:12345-192.168.201.23@tcp:400:kworker.0 00000100:00100000:3.0:1789477424.102125:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d44522850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5c82dded-6a10-4ce8-abd1-52bd956b9523+13:2352:x1876402783713536:12345-192.168.201.23@tcp:400:kworker.0 Request processed in 45us (1316us total) trans 0 rc 0/0 00000100:00100000:3.0:1789477424.102131:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 293 00010000:00010000:3.0:1789477424.815907:0:6710:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789477425.072054:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d50413480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3311:1876402802596096:0@lo:400:kworker.0 00000100:00100000:2.0:1789477425.072172:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789477425.072244:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d47668a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1876402802596608:0@lo:400:kworker.0 00000100:00100000:2.0:1789477425.072274:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789477425.072313:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1789477425.072333:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d50410700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:07d5e05c-913f-419f-adbc-d3cf15e9cd51:3311:1876402802595968:0@lo:400:kworker.0 00000100:00100000:2.0:1789477425.072366:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789477425.072390:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d4766b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3311:1876402802596480:0@lo:400:kworker.0 00000100:00100000:2.0:1789477425.072414:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789477425.072453:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802596608 00000100:00100000:2.0:1789477425.072463:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802596608 00000100:00100000:2.0:1789477425.072537:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1789477425.072548:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d6d482d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3311:x1876402802596608:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789477425.072646:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d6d482d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3311:x1876402802596608:12345-0@lo:400:kworker.0 Request processed in 99us (369us total) trans 0 rc 0/0 00000100:00100000:2.0:1789477425.072654:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00080000:2.0:1789477425.072685:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789477425.072700:0:12091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802596096 00000100:00100000:2.0:1789477425.072722:0:12091:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802596096 00000100:00100000:2.0:1789477425.072751:0:12091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802596480 00000100:00100000:2.0:1789477425.072753:0:12091:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802596480 00000100:00100000:2.0:1789477425.072779:0:12091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:2.0:1789477425.072786:0:12091:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d6d482a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1876402802596096:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789477425.072820:0:12091:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d6d482a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1876402802596096:12345-0@lo:400:kworker.0 Request processed in 35us (657us total) trans 0 rc 0/0 00000100:00100000:2.0:1789477425.072827:0:12091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:2.0:1789477425.072839:0:12091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:2.0:1789477425.072844:0:12091:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d6d481500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1876402802596480:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789477425.072870:0:12091:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d6d481500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1876402802596480:12345-0@lo:400:kworker.0 Request processed in 26us (455us total) trans 0 rc 0/0 00000100:00100000:2.0:1789477425.072876:0:12091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00080000:2.0:1789477425.072894:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789477425.072959:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d4766b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3311:1876402802596480:0@lo:400:kworker.0 00000100:00100000:2.0:1789477425.072973:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d50413480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3311:1876402802596096:0@lo:400:kworker.0 00000100:00100000:2.0:1789477425.072982:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d47668a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1876402802596608:0@lo:400:kworker.0 00000100:00100000:2.0:1789477425.073033:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d58244e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3313:1876402802596352:0@lo:400:kworker.0 00000100:00100000:2.0:1789477425.073064:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789477425.073088:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789477425.073094:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d50411180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1876402802596224:0@lo:400:kworker.0 00000100:00100000:2.0:1789477425.073117:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789477425.073148:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802596224 00000100:00100000:2.0:1789477425.073152:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802596224 00000100:00100000:2.0:1789477425.073184:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1789477425.073191:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d7536aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3313:x1876402802596224:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789477425.073233:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d7536aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3313:x1876402802596224:12345-0@lo:400:kworker.0 Request processed in 43us (115us total) trans 0 rc 0/0 00000100:00100000:2.0:1789477425.073239:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1789477425.073265:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d50411180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1876402802596224:0@lo:400:kworker.0 00000100:00080000:2.0:1789477425.073278:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789477425.073296:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802595968 00000100:00100000:2.0:1789477425.073300:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802595968 00000100:00100000:2.0:1789477425.073327:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 294 00000100:00100000:2.0:1789477425.073334:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d44520c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07d5e05c-913f-419f-adbc-d3cf15e9cd51+19:3311:x1876402802595968:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789477425.073373:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d44520c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07d5e05c-913f-419f-adbc-d3cf15e9cd51+19:3311:x1876402802595968:12345-0@lo:400:kworker.0 Request processed in 38us (1006us total) trans 0 rc 0/0 00000100:00100000:2.0:1789477425.073379:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 294 00000100:00100000:2.0:1789477425.073409:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d50410700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:07d5e05c-913f-419f-adbc-d3cf15e9cd51:3311:1876402802595968:0@lo:400:kworker.0 00000100:00100000:2.0:1789477425.073434:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802596352 00000100:00100000:2.0:1789477425.073438:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802596352 00000100:00100000:2.0:1789477425.073463:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:2.0:1789477425.073468:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d50413480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1876402802596352:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789477425.073498:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d50413480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1876402802596352:12345-0@lo:400:kworker.0 Request processed in 30us (434us total) trans 0 rc 0/0 00000100:00100000:2.0:1789477425.073504:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:2.0:1789477425.073524:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d58244e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3313:1876402802596352:0@lo:400:kworker.0 00000100:00080000:2.0:1789477425.073535:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789477425.074681:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789477425.083647:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d58244e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1876402802596736:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789477425.083786:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789477425.084067:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802596736 00000100:00100000:0.0:1789477425.084078:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802596736 00000100:00100000:0.0:1789477425.084152:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1789477425.084171:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d623cad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1876402802596736:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789477425.084223:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789477425.084292:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d623cad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1876402802596736:12345-0@lo:13:osp-pre-1-0.0 Request processed in 130us (505us total) trans 0 rc 0/0 00000100:00100000:0.0:1789477425.084300:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1789477425.084462:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d58244e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1876402802596736:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1789477425.840324:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1789477426.597571:0:12291:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1b: Test manual lfs pcc attach with restore on remote access ========================================================== 09:03:44 (1789477424) 00010000:00010000:2.0:1789477426.864919:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789477427.632041:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789477427.632107:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d47668700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1876402802596864:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789477427.632217:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789477427.632367:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802596864 00000100:00100000:0.0:1789477427.632388:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802596864 00000100:00100000:0.0:1789477427.632470:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1789477427.632482:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d6cf0ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1876402802596864:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789477427.632538:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789477427.632644:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d6cf0ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1876402802596864:12345-0@lo:13:osp-pre-0-0.0 Request processed in 163us (425us total) trans 0 rc 0/0 00000100:00100000:0.0:1789477427.632653:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00080000:2.0:1789477427.633323:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789477427.633385:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d47668700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1876402802596864:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789477427.761242:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:0.0:1789477427.761325:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783714304 00000100:00100000:0.0:1789477427.761340:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783714304 00000100:00100000:0.0:1789477427.761444:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 137 00000100:00100000:0.0:1789477427.761459:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d58245f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9bc33f26-0aab-4a14-832f-c58d566de1b0+13:11290:x1876402783714304:12345-192.168.201.23@tcp:101:lhsmtool_posix.0 00000100:00080000:2.0:1789477427.761462:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1789477427.761488:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789477427.761516:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be5800/0xafddb3c8f9281fdb lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa90d500d7b8f2c8e expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477427.761665:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be4a00/0xafddb3c8f9281fe2 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477427.761682:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be4a00/0xafddb3c8f9281fe2 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477427.761698:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be4a00/0xafddb3c8f9281fe2 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477427.761716:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be5200/0xafddb3c8f9281fe9 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477427.761723:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be5200/0xafddb3c8f9281fe9 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477427.761728:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be5200/0xafddb3c8f9281fe9 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477427.762297:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be4c00/0xafddb3c8f9281ff0 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477427.762309:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be4c00/0xafddb3c8f9281ff0 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477427.762316:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be4c00/0xafddb3c8f9281ff0 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789477427.762328:0:5844:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 6656 00010000:00010000:0.0:1789477427.762572:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be4a00/0xafddb3c8f9281fe2 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477427.762625:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be4a00/0xafddb3c8f9281fe2 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477427.762633:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be4a00/0xafddb3c8f9281fe2 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477427.762639:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d0d50be4a00 already unused, calling callback (ffffffffc1fd54f0) 00010000:00010000:0.0:1789477427.762644:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be4a00/0xafddb3c8f9281fe2 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477427.762652:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be4a00/0xafddb3c8f9281fe2 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477427.762668:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9d0d596ae300) 00010000:00010000:0.0:1789477427.762671:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789477427.762678:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be4a00/0xafddb3c8f9281fe2 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477427.762695:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be4a00/0xafddb3c8f9281fe2 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477427.762711:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be5200/0xafddb3c8f9281fe9 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477427.762717:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be5200/0xafddb3c8f9281fe9 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477427.762723:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be5200/0xafddb3c8f9281fe9 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477427.762729:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d0d50be5200 already unused, calling callback (ffffffffc1fd54f0) 00010000:00010000:0.0:1789477427.762732:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be5200/0xafddb3c8f9281fe9 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477427.762738:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be5200/0xafddb3c8f9281fe9 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477427.762747:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff9d0d596aed00) 00010000:00010000:0.0:1789477427.762749:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789477427.762752:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be5200/0xafddb3c8f9281fe9 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477427.762758:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be5200/0xafddb3c8f9281fe9 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477427.763268:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be5800/0xafddb3c8f9281fdb lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2c8e expref: 16 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477427.763285:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be4c00/0xafddb3c8f9281ff0 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2c8e expref: 15 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477427.763299:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9d0d48f9be00) 00010000:00010000:0.0:1789477427.763302:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789477427.763305:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d0d50be4c00, rc 0) 00000100:00100000:0.0:1789477427.763392:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d58245f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9bc33f26-0aab-4a14-832f-c58d566de1b0+15:11290:x1876402783714304:12345-192.168.201.23@tcp:101:lhsmtool_posix.0 Request processed in 1937us (2168us total) trans 4294967416 rc 0/0 00000100:00100000:0.0:1789477427.763400:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 137 00000100:00100000:2.0:1789477427.777100:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:2.0:1789477427.777148:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:0.0:1789477427.777314:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783714432 00000100:00100000:0.0:1789477427.777327:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783714432 00000100:00100000:0.0:1789477427.777404:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 138 00000100:00100000:0.0:1789477427.777417:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d58245180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9bc33f26-0aab-4a14-832f-c58d566de1b0+15:11290:x1876402783714432:12345-192.168.201.23@tcp:59:lhsmtool_posix.0 00000100:00100000:0.0:1789477427.777599:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d58245180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9bc33f26-0aab-4a14-832f-c58d566de1b0+15:11290:x1876402783714432:12345-192.168.201.23@tcp:59:lhsmtool_posix.0 Request processed in 161us (491us total) trans 0 rc 0/0 00000100:00100000:0.0:1789477427.777608:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 138 00000100:00100000:3.0:1789477427.777730:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783714560 00000100:00100000:3.0:1789477427.777735:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783714560 00000100:00100000:3.0:1789477427.777788:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 10 00000100:00100000:3.0:1789477427.777796:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d58245500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9bc33f26-0aab-4a14-832f-c58d566de1b0+15:2353:x1876402783714560:12345-192.168.201.23@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789477427.777809:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789477427.777844:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be4c00/0xafddb3c8f9281ff0 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2c8e expref: 15 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477427.777883:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9d0d48f9be00) 00010000:00010000:3.0:1789477427.777889:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789477427.777914:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d58245500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9bc33f26-0aab-4a14-832f-c58d566de1b0+14:2353:x1876402783714560:12345-192.168.201.23@tcp:103:ldlm_bl.0 Request processed in 119us (765us total) trans 0 rc 0/0 00000100:00100000:3.0:1789477427.777921:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 10 00000040:00080000:3.0:1789477427.888781:0:11717:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1789477427.888795:0:11717:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1789477427.889805:0:11717:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:3.0:1789477427.889843:0:11717:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:3.0:1789477427.893042:0:6710:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1789477428.696646:0:5868:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967416 is committed 00010000:00010000:3.0:1789477428.915187:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789477429.215265:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:2.0:1789477429.215315:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:2.0:1789477429.215363:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:2.0:1789477429.215398:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:2.0:1789477429.215421:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:2.0:1789477429.215460:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783714944 00000100:00100000:2.0:1789477429.215472:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783714944 00000100:00100000:2.0:1789477429.215542:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783715072 00000100:00100000:2.0:1789477429.215545:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783715072 00000100:00100000:2.0:1789477429.215573:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 74 00000100:00100000:2.0:1789477429.215618:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d58247100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9bc33f26-0aab-4a14-832f-c58d566de1b0+5:2354:x1876402783714944:12345-192.168.201.23@tcp:400:kworker.0 00000100:00100000:2.0:1789477429.215715:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d58247100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9bc33f26-0aab-4a14-832f-c58d566de1b0+5:2354:x1876402783714944:12345-192.168.201.23@tcp:400:kworker.0 Request processed in 100us (397us total) trans 0 rc 0/0 00000100:00100000:2.0:1789477429.215737:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 74 00000100:00100000:2.0:1789477429.215764:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 75 00000100:00100000:2.0:1789477429.215772:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d50410700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9bc33f26-0aab-4a14-832f-c58d566de1b0+6:2354:x1876402783715072:12345-192.168.201.23@tcp:400:kworker.0 00000100:00100000:2.0:1789477429.215799:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d50410700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9bc33f26-0aab-4a14-832f-c58d566de1b0+6:2354:x1876402783715072:12345-192.168.201.23@tcp:400:kworker.0 Request processed in 28us (377us total) trans 0 rc 0/0 00000100:00100000:2.0:1789477429.215828:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 75 00000100:00080000:2.0:1789477429.215862:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789477429.215866:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789477429.216188:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783715200 00000100:00100000:1.0:1789477429.216202:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783715200 00000100:00100000:1.0:1789477429.216247:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783714816 00000100:00100000:1.0:1789477429.216250:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783714816 00000100:00100000:1.0:1789477429.216273:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 152 00000100:00100000:1.0:1789477429.216280:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d58244e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cf70c55a-e056-446b-8936-49e7cd31fc79+6:2354:x1876402783715200:12345-192.168.201.23@tcp:400:kworker.0 00000100:00100000:1.0:1789477429.216328:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d58244e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cf70c55a-e056-446b-8936-49e7cd31fc79+6:2354:x1876402783715200:12345-192.168.201.23@tcp:400:kworker.0 Request processed in 48us (974us total) trans 0 rc 0/0 00000100:00100000:1.0:1789477429.216335:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 152 00000100:00100000:1.0:1789477429.216350:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 153 00000100:00100000:1.0:1789477429.216357:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d50411c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9bc33f26-0aab-4a14-832f-c58d566de1b0+13:2354:x1876402783714816:12345-192.168.201.23@tcp:400:kworker.0 00000100:00100000:1.0:1789477429.216383:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d50411c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9bc33f26-0aab-4a14-832f-c58d566de1b0+13:2354:x1876402783714816:12345-192.168.201.23@tcp:400:kworker.0 Request processed in 27us (984us total) trans 0 rc 0/0 00000100:00100000:1.0:1789477429.216390:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 153 00000100:00100000:0.0:1789477429.216510:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783714688 00000100:00100000:0.0:1789477429.216515:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783714688 00000100:00100000:0.0:1789477429.216561:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 295 00000100:00100000:0.0:1789477429.216570:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d44520450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5c82dded-6a10-4ce8-abd1-52bd956b9523+13:2354:x1876402783714688:12345-192.168.201.23@tcp:400:kworker.0 00000100:00100000:0.0:1789477429.216624:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d44520450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5c82dded-6a10-4ce8-abd1-52bd956b9523+13:2354:x1876402783714688:12345-192.168.201.23@tcp:400:kworker.0 Request processed in 56us (1375us total) trans 0 rc 0/0 00000100:00100000:0.0:1789477429.216630:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 295 00000100:00080000:2.0:1789477429.216871:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1789477429.942439:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789477430.005487:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:3.0:1789477430.005697:0:12091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783715328 00000100:00100000:3.0:1789477430.005711:0:12091:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783715328 00000100:00100000:3.0:1789477430.005793:0:12091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 139 00000100:00100000:3.0:1789477430.005806:0:12091:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d50411180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9bc33f26-0aab-4a14-832f-c58d566de1b0+13:11332:x1876402783715328:12345-192.168.201.23@tcp:101:lfs.0 00010000:00010000:3.0:1789477430.005842:0:12091:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789477430.005871:0:12091:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d59d6b400/0xafddb3c8f9281ffe lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa90d500d7b8f2c95 expref: -99 pid: 12091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477430.005960:0:12091:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d59d6be00/0xafddb3c8f9282005 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 12091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477430.005978:0:12091:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d59d6be00/0xafddb3c8f9282005 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477430.005991:0:12091:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d59d6be00/0xafddb3c8f9282005 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477430.006007:0:12091:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d59d6b600/0xafddb3c8f928200c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477430.006014:0:12091:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d59d6b600/0xafddb3c8f928200c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477430.006021:0:12091:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d59d6b600/0xafddb3c8f928200c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477430.006347:0:12091:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d59d6be00/0xafddb3c8f9282005 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477430.006364:0:12091:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d59d6be00/0xafddb3c8f9282005 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 12091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477430.006372:0:12091:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d59d6be00/0xafddb3c8f9282005 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477430.006378:0:12091:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d0d59d6be00 already unused, calling callback (ffffffffc1fd54f0) 00010000:00010000:3.0:1789477430.006383:0:12091:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d59d6be00/0xafddb3c8f9282005 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477430.006391:0:12091:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d59d6be00/0xafddb3c8f9282005 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 12091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477430.006407:0:12091:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9d0d596ae000) 00010000:00010000:3.0:1789477430.006411:0:12091:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789477430.006416:0:12091:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d59d6be00/0xafddb3c8f9282005 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477430.006423:0:12091:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d59d6be00/0xafddb3c8f9282005 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477430.006440:0:12091:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d59d6b600/0xafddb3c8f928200c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477430.006446:0:12091:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d59d6b600/0xafddb3c8f928200c lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477430.006452:0:12091:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d59d6b600/0xafddb3c8f928200c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477430.006458:0:12091:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d0d59d6b600 already unused, calling callback (ffffffffc1fd54f0) 00010000:00010000:3.0:1789477430.006466:0:12091:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d59d6b600/0xafddb3c8f928200c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477430.006473:0:12091:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d59d6b600/0xafddb3c8f928200c lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477430.006481:0:12091:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff9d0d44568400) 00010000:00010000:3.0:1789477430.006483:0:12091:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789477430.006486:0:12091:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d59d6b600/0xafddb3c8f928200c lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477430.006491:0:12091:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d59d6b600/0xafddb3c8f928200c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477430.006531:0:12091:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d59d6b400/0xafddb3c8f9281ffe lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2c95 expref: 14 pid: 12091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477430.006544:0:12091:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9d0d596ae000) 00010000:00010000:3.0:1789477430.006546:0:12091:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789477430.006550:0:12091:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d59d6b400/0xafddb3c8f9281ffe lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2c95 expref: 14 pid: 12091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477430.006559:0:12091:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d0d59d6b400, rc 0) 00000100:00100000:2.0:1789477430.011455:0:12091:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d50411180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9bc33f26-0aab-4a14-832f-c58d566de1b0+13:11332:x1876402783715328:12345-192.168.201.23@tcp:101:lfs.0 Request processed in 5633us (5965us total) trans 0 rc 301/301 00000100:00100000:2.0:1789477430.011475:0:12091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 139 00000100:00100000:0.0:1789477430.015634:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:1.0:1789477430.015793:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783715584 00000100:00100000:1.0:1789477430.015806:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783715584 00000100:00100000:1.0:1789477430.015895:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 140 00000100:00100000:1.0:1789477430.015909:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d47669500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9bc33f26-0aab-4a14-832f-c58d566de1b0+13:11332:x1876402783715584:12345-192.168.201.23@tcp:36:lfs.0 00010000:00010000:1.0:1789477430.015994:0:5844:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789477430.016033:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be5e00/0xafddb3c8f928197c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2ace expref: 13 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477430.016056:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9d0d596ae000) 00010000:00010000:1.0:1789477430.016062:0:5844:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789477430.016421:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f518600/0xafddb3c8f9282013 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477430.016438:0:5844:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d41647a00/0xafddb3c8f9281fd4 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2c87 expref: 5 pid: 6999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477430.016455:0:5844:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f518600/0xafddb3c8f9282013 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477430.016497:0:5844:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d41647a00/0xafddb3c8f9281fd4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2c87 expref: 5 pid: 6999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477430.016792:0:5844:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d41647a00/0xafddb3c8f9281fd4 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2c87 expref: 5 pid: 6999 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789477430.016811:0:5844:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d7c3e5f80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5844:1876402802596992:192.168.201.23@tcp:104: 00000100:00100000:1.0:1789477430.016999:0:5844:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d0d4840c3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789477430.019801:0:5844:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d7c3e5f80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5844:1876402802596992:192.168.201.23@tcp:104: 00010000:00010000:0.0:1789477430.019854:0:5844:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f518600/0xafddb3c8f9282013 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789477430.020262:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:1.0:1789477430.020341:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783715712 00000100:00100000:1.0:1789477430.020350:0:6711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783715712 00010000:00010000:1.0:1789477430.020397:0:6711:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d41647a00/0xafddb3c8f9281fd4 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2c87 expref: 6 pid: 6999 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789477430.020443:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 61 00000100:00100000:1.0:1789477430.020456:0:6711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d4766b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:cf70c55a-e056-446b-8936-49e7cd31fc79+6:2354:x1876402783715712:12345-192.168.201.23@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789477430.020475:0:6711:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789477430.020484:0:6711:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d41647a00/0xafddb3c8f9281fd4 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2c87 expref: 6 pid: 6999 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477430.020498:0:6711:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d41647a00/0xafddb3c8f9281fd4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2c87 expref: 6 pid: 6999 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477430.020536:0:6711:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d41647a00/0xafddb3c8f9281fd4 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2c87 expref: 6 pid: 6999 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477430.020567:0:6711:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9d0d596ae000) 00010000:00010000:1.0:1789477430.020572:0:6711:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f518600/0xafddb3c8f9282013 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477430.020613:0:6711:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f518600/0xafddb3c8f9282013 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477430.020623:0:6711:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f518600/0xafddb3c8f9282013 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477430.020645:0:6711:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789477430.020712:0:6711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d4766b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:cf70c55a-e056-446b-8936-49e7cd31fc79+5:2354:x1876402783715712:12345-192.168.201.23@tcp:103:ldlm_bl.0 Request processed in 259us (453us total) trans 0 rc 0/0 00000100:00100000:1.0:1789477430.020721:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 61 00010000:00010000:0.0:1789477430.020915:0:5844:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f518600/0xafddb3c8f9282013 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477430.020925:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f518600/0xafddb3c8f9282013 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477430.020958:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be5600/0xafddb3c8f928201a lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477430.020969:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be5600/0xafddb3c8f928201a lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477430.020979:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be5600/0xafddb3c8f928201a lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789477430.022385:0:5844:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00010000:00010000:0.0:1789477430.022400:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f518600/0xafddb3c8f9282013 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477430.022410:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f518600/0xafddb3c8f9282013 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477430.022418:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f518600/0xafddb3c8f9282013 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477430.022424:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d0d7f518600 already unused, calling callback (ffffffffc1fd54f0) 00010000:00010000:0.0:1789477430.022430:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f518600/0xafddb3c8f9282013 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477430.022438:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f518600/0xafddb3c8f9282013 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477430.022462:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9d0d596ae000) 00010000:00010000:0.0:1789477430.022465:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789477430.022470:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f518600/0xafddb3c8f9282013 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477430.022476:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f518600/0xafddb3c8f9282013 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789477430.022496:0:5844:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000ee685064 reply state 00000000394a7ef6 transno 4294967417 ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be5600/0xafddb3c8f928201a lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789477430.022507:0:5844:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789477430.022641:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d47669500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9bc33f26-0aab-4a14-832f-c58d566de1b0+14:11332:x1876402783715584:12345-192.168.201.23@tcp:36:lfs.0 Request processed in 6731us (7016us total) trans 4294967417 rc 0/0 00000100:00100000:0.0:1789477430.022651:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 140 00010000:00010000:3.0:1789477430.029099:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be5600/0xafddb3c8f928201a lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477430.029123:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be5600/0xafddb3c8f928201a lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477430.029132:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be5600/0xafddb3c8f928201a lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477430.029154:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d0d50be5600 already unused, calling callback (ffffffffc1fd54f0) 00010000:00010000:3.0:1789477430.029161:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be5600/0xafddb3c8f928201a lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477430.029170:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be5600/0xafddb3c8f928201a lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477430.029193:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff9d0d596ae100) 00010000:00010000:3.0:1789477430.029196:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789477430.029202:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be5600/0xafddb3c8f928201a lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477430.029209:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be5600/0xafddb3c8f928201a lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789477430.094168:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:1.0:1789477430.094353:0:6999:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783715840 00000100:00100000:1.0:1789477430.094367:0:6999:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783715840 00000100:00100000:1.0:1789477430.094445:0:6999:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 141 00000100:00100000:1.0:1789477430.094457:0:6999:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d6d3d5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9bc33f26-0aab-4a14-832f-c58d566de1b0+13:11340:x1876402783715840:12345-192.168.201.23@tcp:101:lctl.0 00010000:00010000:1.0:1789477430.094496:0:6999:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789477430.095019:0:6999:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f518a00/0xafddb3c8f9282021 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa90d500d7b8f2c9c expref: -99 pid: 6999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477430.095111:0:6999:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f518e00/0xafddb3c8f9282028 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477430.095127:0:6999:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f518e00/0xafddb3c8f9282028 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477430.095140:0:6999:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f518e00/0xafddb3c8f9282028 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789477430.095227:0:6999:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:1.0:1789477430.095231:0:6999:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 3 stripe count 1 MDT count 1 00000004:00010000:1.0:1789477430.095839:0:6999:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f518e00/0xafddb3c8f9282028 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477430.095884:0:6999:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f518a00/0xafddb3c8f9282021 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2c9c expref: 15 pid: 6999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477430.095905:0:6999:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f518e00/0xafddb3c8f9282028 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2c9c expref: 14 pid: 6999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477430.095915:0:6999:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9d0d5b9f4700) 00010000:00010000:1.0:1789477430.095918:0:6999:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789477430.095922:0:6999:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d0d7f518e00, rc 0) 00000100:00100000:1.0:1789477430.096055:0:6999:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d6d3d5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9bc33f26-0aab-4a14-832f-c58d566de1b0+14:11340:x1876402783715840:12345-192.168.201.23@tcp:101:lctl.0 Request processed in 1599us (1908us total) trans 0 rc 0/0 00000100:00100000:1.0:1789477430.096065:0:6999:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 141 00000100:00100000:0.0:1789477430.170413:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:2.0:1789477430.171504:0:12091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783715968 00000100:00100000:2.0:1789477430.171525:0:12091:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783715968 00000100:00100000:2.0:1789477430.171649:0:12091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 142 00000100:00100000:2.0:1789477430.171662:0:12091:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d4766ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9bc33f26-0aab-4a14-832f-c58d566de1b0+14:11346:x1876402783715968:12345-192.168.201.23@tcp:101:bash.0 00010000:00010000:2.0:1789477430.171687:0:12091:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789477430.171715:0:12091:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d41647800/0xafddb3c8f928202f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa90d500d7b8f2ca3 expref: -99 pid: 12091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477430.180208:0:12091:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d59d6b400/0xafddb3c8f9282036 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477430.180242:0:12091:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d59d6b400/0xafddb3c8f9282036 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477430.180257:0:12091:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d59d6b400/0xafddb3c8f9282036 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477430.180278:0:12091:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d59d6b600/0xafddb3c8f928203d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477430.180286:0:12091:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d59d6b600/0xafddb3c8f928203d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477430.180291:0:12091:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d59d6b600/0xafddb3c8f928203d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477430.180459:0:12091:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d59d6be00/0xafddb3c8f9282044 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477430.180469:0:12091:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d59d6be00/0xafddb3c8f9282044 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477430.180475:0:12091:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d59d6be00/0xafddb3c8f9282044 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12091 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789477430.180518:0:12091:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00000004:00200000:3.0:1789477430.180522:0:12091:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1789477430.180548:0:12091:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d59d6be00/0xafddb3c8f9282044 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477430.180562:0:12091:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d59d6b400/0xafddb3c8f9282036 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477430.180569:0:12091:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d59d6b400/0xafddb3c8f9282036 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 12091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477430.180595:0:12091:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d59d6b400/0xafddb3c8f9282036 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477430.180602:0:12091:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d0d59d6b400 already unused, calling callback (ffffffffc1fd54f0) 00010000:00010000:3.0:1789477430.180607:0:12091:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d59d6b400/0xafddb3c8f9282036 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477430.180615:0:12091:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d59d6b400/0xafddb3c8f9282036 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 12091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477430.180629:0:12091:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9d0d5b9f4700) 00010000:00010000:3.0:1789477430.180639:0:12091:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789477430.180645:0:12091:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d59d6b400/0xafddb3c8f9282036 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477430.180651:0:12091:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d59d6b400/0xafddb3c8f9282036 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477430.180671:0:12091:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d59d6b600/0xafddb3c8f928203d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477430.180676:0:12091:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d59d6b600/0xafddb3c8f928203d lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477430.180681:0:12091:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d59d6b600/0xafddb3c8f928203d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477430.180687:0:12091:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d0d59d6b600 already unused, calling callback (ffffffffc1fd54f0) 00010000:00010000:3.0:1789477430.180689:0:12091:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d59d6b600/0xafddb3c8f928203d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477430.180696:0:12091:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d59d6b600/0xafddb3c8f928203d lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477430.180703:0:12091:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff9d0d44568400) 00010000:00010000:3.0:1789477430.180706:0:12091:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789477430.180708:0:12091:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d59d6b600/0xafddb3c8f928203d lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477430.180713:0:12091:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d59d6b600/0xafddb3c8f928203d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477430.180771:0:12091:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d41647800/0xafddb3c8f928202f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2ca3 expref: 16 pid: 12091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477430.180802:0:12091:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d59d6be00/0xafddb3c8f9282044 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2ca3 expref: 15 pid: 12091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477430.180811:0:12091:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9d0d44568d00) 00010000:00010000:3.0:1789477430.180814:0:12091:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1789477430.180816:0:12091:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d0d59d6be00, rc 0) 00000100:00100000:3.0:1789477430.181063:0:12091:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d4766ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9bc33f26-0aab-4a14-832f-c58d566de1b0+15:11346:x1876402783715968:12345-192.168.201.23@tcp:101:bash.0 Request processed in 9401us (10664us total) trans 0 rc 0/0 00000100:00100000:3.0:1789477430.181074:0:12091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 142 00000100:00100000:0.0:1789477430.187618:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:1.0:1789477430.187718:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783716224 00000100:00100000:1.0:1789477430.187732:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783716224 00000100:00100000:1.0:1789477430.187909:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 143 00000100:00100000:1.0:1789477430.187920:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d4766a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9bc33f26-0aab-4a14-832f-c58d566de1b0+15:11346:x1876402783716224:12345-192.168.201.23@tcp:101:bash.0 00010000:00010000:1.0:1789477430.187947:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789477430.187975:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f518400/0xafddb3c8f928204b lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa90d500d7b8f2caa expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477430.188147:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f519200/0xafddb3c8f9282052 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477430.188185:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f519200/0xafddb3c8f9282052 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477430.188195:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f519200/0xafddb3c8f9282052 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477430.188402:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f519800/0xafddb3c8f9282059 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477430.188428:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f519800/0xafddb3c8f9282059 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477430.188442:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f519800/0xafddb3c8f9282059 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1789477430.189567:0:5844:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x4:0x0], index 0: 0 00010000:00010000:1.0:1789477430.190070:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f518c00/0xafddb3c8f9282060 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477430.190084:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f518c00/0xafddb3c8f9282060 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477430.190094:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f518c00/0xafddb3c8f9282060 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477430.190130:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f519200/0xafddb3c8f9282052 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477430.190137:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f519200/0xafddb3c8f9282052 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477430.190145:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f519200/0xafddb3c8f9282052 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477430.190159:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d0d7f519200 already unused, calling callback (ffffffffc1fd54f0) 00010000:00010000:1.0:1789477430.190164:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f519200/0xafddb3c8f9282052 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477430.190171:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f519200/0xafddb3c8f9282052 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477430.190185:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9d0d44568d00) 00010000:00010000:1.0:1789477430.190188:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789477430.190193:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f519200/0xafddb3c8f9282052 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477430.190199:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f519200/0xafddb3c8f9282052 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789477430.190214:0:5844:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000cf731a50 reply state 000000007e57e74d transno 4294967418 ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f519800/0xafddb3c8f9282059 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789477430.190224:0:5844:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1789477430.190263:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f518400/0xafddb3c8f928204b lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2caa expref: 18 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477430.190279:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f518c00/0xafddb3c8f9282060 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2caa expref: 17 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477430.190286:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9d0d48f9b900) 00010000:00010000:1.0:1789477430.190289:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789477430.190291:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d0d7f518c00, rc 0) 00000100:00100000:1.0:1789477430.190369:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d4766a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9bc33f26-0aab-4a14-832f-c58d566de1b0+18:11346:x1876402783716224:12345-192.168.201.23@tcp:101:bash.0 Request processed in 2450us (2795us total) trans 4294967418 rc 0/0 00000100:00100000:1.0:1789477430.190384:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 143 00000100:00100000:3.0:1789477430.192166:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d6d3d7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1876402802597120:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789477430.192265:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789477430.197269:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802597120 00000100:00100000:2.0:1789477430.197291:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802597120 00000100:00100000:2.0:1789477430.197389:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1789477430.197402:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d623caa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1876402802597120:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789477430.197455:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789477430.197565:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d623caa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1876402802597120:12345-0@lo:13:osp-pre-1-0.0 Request processed in 165us (5298us total) trans 0 rc 0/0 00000100:00100000:2.0:1789477430.197572:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00080000:2.0:1789477430.198196:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789477430.198333:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d6d3d7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1876402802597120:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789477430.198555:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d623c9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:07d5e05c-913f-419f-adbc-d3cf15e9cd51:3311:1876402802597248:0@lo:400:kworker.0 00000100:00100000:2.0:1789477430.199123:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789477430.199311:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d74e8bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1876402802597504:0@lo:400:kworker.0 00000100:00100000:3.0:1789477430.199345:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789477430.199367:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789477430.199372:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d623cad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3313:1876402802597376:0@lo:400:kworker.0 00000100:00100000:3.0:1789477430.199396:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789477430.199450:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802597248 00000100:00100000:1.0:1789477430.199466:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802597248 00000100:00100000:1.0:1789477430.199555:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 296 00000100:00100000:1.0:1789477430.199567:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d44523850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07d5e05c-913f-419f-adbc-d3cf15e9cd51+19:3311:x1876402802597248:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789477430.199654:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802597504 00000100:00100000:2.0:1789477430.199663:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802597504 00000100:00100000:1.0:1789477430.199703:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d44523850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07d5e05c-913f-419f-adbc-d3cf15e9cd51+19:3311:x1876402802597248:12345-0@lo:400:kworker.0 Request processed in 138us (580us total) trans 0 rc 0/0 00000100:00100000:1.0:1789477430.199714:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 296 00000100:00100000:2.0:1789477430.199738:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1789477430.199759:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d74e88380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3313:x1876402802597504:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789477430.199767:0:6999:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802597376 00000100:00100000:1.0:1789477430.199776:0:6999:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802597376 00000100:00100000:1.0:1789477430.199833:0:6999:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:2.0:1789477430.199841:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d74e88380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3313:x1876402802597504:12345-0@lo:400:kworker.0 Request processed in 84us (491us total) trans 0 rc 0/0 00000100:00100000:1.0:1789477430.199852:0:6999:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d74e8b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1876402802597376:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789477430.199861:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00080000:2.0:1789477430.199894:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789477430.199991:0:6999:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d74e8b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1876402802597376:12345-0@lo:400:kworker.0 Request processed in 147us (590us total) trans 0 rc 0/0 00000100:00100000:1.0:1789477430.199999:0:6999:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:2.0:1789477430.200135:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d623cad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3313:1876402802597376:0@lo:400:kworker.0 00000100:00100000:2.0:1789477430.200149:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d74e8bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1876402802597504:0@lo:400:kworker.0 00000100:00100000:2.0:1789477430.200179:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d74e8aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3311:1876402802597760:0@lo:400:kworker.0 00000100:00100000:2.0:1789477430.200215:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789477430.200247:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d623c9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:07d5e05c-913f-419f-adbc-d3cf15e9cd51:3311:1876402802597248:0@lo:400:kworker.0 00000100:00100000:2.0:1789477430.200258:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789477430.200263:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d74e89c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3311:1876402802597632:0@lo:400:kworker.0 00000100:00100000:2.0:1789477430.200285:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789477430.200898:0:12091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802597760 00000100:00100000:3.0:1789477430.200907:0:12091:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802597760 00000100:00100000:3.0:1789477430.200963:0:12091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802597632 00000100:00100000:3.0:1789477430.200967:0:12091:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802597632 00000100:00100000:3.0:1789477430.200990:0:12091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:3.0:1789477430.200998:0:12091:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d6d3d7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1876402802597760:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789477430.201068:0:12091:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d6d3d7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1876402802597760:12345-0@lo:400:kworker.0 Request processed in 58us (839us total) trans 0 rc 0/0 00000100:00100000:3.0:1789477430.201076:0:12091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:3.0:1789477430.201111:0:12091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:3.0:1789477430.201117:0:12091:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d6d3d4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1876402802597632:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789477430.201148:0:12091:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d6d3d4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1876402802597632:12345-0@lo:400:kworker.0 Request processed in 32us (863us total) trans 0 rc 0/0 00000100:00100000:3.0:1789477430.201154:0:12091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00080000:2.0:1789477430.201926:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789477430.201976:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d74e89c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3311:1876402802597632:0@lo:400:kworker.0 00000100:00100000:2.0:1789477430.201991:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d74e8aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3311:1876402802597760:0@lo:400:kworker.0 00000100:00100000:0.0:1789477430.202695:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:1.0:1789477430.202795:0:8241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783716352 00000100:00100000:1.0:1789477430.202814:0:8241:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783716352 00000100:00100000:1.0:1789477430.202887:0:8241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 48 00000100:00100000:1.0:1789477430.202897:0:8241:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d4766aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9bc33f26-0aab-4a14-832f-c58d566de1b0+5:2355:x1876402783716352:12345-192.168.201.23@tcp:101:bash.0 00010000:00010000:1.0:1789477430.202982:0:8241:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789477430.203006:0:8241:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f75f5d68/0xafddb3c8f928206e lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa90d500d7b8f2cb1 expref: -99 pid: 8241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789477430.203038:0:8241:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789477430.203062:0:8241:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=375s v=(0 0) 00010000:00010000:1.0:1789477430.203068:0:8241:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789477430.203093:0:8241:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f75f5d68/0xafddb3c8f928206e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2cb1 expref: 6 pid: 8241 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477430.203116:0:8241:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000f75f5d68/0xafddb3c8f928206e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2cb1 expref: 6 pid: 8241 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477430.203132:0:8241:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d0d7f518400, rc 0) 00000100:00100000:1.0:1789477430.203278:0:8241:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d4766aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9bc33f26-0aab-4a14-832f-c58d566de1b0+6:2355:x1876402783716352:12345-192.168.201.23@tcp:101:bash.0 Request processed in 381us (589us total) trans 0 rc 0/0 00000100:00100000:1.0:1789477430.203287:0:8241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 48 00010000:00010000:2.0:1789477430.203950:0:3296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f519800/0xafddb3c8f9282059 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477430.203990:0:3296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f519800/0xafddb3c8f9282059 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477430.203999:0:3296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f519800/0xafddb3c8f9282059 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477430.204007:0:3296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d0d7f519800 already unused, calling callback (ffffffffc1fd54f0) 00010000:00010000:2.0:1789477430.204014:0:3296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f519800/0xafddb3c8f9282059 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477430.204023:0:3296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f519800/0xafddb3c8f9282059 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477430.204043:0:3296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9d0d5b9f4300) 00010000:00010000:2.0:1789477430.204046:0:3296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789477430.204052:0:3296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f519800/0xafddb3c8f9282059 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477430.204059:0:3296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f519800/0xafddb3c8f9282059 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789477430.212752:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:3.0:1789477430.213333:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783716480 00000100:00100000:3.0:1789477430.213350:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783716480 00000100:00100000:3.0:1789477430.213440:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 49 00000100:00100000:3.0:1789477430.213453:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d47668700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9bc33f26-0aab-4a14-832f-c58d566de1b0+6:11346:x1876402783716480:12345-192.168.201.23@tcp:101:bash.0 00010000:00010000:3.0:1789477430.213477:0:6694:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789477430.213502:0:6694:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a29b55f4/0xafddb3c8f9282075 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa90d500d7b8f2cb8 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477430.213539:0:6694:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000f75f5d68/0xafddb3c8f928206e lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2cb1 expref: 7 pid: 8241 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477430.213549:0:6694:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789477430.213553:0:6694:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789477430.213559:0:6694:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a29b55f4/0xafddb3c8f9282075 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2cb8 expref: 7 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477430.213885:0:6694:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000f75f5d68/0xafddb3c8f928206e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2cb1 expref: 7 pid: 8241 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477430.213905:0:6694:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000f75f5d68/0xafddb3c8f928206e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2cb1 expref: 7 pid: 8241 timeout: 475 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789477430.213949:0:6694:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d74e89880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6694:1876402802597888:192.168.201.23@tcp:104: 00000100:00100000:3.0:1789477430.214067:0:6694:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d0d4639a180 going to sleep for 11 seconds 00000100:00100000:0.0:1789477430.217317:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:3.0:1789477430.217373:0:6694:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d74e89880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6694:1876402802597888:192.168.201.23@tcp:104: 00010000:00010000:3.0:1789477430.217441:0:6694:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000a29b55f4/0xafddb3c8f9282075 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2cb8 expref: 7 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477430.217471:0:6694:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d0d59d6b600, rc 0) 00000100:00100000:3.0:1789477430.217559:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d47668700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9bc33f26-0aab-4a14-832f-c58d566de1b0+7:11346:x1876402783716480:12345-192.168.201.23@tcp:101:bash.0 Request processed in 4107us (4818us total) trans 0 rc 0/0 00000100:00100000:3.0:1789477430.217571:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 49 00000100:00100000:1.0:1789477430.217634:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783716608 00000100:00100000:1.0:1789477430.217649:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783716608 00010000:00010000:1.0:1789477430.217697:0:5831:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000f75f5d68/0xafddb3c8f928206e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2cb1 expref: 7 pid: 8241 timeout: 475 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789477430.217745:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 62 00000100:00100000:1.0:1789477430.217755:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d47668a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9bc33f26-0aab-4a14-832f-c58d566de1b0+7:2354:x1876402783716608:12345-192.168.201.23@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789477430.217770:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789477430.217794:0:5831:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000f75f5d68/0xafddb3c8f928206e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2cb1 expref: 7 pid: 8241 timeout: 475 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477430.217810:0:5831:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000f75f5d68/0xafddb3c8f928206e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2cb1 expref: 7 pid: 8241 timeout: 475 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477430.217853:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f75f5d68/0xafddb3c8f928206e lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2cb1 expref: 7 pid: 8241 timeout: 475 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477430.217918:0:5831:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789477430.217923:0:5831:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789477430.217932:0:5831:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000a29b55f4/0xafddb3c8f9282075 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2cb8 expref: 6 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477430.217943:0:5831:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a29b55f4/0xafddb3c8f9282075 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2cb8 expref: 6 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477430.217986:0:5831:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000a29b55f4/0xafddb3c8f9282075 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2cb8 expref: 6 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789477430.218002:0:5831:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d7c3e5f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:5831:1876402802598016:192.168.201.23@tcp:105: 00000100:00100000:1.0:1789477430.218078:0:5831:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d0d4840c0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789477430.221820:0:5831:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d7c3e5f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:5831:1876402802598016:192.168.201.23@tcp:105: 00010000:00010000:1.0:1789477430.221861:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789477430.222082:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d47668a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9bc33f26-0aab-4a14-832f-c58d566de1b0+6:2354:x1876402783716608:12345-192.168.201.23@tcp:103:ldlm_bl.0 Request processed in 4262us (4717us total) trans 0 rc 0/0 00000100:00100000:1.0:1789477430.222095:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 62 00000100:00100000:0.0:1789477430.228723:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:3.0:1789477430.229409:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783716864 00000100:00100000:3.0:1789477430.229426:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783716864 00000100:00100000:3.0:1789477430.229548:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 36 00000100:00100000:3.0:1789477430.229562:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d4766b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9bc33f26-0aab-4a14-832f-c58d566de1b0+17:11346:x1876402783716864:12345-192.168.201.23@tcp:35:bash.0 00000100:00100000:3.0:1789477430.230098:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d4766b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9bc33f26-0aab-4a14-832f-c58d566de1b0+18:11346:x1876402783716864:12345-192.168.201.23@tcp:35:bash.0 Request processed in 536us (1386us total) trans 4294967419 rc 0/0 00000100:00100000:3.0:1789477430.230108:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 36 00000100:00100000:0.0:1789477430.373992:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:1.0:1789477430.374123:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783717120 00000100:00100000:1.0:1789477430.374138:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783717120 00000100:00100000:1.0:1789477430.374224:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 144 00000100:00100000:1.0:1789477430.374236:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d7f739500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9bc33f26-0aab-4a14-832f-c58d566de1b0+18:11356:x1876402783717120:12345-192.168.201.23@tcp:101:lfs.0 00010000:00010000:1.0:1789477430.374270:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789477430.374299:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f518400/0xafddb3c8f928207c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa90d500d7b8f2cbf expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789477430.374506:0:5845:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00010000:00010000:1.0:1789477430.374852:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f518400/0xafddb3c8f928207c lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2cbf expref: 20 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477430.374873:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9d0d5b9f4700) 00010000:00010000:1.0:1789477430.374877:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1789477430.374883:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f518400/0xafddb3c8f928207c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2cbf expref: 20 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477430.374903:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d0d7f518400, rc 0) 00000100:00100000:1.0:1789477430.374986:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d7f739500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9bc33f26-0aab-4a14-832f-c58d566de1b0+19:11356:x1876402783717120:12345-192.168.201.23@tcp:101:lfs.0 Request processed in 751us (1010us total) trans 4294967420 rc 301/301 00000100:00100000:1.0:1789477430.374995:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 144 00000100:00100000:0.0:1789477430.388415:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:2.0:1789477430.388647:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783717376 00000100:00100000:2.0:1789477430.388663:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783717376 00000100:00100000:2.0:1789477430.388745:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 37 00000100:00100000:2.0:1789477430.388757:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d7f73b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9bc33f26-0aab-4a14-832f-c58d566de1b0+19:11356:x1876402783717376:12345-192.168.201.23@tcp:35:lfs.0 00000100:00100000:2.0:1789477430.389118:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d7f73b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9bc33f26-0aab-4a14-832f-c58d566de1b0+20:11356:x1876402783717376:12345-192.168.201.23@tcp:35:lfs.0 Request processed in 361us (718us total) trans 4294967421 rc 0/0 00000100:00100000:2.0:1789477430.389126:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 37 00000100:00100000:0.0:1789477430.497678:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:1.0:1789477430.497731:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783717504 00000100:00100000:1.0:1789477430.497746:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783717504 00000100:00100000:1.0:1789477430.497907:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 145 00000100:00100000:1.0:1789477430.497930:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d6d465880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9bc33f26-0aab-4a14-832f-c58d566de1b0+20:11362:x1876402783717504:12345-192.168.201.23@tcp:101:lfs.0 00010000:00010000:1.0:1789477430.497965:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789477430.497993:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f518400/0xafddb3c8f928208a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa90d500d7b8f2cc6 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477430.498086:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f519200/0xafddb3c8f9282091 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477430.498104:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f519200/0xafddb3c8f9282091 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477430.498144:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f519200/0xafddb3c8f9282091 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789477430.498364:0:5846:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00000004:00200000:1.0:1789477430.498369:0:5846:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:1.0:1789477430.498472:0:5846:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f519200/0xafddb3c8f9282091 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477430.498509:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f518400/0xafddb3c8f928208a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2cc6 expref: 22 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477430.498531:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f519200/0xafddb3c8f9282091 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2cc6 expref: 21 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477430.498542:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9d0d44568d00) 00010000:00010000:1.0:1789477430.498545:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789477430.498550:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d0d7f519200, rc 0) 00000100:00100000:1.0:1789477430.498698:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d6d465880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9bc33f26-0aab-4a14-832f-c58d566de1b0+21:11362:x1876402783717504:12345-192.168.201.23@tcp:101:lfs.0 Request processed in 770us (1033us total) trans 0 rc 0/0 00000100:00100000:1.0:1789477430.498708:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 145 00000100:00100000:0.0:1789477430.504902:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:1.0:1789477430.507191:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783717760 00000100:00100000:1.0:1789477430.507220:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783717760 00000100:00100000:1.0:1789477430.507303:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 146 00000100:00100000:1.0:1789477430.507315:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d4e641c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9bc33f26-0aab-4a14-832f-c58d566de1b0+21:11362:x1876402783717760:12345-192.168.201.23@tcp:101:lfs.0 00010000:00010000:1.0:1789477430.507343:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789477430.507370:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f518400/0xafddb3c8f9282098 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa90d500d7b8f2ccd expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477430.507539:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f519400/0xafddb3c8f928209f lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477430.507746:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f519400/0xafddb3c8f928209f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477430.507763:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f519400/0xafddb3c8f928209f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789477430.507778:0:5844:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:1.0:1789477430.508132:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f518400/0xafddb3c8f9282098 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2ccd expref: 24 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477430.508154:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f519400/0xafddb3c8f928209f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2ccd expref: 23 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477430.508164:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9d0d48f9b900) 00010000:00010000:1.0:1789477430.508168:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789477430.508171:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d0d7f519400, rc 0) 00000100:00100000:1.0:1789477430.508446:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d4e641c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9bc33f26-0aab-4a14-832f-c58d566de1b0+23:11362:x1876402783717760:12345-192.168.201.23@tcp:101:lfs.0 Request processed in 1131us (3559us total) trans 4294967422 rc 0/0 00000100:00100000:1.0:1789477430.508455:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 146 00000100:00100000:0.0:1789477430.512995:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:3.0:1789477430.515815:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783718144 00000100:00100000:3.0:1789477430.515845:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783718144 00000100:00100000:3.0:1789477430.516041:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 11 00000100:00100000:3.0:1789477430.516054:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d4e640000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9bc33f26-0aab-4a14-832f-c58d566de1b0+23:2352:x1876402783718144:12345-192.168.201.23@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789477430.516076:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789477430.516111:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f519400/0xafddb3c8f928209f lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2ccd expref: 23 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477430.516170:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9d0d48f9b900) 00010000:00010000:3.0:1789477430.516176:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789477430.516439:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d4e640000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9bc33f26-0aab-4a14-832f-c58d566de1b0+22:2352:x1876402783718144:12345-192.168.201.23@tcp:103:ldlm_bl.0 Request processed in 386us (3525us total) trans 0 rc 0/0 00000100:00100000:3.0:1789477430.516447:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 11 00000100:00100000:0.0:1789477430.516895:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:3.0:1789477430.517752:0:12091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783718016 00000100:00100000:3.0:1789477430.517765:0:12091:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783718016 00000100:00100000:3.0:1789477430.517881:0:12091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 147 00000100:00100000:3.0:1789477430.517893:0:12091:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d4e640380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9bc33f26-0aab-4a14-832f-c58d566de1b0+22:11362:x1876402783718016:12345-192.168.201.23@tcp:101:lfs.0 00010000:00010000:3.0:1789477430.517935:0:12091:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789477430.517960:0:12091:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d59d6b400/0xafddb3c8f92820ad lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa90d500d7b8f2cd4 expref: -99 pid: 12091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477430.518092:0:12091:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d59d6a400/0xafddb3c8f92820b4 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477430.518110:0:12091:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d59d6a400/0xafddb3c8f92820b4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477430.518124:0:12091:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d59d6a400/0xafddb3c8f92820b4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12091 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789477430.520689:0:12091:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:3.0:1789477430.520950:0:12091:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d59d6b400/0xafddb3c8f92820ad lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2cd4 expref: 25 pid: 12091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477430.520978:0:12091:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d59d6a400/0xafddb3c8f92820b4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2cd4 expref: 24 pid: 12091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477430.521001:0:12091:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9d0d48f9b900) 00010000:00010000:3.0:1789477430.521003:0:12091:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1789477430.521006:0:12091:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d0d59d6a400, rc 0) 00000100:00100000:3.0:1789477430.521089:0:12091:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d4e640380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9bc33f26-0aab-4a14-832f-c58d566de1b0+24:11362:x1876402783718016:12345-192.168.201.23@tcp:101:lfs.0 Request processed in 3199us (4196us total) trans 4294967423 rc 0/0 00000100:00100000:3.0:1789477430.521096:0:12091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 147 00000100:00100000:0.0:1789477430.530552:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:2.0:1789477430.530933:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783718272 00000100:00100000:2.0:1789477430.530955:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783718272 00000100:00100000:2.0:1789477430.531021:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 50 00000100:00100000:2.0:1789477430.531032:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d4e641180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9bc33f26-0aab-4a14-832f-c58d566de1b0+6:2355:x1876402783718272:12345-192.168.201.23@tcp:1:lfs.0 00010000:00010000:2.0:1789477430.531093:0:6696:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000025858e8c/0xafddb3c8f92820c2 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477430.531119:0:6696:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000a29b55f4/0xafddb3c8f9282075 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2cb8 expref: 6 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477430.531130:0:6696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789477430.531135:0:6696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789477430.531150:0:6696:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000025858e8c/0xafddb3c8f92820c2 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477430.531196:0:6696:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000a29b55f4/0xafddb3c8f9282075 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2cb8 expref: 6 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477430.531370:0:6696:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000a29b55f4/0xafddb3c8f9282075 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2cb8 expref: 6 pid: 6694 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789477430.531387:0:6696:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d6d3d6a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6696:1876402802598144:192.168.201.23@tcp:104: 00000100:00100000:2.0:1789477430.531513:0:6696:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d0d510ab900 going to sleep for 11 seconds 00000100:00100000:2.0:1789477430.534265:0:6696:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d6d3d6a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6696:1876402802598144:192.168.201.23@tcp:104: 00010000:00010000:2.0:1789477430.534308:0:6696:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000025858e8c/0xafddb3c8f92820c2 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789477430.549648:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:1.0:1789477430.549855:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783718400 00000100:00100000:1.0:1789477430.549870:0:6702:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783718400 00002000:00100000:1.0:1789477430.549950:0:6702:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x4:0x0] (0->12) req@ffff9d0d4e641f80 x1876402783718400/t0(0) o4->9bc33f26-0aab-4a14-832f-c58d566de1b0@192.168.201.23@tcp:601/0 lens 504/0 e 0 to 0 dl 1789477441 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789477430.549962:0:6702:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9d0d4e641f80 with x1876402783718400 ext(0->12) 00010000:00010000:1.0:1789477430.549994:0:6702:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000a29b55f4/0xafddb3c8f9282075 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2cb8 expref: 7 pid: 6694 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477430.550015:0:6702:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000a29b55f4/0xafddb3c8f9282075 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2cb8 expref: 7 pid: 6694 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789477430.550023:0:6702:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff9d0d4e641f80 00000100:00100000:1.0:1789477430.550063:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 2 00000100:00100000:1.0:1789477430.550074:0:6702:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d4e641f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:9bc33f26-0aab-4a14-832f-c58d566de1b0+7:2354:x1876402783718400:12345-192.168.201.23@tcp:4:lfs.0 00000100:00100000:1.0:1789477430.550868:0:6702:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d4e641f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:9bc33f26-0aab-4a14-832f-c58d566de1b0+9:2354:x1876402783718400:12345-192.168.201.23@tcp:4:lfs.0 Request processed in 787us (1296us total) trans 4294967305 rc 0/0 00000100:00100000:1.0:1789477430.550880:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 2 00002000:00100000:1.0:1789477430.550891:0:6702:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x4:0x0] (0->12) req@ffff9d0d4e641f80 x1876402783718400/t4294967305(0) o4->9bc33f26-0aab-4a14-832f-c58d566de1b0@192.168.201.23@tcp:601/0 lens 504/448 e 0 to 0 dl 1789477441 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789477430.550901:0:6702:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9d0d4e641f80 with x1876402783718400 ext(0->12) 00010000:00010000:1.0:1789477430.550909:0:6702:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000a29b55f4/0xafddb3c8f9282075 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2cb8 expref: 9 pid: 6694 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477430.550925:0:6702:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000a29b55f4/0xafddb3c8f9282075 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2cb8 expref: 9 pid: 6694 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789477430.550934:0:6702:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff9d0d4e641f80 00000100:00100000:0.0:1789477430.558738:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:3.0:1789477430.558924:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783718528 00000100:00100000:3.0:1789477430.558940:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783718528 00010000:00010000:3.0:1789477430.558999:0:5829:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000a29b55f4/0xafddb3c8f9282075 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2cb8 expref: 9 pid: 6694 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789477430.559056:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 63 00000100:00100000:3.0:1789477430.559069:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d74f84000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9bc33f26-0aab-4a14-832f-c58d566de1b0+9:2355:x1876402783718528:12345-192.168.201.23@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789477430.559090:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1789477430.559122:0:5829:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:3.0:1789477430.559126:0:5829:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb mtime from disk: 0 -> 1789477429 00002000:00010000:3.0:1789477430.559128:0:5829:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb atime from disk: 0 -> 1789477429 00002000:00010000:3.0:1789477430.559131:0:5829:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb ctime from disk: 0 -> 1789477429 00010000:00010000:3.0:1789477430.559149:0:5829:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000a29b55f4/0xafddb3c8f9282075 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2cb8 expref: 9 pid: 6694 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477430.559167:0:5829:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000a29b55f4/0xafddb3c8f9282075 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2cb8 expref: 9 pid: 6694 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477430.559198:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a29b55f4/0xafddb3c8f9282075 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2cb8 expref: 9 pid: 6694 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477430.559241:0:5829:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789477430.559246:0:5829:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789477430.559254:0:5829:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000025858e8c/0xafddb3c8f92820c2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477430.559266:0:5829:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000025858e8c/0xafddb3c8f92820c2 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477430.559303:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789477430.559445:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d74f84000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9bc33f26-0aab-4a14-832f-c58d566de1b0+8:2355:x1876402783718528:12345-192.168.201.23@tcp:103:ldlm_bl.0 Request processed in 377us (721us total) trans 0 rc 0/0 00000100:00100000:3.0:1789477430.559454:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 63 00010000:00010000:2.0:1789477430.559619:0:6696:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000025858e8c/0xafddb3c8f92820c2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477430.559631:0:6696:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000025858e8c/0xafddb3c8f92820c2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477430.559661:0:6696:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000025858e8c/0xafddb3c8f92820c2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477430.559670:0:6696:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000025858e8c/0xafddb3c8f92820c2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477430.559678:0:6696:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000025858e8c/0xafddb3c8f92820c2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477430.559685:0:6696:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d0d41646a00 already unused, calling callback (ffffffffc15972a0) 00010000:00010000:2.0:1789477430.559690:0:6696:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000025858e8c/0xafddb3c8f92820c2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477430.559700:0:6696:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000025858e8c/0xafddb3c8f92820c2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477430.559714:0:6696:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000025858e8c/0xafddb3c8f92820c2 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477430.559736:0:6696:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000025858e8c/0xafddb3c8f92820c2 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789477430.559798:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d4e641180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9bc33f26-0aab-4a14-832f-c58d566de1b0+7:2355:x1876402783718272:12345-192.168.201.23@tcp:1:lfs.0 Request processed in 28768us (29261us total) trans 0 rc 0/0 00000100:00100000:2.0:1789477430.559809:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 50 00000100:00100000:2.0:1789477430.567114:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:3.0:1789477430.567413:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783718784 00000100:00100000:3.0:1789477430.567429:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783718784 00000100:00100000:3.0:1789477430.567505:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 38 00000100:00100000:3.0:1789477430.567518:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d5845cc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9bc33f26-0aab-4a14-832f-c58d566de1b0+24:11362:x1876402783718784:12345-192.168.201.23@tcp:35:lfs.0 00000004:00010000:3.0:1789477430.569852:0:5848:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0xb:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d59d6a400/0xafddb3c8f92820b4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2cd4 expref: 24 pid: 12091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789477430.570246:0:5848:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967424 00000001:00080000:3.0:1789477430.570302:0:5848:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967425 00000001:00080000:3.0:1789477430.582139:0:5848:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967426 00010000:00010000:3.0:1789477430.582283:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d59d6b600/0xafddb3c8f92820c9 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477430.582309:0:5848:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f518c00/0xafddb3c8f9282060 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2caa expref: 28 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477430.582329:0:5848:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d59d6b600/0xafddb3c8f92820c9 lrc: 4/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477430.582382:0:5848:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f518c00/0xafddb3c8f9282060 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2caa expref: 28 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477430.582404:0:5848:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f518c00/0xafddb3c8f9282060 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2caa expref: 28 pid: 5844 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789477430.582422:0:5848:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d74e89880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5848:1876402802598272:192.168.201.23@tcp:104: 00000100:00100000:3.0:1789477430.582543:0:5848:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d0d585b2540 going to sleep for 11 seconds 00000100:00100000:0.0:1789477430.591433:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:1.0:1789477430.591622:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783718912 00000100:00100000:1.0:1789477430.591637:0:6711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783718912 00010000:00010000:1.0:1789477430.591701:0:6711:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f518c00/0xafddb3c8f9282060 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2caa expref: 29 pid: 5844 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789477430.591782:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 64 00000100:00100000:1.0:1789477430.591806:0:6711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d50a83850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9bc33f26-0aab-4a14-832f-c58d566de1b0+29:2354:x1876402783718912:12345-192.168.201.23@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789477430.591834:0:6711:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789477430.591844:0:6711:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f518c00/0xafddb3c8f9282060 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2caa expref: 29 pid: 5844 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477430.591860:0:6711:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f518c00/0xafddb3c8f9282060 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2caa expref: 29 pid: 5844 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477430.591892:0:6711:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9d0d48f9b900) 00010000:00010000:1.0:1789477430.591898:0:6711:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d59d6b600/0xafddb3c8f92820c9 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477430.591920:0:6711:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d59d6b600/0xafddb3c8f92820c9 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477430.591930:0:6711:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d59d6b600/0xafddb3c8f92820c9 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477430.591954:0:6711:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789477430.592036:0:6711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d50a83850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9bc33f26-0aab-4a14-832f-c58d566de1b0+29:2354:x1876402783718912:12345-192.168.201.23@tcp:103:ldlm_bl.0 Request processed in 233us (619us total) trans 0 rc 0/0 00000100:00100000:1.0:1789477430.592045:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 64 00010000:00010000:3.0:1789477430.598045:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f518c00/0xafddb3c8f9282060 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2caa expref: 28 pid: 5844 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789477430.598080:0:5848:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d74e89880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5848:1876402802598272:192.168.201.23@tcp:104: 00010000:00010000:3.0:1789477430.598111:0:5848:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d59d6b600/0xafddb3c8f92820c9 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477430.598124:0:5848:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d59d6b600/0xafddb3c8f92820c9 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477430.598131:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d59d6b600/0xafddb3c8f92820c9 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789477430.598320:0:5848:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967427 00000001:00080000:3.0:1789477430.598634:0:5848:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967428 00000100:00100000:3.0:1789477430.601592:0:5848:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d74e89880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5848:1876402802598400:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1789477430.601738:0:5848:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789477430.601789:0:5848:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d0d470ed900 going to sleep for 11 seconds 00000100:00100000:0.0:1789477430.604050:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802598400 00000100:00100000:0.0:1789477430.604072:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802598400 00000100:00100000:0.0:1789477430.604159:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1789477430.604172:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d74e88e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5848:x1876402802598400:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1789477430.604340:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d74e88e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5848:x1876402802598400:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 170us (2603us total) trans 0 rc 0/0 00000100:00100000:0.0:1789477430.604348:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1789477430.604676:0:5848:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d74e89880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5848:1876402802598400:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:3.0:1789477430.605357:0:5848:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967429 00000100:00100000:3.0:1789477430.605695:0:5848:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d74e89880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5848:1876402802598528:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1789477430.605763:0:5848:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789477430.605796:0:5848:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d0d7c569c00 going to sleep for 11 seconds 00000100:00100000:1.0:1789477430.606026:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802598528 00000100:00100000:1.0:1789477430.606035:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802598528 00000100:00100000:1.0:1789477430.606086:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1789477430.606097:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d74e88700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5848:x1876402802598528:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1789477430.606354:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d74e88700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5848:x1876402802598528:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 258us (589us total) trans 4294967306 rc 0/0 00000100:00100000:1.0:1789477430.606362:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1789477430.607109:0:5848:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d74e89880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5848:1876402802598528:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:3.0:1789477430.607221:0:5848:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967430 00010000:00010000:3.0:1789477430.607289:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d59d6b600/0xafddb3c8f92820c9 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477430.607303:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d59d6b600/0xafddb3c8f92820c9 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477430.607311:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d59d6b600/0xafddb3c8f92820c9 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477430.607319:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d0d59d6b600 already unused, calling callback (ffffffffc1fd54f0) 00010000:00010000:3.0:1789477430.607324:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d59d6b600/0xafddb3c8f92820c9 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477430.607332:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d59d6b600/0xafddb3c8f92820c9 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477430.607353:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9d0d48f9b900) 00010000:00010000:3.0:1789477430.607357:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:3.0:1789477430.607362:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d59d6b600/0xafddb3c8f92820c9 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477430.607387:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d59d6b600/0xafddb3c8f92820c9 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1789477430.608039:0:5848:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0xc:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:2.0:1789477430.608338:0:5848:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].4, 64 off8448 00000004:00080000:2.0:1789477430.608353:0:5848:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 375679774119ns, next at 376679771451ns, rc = 0 00000001:00080000:2.0:1789477430.608362:0:5848:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967431 00010000:00010000:2.0:1789477430.608430:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9d0d48f9b900) 00010000:00010000:2.0:1789477430.608435:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1789477430.608445:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d59d6a400/0xafddb3c8f92820b4 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2cd4 expref: 32 pid: 12091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789477430.608660:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d5845cc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9bc33f26-0aab-4a14-832f-c58d566de1b0+31:11362:x1876402783718784:12345-192.168.201.23@tcp:35:lfs.0 Request processed in 41142us (41560us total) trans 4294967432 rc 0/0 00000100:00100000:2.0:1789477430.608671:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 38 00000020:00080000:2.0:1789477430.608677:0:5848:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:0.0:1789477430.613069:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:1.0:1789477430.613639:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783719040 00000100:00100000:1.0:1789477430.613652:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783719040 00000100:00100000:1.0:1789477430.613735:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 148 00000100:00100000:1.0:1789477430.613747:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d74f86300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9bc33f26-0aab-4a14-832f-c58d566de1b0+31:11362:x1876402783719040:12345-192.168.201.23@tcp:101:lfs.0 00010000:00010000:1.0:1789477430.613781:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789477430.613835:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f518c00/0xafddb3c8f92820d0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa90d500d7b8f2cdb expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477430.613992:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f518c00/0xafddb3c8f92820d0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2cdb expref: 32 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477430.614013:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f518c00/0xafddb3c8f92820d0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2cdb expref: 32 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477430.614040:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9d0d48f9bf00) 00010000:00010000:1.0:1789477430.614045:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789477430.614050:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d0d7f518c00, rc 0) 00000100:00100000:1.0:1789477430.614130:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d74f86300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9bc33f26-0aab-4a14-832f-c58d566de1b0+32:11362:x1876402783719040:12345-192.168.201.23@tcp:101:lfs.0 Request processed in 384us (1078us total) trans 0 rc 0/0 00000100:00100000:1.0:1789477430.614138:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 148 00000100:00100000:0.0:1789477430.618286:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:2.0:1789477430.618384:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783719296 00000100:00100000:2.0:1789477430.618406:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783719296 00000100:00100000:2.0:1789477430.618478:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 39 00000100:00100000:2.0:1789477430.618492:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d74f84700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9bc33f26-0aab-4a14-832f-c58d566de1b0+32:11362:x1876402783719296:12345-192.168.201.23@tcp:35:lfs.0 00000100:00100000:2.0:1789477430.619161:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d74f84700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9bc33f26-0aab-4a14-832f-c58d566de1b0+33:11362:x1876402783719296:12345-192.168.201.23@tcp:35:lfs.0 Request processed in 667us (882us total) trans 4294967433 rc 0/0 00000100:00100000:2.0:1789477430.619189:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 39 00000100:00100000:2.0:1789477430.687173:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:1.0:1789477430.687497:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783719552 00000100:00100000:1.0:1789477430.687510:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783719552 00000100:00100000:1.0:1789477430.687617:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 149 00000100:00100000:1.0:1789477430.687633:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d6d3d6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9bc33f26-0aab-4a14-832f-c58d566de1b0+33:11372:x1876402783719552:12345-192.168.201.23@tcp:101:lfs.0 00010000:00010000:1.0:1789477430.687684:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789477430.687708:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f518400/0xafddb3c8f92820d7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa90d500d7b8f2ce2 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789477430.687927:0:5844:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00010000:00010000:1.0:1789477430.688103:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f518400/0xafddb3c8f92820d7 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2ce2 expref: 35 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477430.688122:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9d0d5b9f4700) 00010000:00010000:1.0:1789477430.688126:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1789477430.688131:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f518400/0xafddb3c8f92820d7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2ce2 expref: 35 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477430.688148:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d0d7f518400, rc 0) 00000100:00100000:1.0:1789477430.688293:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d6d3d6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9bc33f26-0aab-4a14-832f-c58d566de1b0+34:11372:x1876402783719552:12345-192.168.201.23@tcp:101:lfs.0 Request processed in 663us (1134us total) trans 4294967434 rc 301/301 00000100:00100000:1.0:1789477430.688301:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 149 00000100:00100000:0.0:1789477430.690691:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:3.0:1789477430.691609:0:12091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783719680 00000100:00100000:3.0:1789477430.691626:0:12091:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783719680 00000100:00100000:3.0:1789477430.691700:0:12091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 150 00000100:00100000:3.0:1789477430.691713:0:12091:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d74f84000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9bc33f26-0aab-4a14-832f-c58d566de1b0+34:11372:x1876402783719680:12345-192.168.201.23@tcp:34:lfs.0 00010000:00010000:3.0:1789477430.691834:0:12091:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d59d6b600/0xafddb3c8f92820e5 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477430.691859:0:12091:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d59d6b600/0xafddb3c8f92820e5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477430.691875:0:12091:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d59d6b600/0xafddb3c8f92820e5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477430.691894:0:12091:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d59d6b400/0xafddb3c8f92820ec lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477430.691902:0:12091:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d59d6b400/0xafddb3c8f92820ec lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477430.691909:0:12091:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d59d6b400/0xafddb3c8f92820ec lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477430.692041:0:12091:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d59d6a400/0xafddb3c8f92820f3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477430.692050:0:12091:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d59d6a400/0xafddb3c8f92820f3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477430.692077:0:12091:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d59d6a400/0xafddb3c8f92820f3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12091 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789477430.692145:0:12091:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d59d6a400/0xafddb3c8f92820f3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477430.692162:0:12091:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d59d6b600/0xafddb3c8f92820e5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477430.692169:0:12091:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d59d6b600/0xafddb3c8f92820e5 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 12091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477430.692176:0:12091:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d59d6b600/0xafddb3c8f92820e5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477430.692183:0:12091:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d0d59d6b600 already unused, calling callback (ffffffffc1fd54f0) 00010000:00010000:3.0:1789477430.692189:0:12091:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d59d6b600/0xafddb3c8f92820e5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477430.692198:0:12091:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d59d6b600/0xafddb3c8f92820e5 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 12091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477430.692212:0:12091:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9d0d44568d00) 00010000:00010000:3.0:1789477430.692215:0:12091:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789477430.692221:0:12091:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d59d6b600/0xafddb3c8f92820e5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477430.692227:0:12091:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d59d6b600/0xafddb3c8f92820e5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477430.692249:0:12091:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d59d6b400/0xafddb3c8f92820ec lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477430.692262:0:12091:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d59d6b400/0xafddb3c8f92820ec lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477430.692268:0:12091:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d59d6b400/0xafddb3c8f92820ec lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477430.692273:0:12091:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d0d59d6b400 already unused, calling callback (ffffffffc1fd54f0) 00010000:00010000:3.0:1789477430.692277:0:12091:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d59d6b400/0xafddb3c8f92820ec lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477430.692283:0:12091:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d59d6b400/0xafddb3c8f92820ec lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477430.692292:0:12091:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9d0d44568400) 00010000:00010000:3.0:1789477430.692295:0:12091:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789477430.692298:0:12091:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d59d6b400/0xafddb3c8f92820ec lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477430.692304:0:12091:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d59d6b400/0xafddb3c8f92820ec lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477430.692322:0:12091:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d59d6a400/0xafddb3c8f92820f3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477430.692328:0:12091:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d59d6a400/0xafddb3c8f92820f3 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477430.692334:0:12091:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d59d6a400/0xafddb3c8f92820f3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477430.692339:0:12091:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d0d59d6a400 already unused, calling callback (ffffffffc1fd54f0) 00010000:00010000:3.0:1789477430.692348:0:12091:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d59d6a400/0xafddb3c8f92820f3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477430.692355:0:12091:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d59d6a400/0xafddb3c8f92820f3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477430.692364:0:12091:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9d0d48f9bf00) 00010000:00010000:3.0:1789477430.692367:0:12091:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789477430.692370:0:12091:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d59d6a400/0xafddb3c8f92820f3 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477430.692377:0:12091:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d59d6a400/0xafddb3c8f92820f3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12091 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789477430.693091:0:12091:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d74f84000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9bc33f26-0aab-4a14-832f-c58d566de1b0+34:11372:x1876402783719680:12345-192.168.201.23@tcp:34:lfs.0 Request processed in 1374us (2405us total) trans 0 rc 0/0 00000100:00100000:3.0:1789477430.693103:0:12091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 150 00000100:00100000:0.0:1789477430.696750:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:1.0:1789477430.696970:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783719936 00000100:00100000:1.0:1789477430.696984:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783719936 00000100:00100000:1.0:1789477430.697061:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 40 00000100:00100000:1.0:1789477430.697072:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d7536b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9bc33f26-0aab-4a14-832f-c58d566de1b0+34:11372:x1876402783719936:12345-192.168.201.23@tcp:35:lfs.0 00000100:00100000:1.0:1789477430.697894:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d7536b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9bc33f26-0aab-4a14-832f-c58d566de1b0+35:11372:x1876402783719936:12345-192.168.201.23@tcp:35:lfs.0 Request processed in 818us (1154us total) trans 4294967435 rc 0/0 00000100:00100000:1.0:1789477430.697905:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 40 00000100:00100000:2.0:1789477430.749802:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:0.0:1789477430.749933:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783720192 00000100:00100000:0.0:1789477430.749949:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783720192 00000100:00100000:0.0:1789477430.750037:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 151 00000100:00100000:0.0:1789477430.750051:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d6d3d6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9bc33f26-0aab-4a14-832f-c58d566de1b0+35:11375:x1876402783720192:12345-192.168.201.23@tcp:101:lfs.0 00010000:00010000:0.0:1789477430.750085:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789477430.750115:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be5200/0xafddb3c8f92820fa lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa90d500d7b8f2ce9 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477430.750222:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be4a00/0xafddb3c8f9282101 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477430.750241:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be4a00/0xafddb3c8f9282101 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477430.750255:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be4a00/0xafddb3c8f9282101 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477430.750292:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be5e00/0xafddb3c8f9282108 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477430.750300:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be5e00/0xafddb3c8f9282108 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477430.750307:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be5e00/0xafddb3c8f9282108 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477430.750505:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be5600/0xafddb3c8f928210f lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477430.750515:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be5600/0xafddb3c8f928210f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477430.750524:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be5600/0xafddb3c8f928210f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789477430.750536:0:5845:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:0.0:1789477430.750698:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be4a00/0xafddb3c8f9282101 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477430.750707:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be4a00/0xafddb3c8f9282101 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477430.750715:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be4a00/0xafddb3c8f9282101 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477430.750721:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d0d50be4a00 already unused, calling callback (ffffffffc1fd54f0) 00010000:00010000:0.0:1789477430.750726:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be4a00/0xafddb3c8f9282101 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477430.750747:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be4a00/0xafddb3c8f9282101 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477430.750763:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9d0d44568d00) 00010000:00010000:0.0:1789477430.750766:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789477430.750773:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be4a00/0xafddb3c8f9282101 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477430.750780:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be4a00/0xafddb3c8f9282101 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477430.750796:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be5e00/0xafddb3c8f9282108 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477430.750802:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be5e00/0xafddb3c8f9282108 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477430.750808:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be5e00/0xafddb3c8f9282108 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477430.750826:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d0d50be5e00 already unused, calling callback (ffffffffc1fd54f0) 00010000:00010000:0.0:1789477430.750828:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be5e00/0xafddb3c8f9282108 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477430.750834:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be5e00/0xafddb3c8f9282108 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477430.750842:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9d0d596ae000) 00010000:00010000:0.0:1789477430.750844:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789477430.750847:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be5e00/0xafddb3c8f9282108 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477430.750863:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be5e00/0xafddb3c8f9282108 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477430.750919:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be5200/0xafddb3c8f92820fa lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2ce9 expref: 38 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477430.750935:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be5600/0xafddb3c8f928210f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2ce9 expref: 37 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477430.750943:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9d0d48f9bf00) 00010000:00010000:0.0:1789477430.750946:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789477430.750949:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d0d50be5600, rc 0) 00000100:00100000:0.0:1789477430.751055:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d6d3d6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9bc33f26-0aab-4a14-832f-c58d566de1b0+37:11375:x1876402783720192:12345-192.168.201.23@tcp:101:lfs.0 Request processed in 1005us (1265us total) trans 4294967436 rc 0/0 00000100:00100000:0.0:1789477430.751064:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 151 00000100:00100000:0.0:1789477430.757773:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:1.0:1789477430.757919:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783720320 00000100:00100000:1.0:1789477430.757933:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783720320 00000100:00100000:1.0:1789477430.758010:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 152 00000100:00100000:1.0:1789477430.758043:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d75368000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9bc33f26-0aab-4a14-832f-c58d566de1b0+37:11375:x1876402783720320:12345-192.168.201.23@tcp:54:lfs.0 00010000:00010000:1.0:1789477430.758136:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f519400/0xafddb3c8f928211d lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477430.758158:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f519400/0xafddb3c8f928211d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477430.758174:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f519400/0xafddb3c8f928211d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477430.758221:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f519400/0xafddb3c8f928211d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477430.758230:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f519400/0xafddb3c8f928211d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477430.758238:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f519400/0xafddb3c8f928211d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477430.758246:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d0d7f519400 already unused, calling callback (ffffffffc1fd54f0) 00010000:00010000:1.0:1789477430.758252:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f519400/0xafddb3c8f928211d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477430.758261:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f519400/0xafddb3c8f928211d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477430.758275:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9d0d48f9bf00) 00010000:00010000:1.0:1789477430.758278:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1789477430.758284:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f519400/0xafddb3c8f928211d lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477430.758292:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f519400/0xafddb3c8f928211d lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789477430.758399:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d75368000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9bc33f26-0aab-4a14-832f-c58d566de1b0+37:11375:x1876402783720320:12345-192.168.201.23@tcp:54:lfs.0 Request processed in 360us (644us total) trans 0 rc 0/0 00000100:00100000:1.0:1789477430.758408:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 152 00000100:00100000:1.0:1789477430.760972:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:2.0:1789477430.761574:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783720576 00000100:00100000:2.0:1789477430.761825:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783720576 00000100:00100000:2.0:1789477430.761911:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 41 00000100:00100000:2.0:1789477430.761924:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d7c3e5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9bc33f26-0aab-4a14-832f-c58d566de1b0+37:11375:x1876402783720576:12345-192.168.201.23@tcp:35:lfs.0 00000100:00100000:2.0:1789477430.762267:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d7c3e5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9bc33f26-0aab-4a14-832f-c58d566de1b0+38:11375:x1876402783720576:12345-192.168.201.23@tcp:35:lfs.0 Request processed in 344us (1308us total) trans 4294967437 rc 0/0 00000100:00100000:2.0:1789477430.762276:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 41 00000040:00080000:1.0:1789477430.960789:0:11717:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1789477430.960804:0:11717:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789477430.961112:0:11717:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 3 count 1 00000040:00080000:1.0:1789477430.961120:0:11717:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:3.0:1789477430.961563:0:6710:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789477431.102866:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:3.0:1789477431.103131:0:12091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783720832 00000100:00100000:3.0:1789477431.103146:0:12091:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783720832 00000100:00080000:2.0:1789477431.103288:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789477431.108010:0:12091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 153 00000100:00100000:3.0:1789477431.108048:0:12091:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d6d3d5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9bc33f26-0aab-4a14-832f-c58d566de1b0+38:11407:x1876402783720832:12345-192.168.201.23@tcp:101:cat.0 00010000:00010000:3.0:1789477431.108088:0:12091:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789477431.108120:0:12091:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d59d6a400/0xafddb3c8f9282124 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa90d500d7b8f2cf0 expref: -99 pid: 12091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477431.108307:0:12091:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d59d6b400/0xafddb3c8f928212b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477431.108325:0:12091:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d59d6b400/0xafddb3c8f928212b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477431.108347:0:12091:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d59d6b400/0xafddb3c8f928212b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12091 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789477431.108363:0:12091:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:3.0:1789477431.108541:0:12091:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d59d6a400/0xafddb3c8f9282124 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2cf0 expref: 41 pid: 12091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477431.108570:0:12091:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d59d6b400/0xafddb3c8f928212b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2cf0 expref: 40 pid: 12091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477431.108642:0:12091:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9d0d48f9bf00) 00010000:00010000:3.0:1789477431.108646:0:12091:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789477431.108650:0:12091:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d0d59d6b400, rc 0) 00000100:00100000:3.0:1789477431.108739:0:12091:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d6d3d5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9bc33f26-0aab-4a14-832f-c58d566de1b0+40:11407:x1876402783720832:12345-192.168.201.23@tcp:101:cat.0 Request processed in 711us (5889us total) trans 4294967438 rc 0/0 00000100:00100000:3.0:1789477431.108748:0:12091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 153 00000100:00100000:0.0:1789477431.125791:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:0.0:1789477431.126704:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:2.0:1789477431.127904:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783721216 00000100:00100000:2.0:1789477431.127925:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783721216 00000100:00100000:2.0:1789477431.128017:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 42 00000100:00100000:2.0:1789477431.128030:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d7536bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9bc33f26-0aab-4a14-832f-c58d566de1b0+40:11407:x1876402783721216:12345-192.168.201.23@tcp:35:cat.0 00000100:00100000:2.0:1789477431.129622:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d7536bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9bc33f26-0aab-4a14-832f-c58d566de1b0+41:11407:x1876402783721216:12345-192.168.201.23@tcp:35:cat.0 Request processed in 1580us (2909us total) trans 4294967439 rc 0/0 00000100:00100000:2.0:1789477431.129639:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 42 00000100:00100000:3.0:1789477431.133701:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783720960 00000100:00100000:3.0:1789477431.133778:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783720960 00000100:00100000:2.0:1789477431.134126:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 12 00000100:00100000:2.0:1789477431.134141:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d75369180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9bc33f26-0aab-4a14-832f-c58d566de1b0+41:2355:x1876402783720960:12345-192.168.201.23@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789477431.134168:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789477431.134202:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d59d6b400/0xafddb3c8f928212b lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2cf0 expref: 41 pid: 12091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477431.134258:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9d0d48f9bf00) 00010000:00010000:2.0:1789477431.134265:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789477431.134367:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d75369180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9bc33f26-0aab-4a14-832f-c58d566de1b0+40:2355:x1876402783720960:12345-192.168.201.23@tcp:103:ldlm_bl.0 Request processed in 229us (8593us total) trans 0 rc 0/0 00000100:00100000:2.0:1789477431.134376:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 12 00000100:00100000:0.0:1789477431.257063:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:2.0:1789477431.257307:0:6999:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783721472 00000100:00100000:2.0:1789477431.257322:0:6999:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783721472 00000100:00100000:2.0:1789477431.257406:0:6999:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 154 00000100:00100000:2.0:1789477431.257421:0:6999:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d6d480380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9bc33f26-0aab-4a14-832f-c58d566de1b0+40:11413:x1876402783721472:12345-192.168.201.23@tcp:101:dd.0 00010000:00010000:2.0:1789477431.257458:0:6999:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789477431.257463:0:6999:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1789477431.257500:0:6999:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f519200/0xafddb3c8f9282091 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2cc6 expref: 40 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477431.257527:0:6999:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9d0d44568d00) 00010000:00010000:2.0:1789477431.257532:0:6999:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789477431.257548:0:6999:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d41647800/0xafddb3c8f9282139 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa90d500d7b8f2cf7 expref: -99 pid: 6999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477431.257882:0:6999:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d41646a00/0xafddb3c8f9282140 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477431.257898:0:6999:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be5600/0xafddb3c8f928210f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2ce9 expref: 40 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477431.257921:0:6999:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d41646a00/0xafddb3c8f9282140 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477431.257983:0:6999:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be5600/0xafddb3c8f928210f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2ce9 expref: 40 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477431.258000:0:6999:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be5600/0xafddb3c8f928210f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2ce9 expref: 40 pid: 5845 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789477431.258017:0:6999:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d7f73b100 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6999:1876402802598656:192.168.201.23@tcp:104: 00000100:00100000:2.0:1789477431.258156:0:6999:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d0d510ab480 going to sleep for 11 seconds 00000100:00100000:2.0:1789477431.270974:0:6999:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d7f73b100 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6999:1876402802598656:192.168.201.23@tcp:104: 00010000:00010000:2.0:1789477431.271025:0:6999:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d41646a00/0xafddb3c8f9282140 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789477431.275114:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:1.0:1789477431.275310:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783721600 00000100:00100000:1.0:1789477431.275325:0:6711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783721600 00010000:00010000:1.0:1789477431.275388:0:6711:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be5600/0xafddb3c8f928210f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2ce9 expref: 41 pid: 5845 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789477431.275446:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 65 00000100:00100000:1.0:1789477431.275459:0:6711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d50b05c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9bc33f26-0aab-4a14-832f-c58d566de1b0+41:2354:x1876402783721600:12345-192.168.201.23@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789477431.275479:0:6711:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789477431.275488:0:6711:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be5600/0xafddb3c8f928210f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2ce9 expref: 41 pid: 5845 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477431.275504:0:6711:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be5600/0xafddb3c8f928210f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2ce9 expref: 41 pid: 5845 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477431.275534:0:6711:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be5600/0xafddb3c8f928210f lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2ce9 expref: 41 pid: 5845 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477431.275556:0:6711:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9d0d48f9bf00) 00010000:00010000:1.0:1789477431.275639:0:6711:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d41646a00/0xafddb3c8f9282140 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477431.275651:0:6711:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d41646a00/0xafddb3c8f9282140 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477431.275660:0:6711:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d41646a00/0xafddb3c8f9282140 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477431.275702:0:6711:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789477431.275784:0:6711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d50b05c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9bc33f26-0aab-4a14-832f-c58d566de1b0+40:2354:x1876402783721600:12345-192.168.201.23@tcp:103:ldlm_bl.0 Request processed in 326us (686us total) trans 0 rc 0/0 00000100:00100000:1.0:1789477431.275793:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 65 00010000:00010000:2.0:1789477431.277520:0:6999:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d41646a00/0xafddb3c8f9282140 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477431.277542:0:6999:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d41646a00/0xafddb3c8f9282140 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789477431.277622:0:6999:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:2.0:1789477431.277880:0:6999:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d41647800/0xafddb3c8f9282139 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2cf7 expref: 41 pid: 6999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477431.278010:0:6999:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d41646a00/0xafddb3c8f9282140 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2cf7 expref: 40 pid: 6999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477431.278021:0:6999:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9d0d48f9bf00) 00010000:00010000:2.0:1789477431.278025:0:6999:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1789477431.278049:0:6999:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d0d41646a00, rc 0) 00000100:00100000:2.0:1789477431.278128:0:6999:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d6d480380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9bc33f26-0aab-4a14-832f-c58d566de1b0+40:11413:x1876402783721472:12345-192.168.201.23@tcp:101:dd.0 Request processed in 20709us (21081us total) trans 4294967440 rc 0/0 00000100:00100000:2.0:1789477431.278139:0:6999:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 154 00000100:00100000:0.0:1789477431.286878:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:1.0:1789477431.287183:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783721856 00000100:00100000:1.0:1789477431.287200:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783721856 00000100:00100000:1.0:1789477431.287294:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 155 00000100:00100000:1.0:1789477431.287307:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d50b07100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9bc33f26-0aab-4a14-832f-c58d566de1b0+40:11413:x1876402783721856:12345-192.168.201.23@tcp:36:dd.0 00010000:00010000:1.0:1789477431.287779:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f518a00/0xafddb3c8f928214e lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477431.287815:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f518a00/0xafddb3c8f928214e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477431.287831:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f518a00/0xafddb3c8f928214e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789477431.289157:0:5846:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967441 00000004:00010000:1.0:1789477431.289246:0:5846:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000001f44dc14 reply state 000000007754ff34 transno 4294967442 ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f518a00/0xafddb3c8f928214e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789477431.289261:0:5846:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1789477431.289477:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d50b07100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9bc33f26-0aab-4a14-832f-c58d566de1b0+43:11413:x1876402783721856:12345-192.168.201.23@tcp:36:dd.0 Request processed in 2166us (2616us total) trans 4294967442 rc 0/0 00000100:00100000:1.0:1789477431.289489:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 155 00000020:00080000:1.0:1789477431.289496:0:5846:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1789477431.297056:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f518a00/0xafddb3c8f928214e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477431.297081:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f518a00/0xafddb3c8f928214e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477431.297091:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f518a00/0xafddb3c8f928214e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477431.297098:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d0d7f518a00 already unused, calling callback (ffffffffc1fd54f0) 00010000:00010000:3.0:1789477431.297104:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f518a00/0xafddb3c8f928214e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477431.297135:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f518a00/0xafddb3c8f928214e lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477431.297160:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9d0d48f9bf00) 00010000:00010000:3.0:1789477431.297163:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789477431.297170:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f518a00/0xafddb3c8f928214e lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477431.297177:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f518a00/0xafddb3c8f928214e lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789477431.614167:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:3.0:1789477431.614291:0:12091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783721984 00000100:00100000:3.0:1789477431.614307:0:12091:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783721984 00000100:00100000:3.0:1789477431.614403:0:12091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 156 00000100:00100000:3.0:1789477431.614417:0:12091:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d50b04a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9bc33f26-0aab-4a14-832f-c58d566de1b0+42:11427:x1876402783721984:12345-192.168.201.23@tcp:101:stat.0 00010000:00010000:3.0:1789477431.614454:0:12091:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789477431.614484:0:12091:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d59d6a400/0xafddb3c8f9282155 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa90d500d7b8f2cfe expref: -99 pid: 12091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477431.614637:0:12091:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d59d6b600/0xafddb3c8f928215c lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477431.614655:0:12091:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d59d6b600/0xafddb3c8f928215c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477431.614668:0:12091:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d59d6b600/0xafddb3c8f928215c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477431.614687:0:12091:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d59d6b400/0xafddb3c8f9282163 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477431.614721:0:12091:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d59d6b400/0xafddb3c8f9282163 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477431.614738:0:12091:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d59d6b400/0xafddb3c8f9282163 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477431.614883:0:12091:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49ecba00/0xafddb3c8f928216a lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477431.614896:0:12091:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d41646a00/0xafddb3c8f9282140 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2cf7 expref: 43 pid: 6999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477431.614905:0:12091:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49ecba00/0xafddb3c8f928216a lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477431.614950:0:12091:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d41646a00/0xafddb3c8f9282140 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2cf7 expref: 43 pid: 6999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477431.614966:0:12091:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d41646a00/0xafddb3c8f9282140 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2cf7 expref: 43 pid: 6999 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789477431.614982:0:12091:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d74e88a80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12091:1876402802598784:192.168.201.23@tcp:104: 00000100:00100000:3.0:1789477431.615117:0:12091:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d0d7c569c00 going to sleep for 11 seconds 00000100:00100000:0.0:1789477431.625228:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:1.0:1789477431.625525:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783722240 00000100:00100000:1.0:1789477431.625540:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783722240 00000100:00100000:1.0:1789477431.625653:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 43 00000100:00100000:1.0:1789477431.625667:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d50b05500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9bc33f26-0aab-4a14-832f-c58d566de1b0+44:5604:x1876402783722240:12345-192.168.201.23@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1789477431.626163:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d50b05500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9bc33f26-0aab-4a14-832f-c58d566de1b0+45:5604:x1876402783722240:12345-192.168.201.23@tcp:35:ldlm_bl.0 Request processed in 498us (950us total) trans 4294967443 rc 0/0 00000100:00100000:1.0:1789477431.626175:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 43 00000100:00100000:3.0:1789477431.627105:0:12091:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d74e88a80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12091:1876402802598784:192.168.201.23@tcp:104: 00010000:00010000:3.0:1789477431.627158:0:12091:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49ecba00/0xafddb3c8f928216a lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12091 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789477431.629236:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:1.0:1789477431.629355:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783722368 00000100:00100000:1.0:1789477431.629368:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783722368 00010000:00010000:1.0:1789477431.629426:0:5831:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d41646a00/0xafddb3c8f9282140 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2cf7 expref: 45 pid: 6999 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789477431.629481:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 66 00000100:00100000:1.0:1789477431.629495:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d7f73b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9bc33f26-0aab-4a14-832f-c58d566de1b0+45:2354:x1876402783722368:12345-192.168.201.23@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789477431.629515:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789477431.629524:0:5831:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d41646a00/0xafddb3c8f9282140 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2cf7 expref: 45 pid: 6999 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477431.629539:0:5831:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d41646a00/0xafddb3c8f9282140 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2cf7 expref: 45 pid: 6999 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477431.629569:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d41646a00/0xafddb3c8f9282140 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2cf7 expref: 45 pid: 6999 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477431.629659:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9d0d48f9bf00) 00010000:00010000:1.0:1789477431.629666:0:5831:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49ecba00/0xafddb3c8f928216a lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477431.629677:0:5831:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49ecba00/0xafddb3c8f928216a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 12091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477431.629686:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49ecba00/0xafddb3c8f928216a lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 12091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477431.629727:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789477431.629939:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d7f73b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9bc33f26-0aab-4a14-832f-c58d566de1b0+44:2354:x1876402783722368:12345-192.168.201.23@tcp:103:ldlm_bl.0 Request processed in 446us (715us total) trans 0 rc 0/0 00000100:00100000:1.0:1789477431.629948:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 66 00010000:00010000:3.0:1789477431.630068:0:12091:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49ecba00/0xafddb3c8f928216a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477431.630087:0:12091:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49ecba00/0xafddb3c8f928216a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12091 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789477431.630151:0:12091:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:3.0:1789477431.630157:0:12091:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1789477431.630184:0:12091:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49ecba00/0xafddb3c8f928216a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477431.630200:0:12091:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49ecba00/0xafddb3c8f928216a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477431.630211:0:12091:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d59d6b600/0xafddb3c8f928215c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477431.630219:0:12091:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d59d6b600/0xafddb3c8f928215c lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 12091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477431.630227:0:12091:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d59d6b600/0xafddb3c8f928215c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477431.630233:0:12091:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d0d59d6b600 already unused, calling callback (ffffffffc1fd54f0) 00010000:00010000:3.0:1789477431.630239:0:12091:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d59d6b600/0xafddb3c8f928215c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477431.630248:0:12091:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d59d6b600/0xafddb3c8f928215c lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 12091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477431.630259:0:12091:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9d0d44568d00) 00010000:00010000:3.0:1789477431.630263:0:12091:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789477431.630267:0:12091:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d59d6b600/0xafddb3c8f928215c lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477431.630284:0:12091:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d59d6b600/0xafddb3c8f928215c lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477431.630304:0:12091:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d59d6b400/0xafddb3c8f9282163 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477431.630311:0:12091:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d59d6b400/0xafddb3c8f9282163 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477431.630317:0:12091:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d59d6b400/0xafddb3c8f9282163 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477431.630323:0:12091:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d0d59d6b400 already unused, calling callback (ffffffffc1fd54f0) 00010000:00010000:3.0:1789477431.630326:0:12091:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d59d6b400/0xafddb3c8f9282163 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477431.630332:0:12091:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d59d6b400/0xafddb3c8f9282163 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477431.630340:0:12091:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9d0d44568400) 00010000:00010000:3.0:1789477431.630342:0:12091:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789477431.630345:0:12091:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d59d6b400/0xafddb3c8f9282163 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477431.630351:0:12091:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d59d6b400/0xafddb3c8f9282163 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477431.630394:0:12091:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d59d6a400/0xafddb3c8f9282155 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2cfe expref: 44 pid: 12091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477431.630424:0:12091:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49ecba00/0xafddb3c8f928216a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2cfe expref: 43 pid: 12091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477431.630432:0:12091:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9d0d48f9bf00) 00010000:00010000:3.0:1789477431.630434:0:12091:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789477431.630437:0:12091:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d0d49ecba00, rc 0) 00000100:00100000:3.0:1789477431.630474:0:12091:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d50b04a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9bc33f26-0aab-4a14-832f-c58d566de1b0+43:11427:x1876402783721984:12345-192.168.201.23@tcp:101:stat.0 Request processed in 16061us (16324us total) trans 0 rc 0/0 00000100:00100000:3.0:1789477431.630482:0:12091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 156 00000100:00100000:0.0:1789477431.743990:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:2.0:1789477431.744405:0:6999:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783722624 00000100:00100000:2.0:1789477431.744420:0:6999:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783722624 00000100:00100000:2.0:1789477431.744502:0:6999:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 157 00000100:00100000:2.0:1789477431.744515:0:6999:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d50b06d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9bc33f26-0aab-4a14-832f-c58d566de1b0+43:11433:x1876402783722624:12345-192.168.201.23@tcp:36:truncate.0 00010000:00010000:2.0:1789477431.744635:0:6999:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789477431.744672:0:6999:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49ecba00/0xafddb3c8f928216a lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2cfe expref: 43 pid: 12091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477431.744706:0:6999:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9d0d48f9bf00) 00010000:00010000:2.0:1789477431.744712:0:6999:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789477431.745027:0:6999:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d41646a00/0xafddb3c8f9282171 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477431.745047:0:6999:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d41646a00/0xafddb3c8f9282171 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477431.745060:0:6999:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d41646a00/0xafddb3c8f9282171 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789477431.745138:0:6999:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967444 00000004:00010000:2.0:1789477431.745169:0:6999:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000c3bdfe42 reply state 00000000c6dceb70 transno 4294967445 ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d41646a00/0xafddb3c8f9282171 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789477431.745180:0:6999:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789477431.747852:0:6999:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d50b06d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9bc33f26-0aab-4a14-832f-c58d566de1b0+45:11433:x1876402783722624:12345-192.168.201.23@tcp:36:truncate.0 Request processed in 3322us (3862us total) trans 4294967445 rc 0/0 00000100:00100000:2.0:1789477431.747889:0:6999:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 157 00000020:00080000:2.0:1789477431.747901:0:6999:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1789477431.765725:0:3296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d41646a00/0xafddb3c8f9282171 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477431.765749:0:3296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d41646a00/0xafddb3c8f9282171 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477431.765758:0:3296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d41646a00/0xafddb3c8f9282171 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477431.765765:0:3296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d0d41646a00 already unused, calling callback (ffffffffc1fd54f0) 00010000:00010000:1.0:1789477431.765770:0:3296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d41646a00/0xafddb3c8f9282171 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477431.765779:0:3296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d41646a00/0xafddb3c8f9282171 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477431.765836:0:3296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9d0d48f9bf00) 00010000:00010000:1.0:1789477431.765840:0:3296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789477431.765846:0:3296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d41646a00/0xafddb3c8f9282171 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477431.765853:0:3296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d41646a00/0xafddb3c8f9282171 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789477431.909001:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:1.0:1789477431.909159:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783722752 00000100:00100000:1.0:1789477431.909175:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783722752 00000100:00100000:1.0:1789477431.909390:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 158 00000100:00100000:1.0:1789477431.909404:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d50b04000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9bc33f26-0aab-4a14-832f-c58d566de1b0+44:11447:x1876402783722752:12345-192.168.201.23@tcp:101:stat.0 00010000:00010000:1.0:1789477431.909442:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789477431.909471:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f518800/0xafddb3c8f9282178 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa90d500d7b8f2d05 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477431.909635:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f518000/0xafddb3c8f928217f lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477431.909657:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f518000/0xafddb3c8f928217f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477431.909672:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f518000/0xafddb3c8f928217f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477431.909693:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f518600/0xafddb3c8f9282186 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477431.909700:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f518600/0xafddb3c8f9282186 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477431.909811:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f518600/0xafddb3c8f9282186 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477431.909956:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f518a00/0xafddb3c8f928218d lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477431.909964:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f518a00/0xafddb3c8f928218d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477431.909972:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f518a00/0xafddb3c8f928218d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789477431.910020:0:5845:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 1234567 00000004:00200000:1.0:1789477431.910025:0:5845:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1789477431.910055:0:5845:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f518a00/0xafddb3c8f928218d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477431.910069:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f518a00/0xafddb3c8f928218d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477431.910078:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f518000/0xafddb3c8f928217f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477431.910086:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f518000/0xafddb3c8f928217f lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477431.910093:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f518000/0xafddb3c8f928217f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477431.910100:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d0d7f518000 already unused, calling callback (ffffffffc1fd54f0) 00010000:00010000:1.0:1789477431.910930:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f518000/0xafddb3c8f928217f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477431.910958:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f518000/0xafddb3c8f928217f lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477431.910975:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9d0d44568d00) 00010000:00010000:1.0:1789477431.910978:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789477431.910983:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f518000/0xafddb3c8f928217f lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477431.910990:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f518000/0xafddb3c8f928217f lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477431.911009:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f518600/0xafddb3c8f9282186 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477431.911015:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f518600/0xafddb3c8f9282186 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477431.911022:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f518600/0xafddb3c8f9282186 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477431.911027:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d0d7f518600 already unused, calling callback (ffffffffc1fd54f0) 00010000:00010000:1.0:1789477431.911031:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f518600/0xafddb3c8f9282186 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477431.911037:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f518600/0xafddb3c8f9282186 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477431.911044:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9d0d48f9b400) 00010000:00010000:1.0:1789477431.911047:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789477431.911050:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f518600/0xafddb3c8f9282186 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477431.911067:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f518600/0xafddb3c8f9282186 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477431.911359:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f518800/0xafddb3c8f9282178 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2d05 expref: 46 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477431.911379:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f518a00/0xafddb3c8f928218d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2d05 expref: 45 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477431.911388:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9d0d48f9bf00) 00010000:00010000:1.0:1789477431.911391:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789477431.911394:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d0d7f518a00, rc 0) 00000100:00100000:1.0:1789477431.911550:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d50b04000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9bc33f26-0aab-4a14-832f-c58d566de1b0+45:11447:x1876402783722752:12345-192.168.201.23@tcp:101:stat.0 Request processed in 2148us (2565us total) trans 0 rc 0/0 00000100:00100000:1.0:1789477431.911560:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 158 00010000:00010000:3.0:1789477431.984617:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789477432.018286:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:3.0:1789477432.018417:0:12091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783723008 00000100:00100000:3.0:1789477432.018432:0:12091:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783723008 00000100:00100000:3.0:1789477432.018513:0:12091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 159 00000100:00100000:3.0:1789477432.018526:0:12091:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d7c3e4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9bc33f26-0aab-4a14-832f-c58d566de1b0+45:11457:x1876402783723008:12345-192.168.201.23@tcp:101:lfs.0 00010000:00010000:3.0:1789477432.018556:0:12091:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789477432.018878:0:12091:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49eca600/0xafddb3c8f9282194 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa90d500d7b8f2d0c expref: -99 pid: 12091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789477432.019045:0:12091:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00010000:00010000:3.0:1789477432.019218:0:12091:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49eca600/0xafddb3c8f9282194 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2d0c expref: 47 pid: 12091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477432.019238:0:12091:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9d0d5b9f4700) 00010000:00010000:3.0:1789477432.019241:0:12091:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789477432.019246:0:12091:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49eca600/0xafddb3c8f9282194 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2d0c expref: 47 pid: 12091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477432.019293:0:12091:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d0d49eca600, rc 0) 00000100:00100000:3.0:1789477432.019382:0:12091:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d7c3e4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9bc33f26-0aab-4a14-832f-c58d566de1b0+46:11457:x1876402783723008:12345-192.168.201.23@tcp:101:lfs.0 Request processed in 857us (1111us total) trans 4294967446 rc 301/301 00000100:00100000:3.0:1789477432.019392:0:12091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 159 00000100:00100000:2.0:1789477432.023178:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:1.0:1789477432.023291:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783723264 00000100:00100000:1.0:1789477432.023305:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783723264 00000100:00100000:1.0:1789477432.023381:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 44 00000100:00100000:1.0:1789477432.023394:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d5845c450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9bc33f26-0aab-4a14-832f-c58d566de1b0+46:11457:x1876402783723264:12345-192.168.201.23@tcp:35:lfs.0 00000100:00100000:1.0:1789477432.024116:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d5845c450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9bc33f26-0aab-4a14-832f-c58d566de1b0+47:11457:x1876402783723264:12345-192.168.201.23@tcp:35:lfs.0 Request processed in 722us (951us total) trans 4294967447 rc 0/0 00000100:00100000:1.0:1789477432.024127:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 44 00000100:00100000:0.0:1789477432.121036:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:2.0:1789477432.121283:0:6999:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783723520 00000100:00100000:2.0:1789477432.121355:0:6999:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783723520 00000100:00100000:2.0:1789477432.121444:0:6999:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 160 00000100:00100000:2.0:1789477432.121457:0:6999:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d50b05180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9bc33f26-0aab-4a14-832f-c58d566de1b0+47:11463:x1876402783723520:12345-192.168.201.23@tcp:101:bash.0 00010000:00010000:2.0:1789477432.121880:0:6999:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789477432.121909:0:6999:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d41647800/0xafddb3c8f92821a2 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa90d500d7b8f2d13 expref: -99 pid: 6999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477432.122051:0:6999:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d41647a00/0xafddb3c8f92821a9 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477432.122212:0:6999:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f518a00/0xafddb3c8f928218d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2d05 expref: 48 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477432.122223:0:6999:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d41647a00/0xafddb3c8f92821a9 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477432.122271:0:6999:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f518a00/0xafddb3c8f928218d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2d05 expref: 48 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477432.122358:0:6999:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f518a00/0xafddb3c8f928218d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2d05 expref: 48 pid: 5845 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789477432.122377:0:6999:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d623c9f80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6999:1876402802598912:192.168.201.23@tcp:104: 00000100:00100000:2.0:1789477432.127548:0:6999:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d0d58508cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1789477432.131110:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:1.0:1789477432.131645:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783723648 00000100:00100000:1.0:1789477432.131656:0:6711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783723648 00010000:00010000:1.0:1789477432.131710:0:6711:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f518a00/0xafddb3c8f928218d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2d05 expref: 49 pid: 5845 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789477432.131766:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 67 00000100:00100000:1.0:1789477432.131797:0:6711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d50b05500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9bc33f26-0aab-4a14-832f-c58d566de1b0+49:2354:x1876402783723648:12345-192.168.201.23@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789477432.131822:0:6711:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789477432.131832:0:6711:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f518a00/0xafddb3c8f928218d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2d05 expref: 49 pid: 5845 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477432.131847:0:6711:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f518a00/0xafddb3c8f928218d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2d05 expref: 49 pid: 5845 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477432.131878:0:6711:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f518a00/0xafddb3c8f928218d lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2d05 expref: 49 pid: 5845 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477432.131897:0:6711:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9d0d48f9bf00) 00010000:00010000:1.0:1789477432.131904:0:6711:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d41647a00/0xafddb3c8f92821a9 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477432.131916:0:6711:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d41647a00/0xafddb3c8f92821a9 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477432.131923:0:6711:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d41647a00/0xafddb3c8f92821a9 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477432.131947:0:6711:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789477432.132035:0:6711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d50b05500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9bc33f26-0aab-4a14-832f-c58d566de1b0+48:2354:x1876402783723648:12345-192.168.201.23@tcp:103:ldlm_bl.0 Request processed in 258us (933us total) trans 0 rc 0/0 00000100:00100000:1.0:1789477432.132044:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 67 00000100:00100000:2.0:1789477432.133362:0:6999:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d623c9f80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6999:1876402802598912:192.168.201.23@tcp:104: 00010000:00010000:2.0:1789477432.134211:0:6999:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d41647a00/0xafddb3c8f92821a9 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477432.134231:0:6999:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d41647a00/0xafddb3c8f92821a9 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477432.134238:0:6999:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d41647a00/0xafddb3c8f92821a9 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789477432.134270:0:6999:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 1234567 00010000:00010000:2.0:1789477432.134951:0:6999:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d41647800/0xafddb3c8f92821a2 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2d13 expref: 49 pid: 6999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477432.134978:0:6999:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d41647a00/0xafddb3c8f92821a9 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2d13 expref: 48 pid: 6999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477432.134989:0:6999:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9d0d48f9bf00) 00010000:00010000:2.0:1789477432.134992:0:6999:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1789477432.134996:0:6999:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d0d41647a00, rc 0) 00000100:00100000:2.0:1789477432.135198:0:6999:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d50b05180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9bc33f26-0aab-4a14-832f-c58d566de1b0+48:11463:x1876402783723520:12345-192.168.201.23@tcp:101:bash.0 Request processed in 13742us (14175us total) trans 4294967448 rc 0/0 00000100:00100000:2.0:1789477432.135209:0:6999:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 160 00000100:00100000:0.0:1789477432.138397:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:1.0:1789477432.138503:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783723904 00000100:00100000:1.0:1789477432.138524:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783723904 00000100:00100000:1.0:1789477432.138709:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 161 00000100:00100000:1.0:1789477432.138721:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d75107480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9bc33f26-0aab-4a14-832f-c58d566de1b0+48:11463:x1876402783723904:12345-192.168.201.23@tcp:36:bash.0 00010000:00010000:1.0:1789477432.139104:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f518a00/0xafddb3c8f92821b7 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477432.139139:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f518a00/0xafddb3c8f92821b7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477432.139152:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f518a00/0xafddb3c8f92821b7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789477432.139215:0:5845:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967449 00000004:00010000:1.0:1789477432.139241:0:5845:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000080551cf3 reply state 00000000ea042173 transno 4294967450 ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f518a00/0xafddb3c8f92821b7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789477432.139251:0:5845:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1789477432.139372:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d75107480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9bc33f26-0aab-4a14-832f-c58d566de1b0+51:11463:x1876402783723904:12345-192.168.201.23@tcp:36:bash.0 Request processed in 652us (989us total) trans 4294967450 rc 0/0 00000100:00100000:1.0:1789477432.139381:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 161 00000020:00080000:1.0:1789477432.139388:0:5845:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1789477432.146265:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f518a00/0xafddb3c8f92821b7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477432.146286:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f518a00/0xafddb3c8f92821b7 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477432.146303:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f518a00/0xafddb3c8f92821b7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477432.146311:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d0d7f518a00 already unused, calling callback (ffffffffc1fd54f0) 00010000:00010000:3.0:1789477432.146317:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f518a00/0xafddb3c8f92821b7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477432.146325:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f518a00/0xafddb3c8f92821b7 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477432.146347:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9d0d48f9bf00) 00010000:00010000:3.0:1789477432.146351:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789477432.146355:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f518a00/0xafddb3c8f92821b7 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477432.146363:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f518a00/0xafddb3c8f92821b7 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789477432.149661:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:3.0:1789477432.149967:0:12091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783724032 00000100:00100000:3.0:1789477432.150005:0:12091:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783724032 00000100:00100000:3.0:1789477432.150092:0:12091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 162 00000100:00100000:3.0:1789477432.150114:0:12091:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d75104700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9bc33f26-0aab-4a14-832f-c58d566de1b0+50:11463:x1876402783724032:12345-192.168.201.23@tcp:101:bash.0 00010000:00010000:3.0:1789477432.150150:0:12091:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789477432.150178:0:12091:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49eca600/0xafddb3c8f92821be lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa90d500d7b8f2d1a expref: -99 pid: 12091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477432.150299:0:12091:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49ecbc00/0xafddb3c8f92821c5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 12091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477432.150317:0:12091:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d41647a00/0xafddb3c8f92821a9 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2d13 expref: 51 pid: 6999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477432.150327:0:12091:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49ecbc00/0xafddb3c8f92821c5 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477432.150370:0:12091:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d41647a00/0xafddb3c8f92821a9 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2d13 expref: 51 pid: 6999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477432.150387:0:12091:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d41647a00/0xafddb3c8f92821a9 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2d13 expref: 51 pid: 6999 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789477432.150404:0:12091:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d74e88a80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12091:1876402802599040:192.168.201.23@tcp:104: 00000100:00100000:3.0:1789477432.150512:0:12091:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d0d7c569c00 going to sleep for 11 seconds 00000100:00100000:0.0:1789477432.157846:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:1.0:1789477432.158069:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783724160 00000100:00100000:1.0:1789477432.158085:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783724160 00010000:00010000:1.0:1789477432.158156:0:5831:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d41647a00/0xafddb3c8f92821a9 lrc: 5/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2d13 expref: 52 pid: 6999 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789477432.158214:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 68 00000100:00100000:1.0:1789477432.158227:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d75104000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9bc33f26-0aab-4a14-832f-c58d566de1b0+52:2355:x1876402783724160:12345-192.168.201.23@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789477432.158249:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789477432.158257:0:5831:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d41647a00/0xafddb3c8f92821a9 lrc: 5/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2d13 expref: 52 pid: 6999 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477432.158288:0:5831:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d41647a00/0xafddb3c8f92821a9 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2d13 expref: 52 pid: 6999 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477432.158318:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9d0d48f9bf00) 00010000:00010000:1.0:1789477432.158324:0:5831:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49ecbc00/0xafddb3c8f92821c5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x50210000000000 pid: 12091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477432.158336:0:5831:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49ecbc00/0xafddb3c8f92821c5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 12091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477432.158345:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49ecbc00/0xafddb3c8f92821c5 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 12091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477432.158368:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789477432.158440:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d75104000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9bc33f26-0aab-4a14-832f-c58d566de1b0+52:2355:x1876402783724160:12345-192.168.201.23@tcp:103:ldlm_bl.0 Request processed in 215us (614us total) trans 0 rc 0/0 00000100:00100000:1.0:1789477432.158450:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 68 00010000:00010000:3.0:1789477432.160652:0:12091:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d41647a00/0xafddb3c8f92821a9 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2d13 expref: 51 pid: 6999 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789477432.160683:0:12091:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d74e88a80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12091:1876402802599040:192.168.201.23@tcp:104: 00010000:00010000:3.0:1789477432.160738:0:12091:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49ecbc00/0xafddb3c8f92821c5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477432.160750:0:12091:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49ecbc00/0xafddb3c8f92821c5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477432.160756:0:12091:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49ecbc00/0xafddb3c8f92821c5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12091 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789477432.160835:0:12091:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:3.0:1789477432.160840:0:12091:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1789477432.160868:0:12091:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49ecbc00/0xafddb3c8f92821c5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477432.160913:0:12091:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49eca600/0xafddb3c8f92821be lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2d1a expref: 51 pid: 12091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477432.160937:0:12091:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49ecbc00/0xafddb3c8f92821c5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2d1a expref: 50 pid: 12091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477432.160946:0:12091:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9d0d48f9bf00) 00010000:00010000:3.0:1789477432.160949:0:12091:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789477432.160954:0:12091:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d0d49ecbc00, rc 0) 00000100:00100000:3.0:1789477432.161032:0:12091:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d75104700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9bc33f26-0aab-4a14-832f-c58d566de1b0+50:11463:x1876402783724032:12345-192.168.201.23@tcp:101:bash.0 Request processed in 10928us (11385us total) trans 0 rc 0/0 00000100:00100000:3.0:1789477432.161042:0:12091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 162 00000100:00100000:0.0:1789477432.168015:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:1.0:1789477432.168258:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783724416 00000100:00100000:1.0:1789477432.168274:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783724416 00000100:00100000:1.0:1789477432.168434:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 45 00000100:00100000:1.0:1789477432.168447:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d75105880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9bc33f26-0aab-4a14-832f-c58d566de1b0+50:11463:x1876402783724416:12345-192.168.201.23@tcp:35:bash.0 00000100:00100000:1.0:1789477432.171248:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d75105880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9bc33f26-0aab-4a14-832f-c58d566de1b0+51:11463:x1876402783724416:12345-192.168.201.23@tcp:35:bash.0 Request processed in 2784us (3229us total) trans 4294967451 rc 0/0 00000100:00100000:1.0:1789477432.171268:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 45 00000100:00100000:0.0:1789477432.271706:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:2.0:1789477432.274361:0:6999:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783724672 00000100:00100000:2.0:1789477432.274383:0:6999:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783724672 00000100:00100000:0.0:1789477432.274731:0:6999:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 163 00000100:00100000:0.0:1789477432.274741:0:6999:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d75107800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9bc33f26-0aab-4a14-832f-c58d566de1b0+51:11472:x1876402783724672:12345-192.168.201.23@tcp:101:lfs.0 00010000:00010000:0.0:1789477432.274772:0:6999:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789477432.274813:0:6999:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be5e00/0xafddb3c8f92821cc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa90d500d7b8f2d21 expref: -99 pid: 6999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789477432.274983:0:6999:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00010000:00010000:0.0:1789477432.275128:0:6999:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be5e00/0xafddb3c8f92821cc lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2d21 expref: 53 pid: 6999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477432.275143:0:6999:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9d0d5b9f4700) 00010000:00010000:0.0:1789477432.275146:0:6999:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1789477432.275150:0:6999:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be5e00/0xafddb3c8f92821cc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2d21 expref: 53 pid: 6999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477432.275164:0:6999:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d0d50be5e00, rc 0) 00000100:00100000:0.0:1789477432.275238:0:6999:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d75107800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9bc33f26-0aab-4a14-832f-c58d566de1b0+52:11472:x1876402783724672:12345-192.168.201.23@tcp:101:lfs.0 Request processed in 499us (3548us total) trans 4294967452 rc 301/301 00000100:00100000:0.0:1789477432.275244:0:6999:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 163 00000100:00100000:3.0:1789477432.285155:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:0.0:1789477432.285685:0:6999:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783724800 00000100:00100000:0.0:1789477432.285702:0:6999:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783724800 00000100:00100000:0.0:1789477432.285806:0:6999:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 164 00000100:00100000:0.0:1789477432.285820:0:6999:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d74e88a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9bc33f26-0aab-4a14-832f-c58d566de1b0+52:11472:x1876402783724800:12345-192.168.201.23@tcp:34:lfs.0 00010000:00010000:0.0:1789477432.285953:0:6999:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be5200/0xafddb3c8f92821da lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477432.285976:0:6999:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be5200/0xafddb3c8f92821da lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477432.285991:0:6999:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be5200/0xafddb3c8f92821da lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477432.286010:0:6999:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be4800/0xafddb3c8f92821e1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477432.286018:0:6999:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be4800/0xafddb3c8f92821e1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477432.286025:0:6999:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be4800/0xafddb3c8f92821e1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477432.286450:0:6999:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be5800/0xafddb3c8f92821e8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477432.286462:0:6999:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be5800/0xafddb3c8f92821e8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477432.286470:0:6999:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be5800/0xafddb3c8f92821e8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789477432.286853:0:6999:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be5800/0xafddb3c8f92821e8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477432.286872:0:6999:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be5200/0xafddb3c8f92821da lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477432.286893:0:6999:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be5200/0xafddb3c8f92821da lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477432.286901:0:6999:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be5200/0xafddb3c8f92821da lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477432.286908:0:6999:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d0d50be5200 already unused, calling callback (ffffffffc1fd54f0) 00010000:00010000:0.0:1789477432.286913:0:6999:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be5200/0xafddb3c8f92821da lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477432.286921:0:6999:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be5200/0xafddb3c8f92821da lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477432.286935:0:6999:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9d0d44568d00) 00010000:00010000:0.0:1789477432.286938:0:6999:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789477432.286944:0:6999:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be5200/0xafddb3c8f92821da lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477432.286949:0:6999:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be5200/0xafddb3c8f92821da lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477432.286966:0:6999:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be4800/0xafddb3c8f92821e1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477432.286971:0:6999:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be4800/0xafddb3c8f92821e1 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477432.286977:0:6999:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be4800/0xafddb3c8f92821e1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477432.286983:0:6999:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d0d50be4800 already unused, calling callback (ffffffffc1fd54f0) 00010000:00010000:0.0:1789477432.286991:0:6999:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be4800/0xafddb3c8f92821e1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477432.286997:0:6999:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be4800/0xafddb3c8f92821e1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477432.287005:0:6999:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9d0d596ae000) 00010000:00010000:0.0:1789477432.287008:0:6999:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789477432.287011:0:6999:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be4800/0xafddb3c8f92821e1 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477432.287017:0:6999:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be4800/0xafddb3c8f92821e1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477432.288850:0:6999:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be5800/0xafddb3c8f92821e8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477432.288874:0:6999:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be5800/0xafddb3c8f92821e8 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477432.288883:0:6999:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be5800/0xafddb3c8f92821e8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477432.288889:0:6999:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d0d50be5800 already unused, calling callback (ffffffffc1fd54f0) 00010000:00010000:0.0:1789477432.288894:0:6999:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be5800/0xafddb3c8f92821e8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477432.288902:0:6999:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be5800/0xafddb3c8f92821e8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477432.288923:0:6999:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9d0d48f9bf00) 00010000:00010000:0.0:1789477432.288926:0:6999:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789477432.288949:0:6999:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be5800/0xafddb3c8f92821e8 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477432.288955:0:6999:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be5800/0xafddb3c8f92821e8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789477432.289684:0:6999:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d74e88a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9bc33f26-0aab-4a14-832f-c58d566de1b0+52:11472:x1876402783724800:12345-192.168.201.23@tcp:34:lfs.0 Request processed in 3856us (4533us total) trans 0 rc 0/0 00000100:00100000:0.0:1789477432.289699:0:6999:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 164 00000100:00100000:2.0:1789477432.297354:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:0.0:1789477432.297455:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783725056 00000100:00100000:0.0:1789477432.297467:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783725056 00000100:00100000:0.0:1789477432.297674:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 46 00000100:00100000:0.0:1789477432.297687:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d623c9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9bc33f26-0aab-4a14-832f-c58d566de1b0+52:11472:x1876402783725056:12345-192.168.201.23@tcp:35:lfs.0 00000100:00100000:0.0:1789477432.298078:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d623c9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9bc33f26-0aab-4a14-832f-c58d566de1b0+53:11472:x1876402783725056:12345-192.168.201.23@tcp:35:lfs.0 Request processed in 393us (736us total) trans 4294967453 rc 0/0 00000100:00100000:0.0:1789477432.298088:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 46 00000100:00100000:3.0:1789477432.343273:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:2.0:1789477432.343412:0:12091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783725312 00000100:00100000:2.0:1789477432.343426:0:12091:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783725312 00000100:00100000:2.0:1789477432.343523:0:12091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 165 00000100:00100000:2.0:1789477432.343536:0:12091:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d74e8b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9bc33f26-0aab-4a14-832f-c58d566de1b0+53:11476:x1876402783725312:12345-192.168.201.23@tcp:101:lfs.0 00010000:00010000:2.0:1789477432.343569:0:12091:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789477432.343637:0:12091:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d41647800/0xafddb3c8f92821ef lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa90d500d7b8f2d28 expref: -99 pid: 12091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477432.343756:0:12091:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d41647a00/0xafddb3c8f92821f6 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477432.343775:0:12091:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d41647a00/0xafddb3c8f92821f6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477432.343804:0:12091:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d41647a00/0xafddb3c8f92821f6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477432.343821:0:12091:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d41647000/0xafddb3c8f92821fd lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477432.343828:0:12091:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d41647000/0xafddb3c8f92821fd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477432.343835:0:12091:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d41647000/0xafddb3c8f92821fd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477432.343979:0:12091:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d41646a00/0xafddb3c8f9282204 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477432.343986:0:12091:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d41646a00/0xafddb3c8f9282204 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477432.343991:0:12091:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d41646a00/0xafddb3c8f9282204 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12091 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789477432.344011:0:12091:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:2.0:1789477432.344134:0:12091:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d41647a00/0xafddb3c8f92821f6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477432.344143:0:12091:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d41647a00/0xafddb3c8f92821f6 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 12091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477432.344151:0:12091:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d41647a00/0xafddb3c8f92821f6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477432.344159:0:12091:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d0d41647a00 already unused, calling callback (ffffffffc1fd54f0) 00010000:00010000:2.0:1789477432.344164:0:12091:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d41647a00/0xafddb3c8f92821f6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477432.344170:0:12091:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d41647a00/0xafddb3c8f92821f6 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 12091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477432.344182:0:12091:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9d0d44568d00) 00010000:00010000:2.0:1789477432.344184:0:12091:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789477432.344187:0:12091:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d41647a00/0xafddb3c8f92821f6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477432.344192:0:12091:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d41647a00/0xafddb3c8f92821f6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477432.344205:0:12091:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d41647000/0xafddb3c8f92821fd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477432.344209:0:12091:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d41647000/0xafddb3c8f92821fd lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477432.344220:0:12091:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d41647000/0xafddb3c8f92821fd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477432.344224:0:12091:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d0d41647000 already unused, calling callback (ffffffffc1fd54f0) 00010000:00010000:2.0:1789477432.344226:0:12091:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d41647000/0xafddb3c8f92821fd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477432.344229:0:12091:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d41647000/0xafddb3c8f92821fd lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477432.344234:0:12091:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9d0d50919800) 00010000:00010000:2.0:1789477432.344235:0:12091:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789477432.344237:0:12091:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d41647000/0xafddb3c8f92821fd lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477432.344240:0:12091:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d41647000/0xafddb3c8f92821fd lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477432.344278:0:12091:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d41647800/0xafddb3c8f92821ef lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2d28 expref: 56 pid: 12091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477432.344289:0:12091:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d41646a00/0xafddb3c8f9282204 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2d28 expref: 55 pid: 12091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477432.344302:0:12091:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9d0d48f9bf00) 00010000:00010000:2.0:1789477432.344304:0:12091:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789477432.344307:0:12091:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d0d41646a00, rc 0) 00000100:00100000:2.0:1789477432.344375:0:12091:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d74e8b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9bc33f26-0aab-4a14-832f-c58d566de1b0+55:11476:x1876402783725312:12345-192.168.201.23@tcp:101:lfs.0 Request processed in 842us (1117us total) trans 4294967454 rc 0/0 00000100:00100000:2.0:1789477432.344388:0:12091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 165 00000100:00100000:3.0:1789477432.347453:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:3.0:1789477432.348296:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:1.0:1789477432.348542:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783725568 00000100:00100000:1.0:1789477432.348556:0:6711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783725568 00000100:00100000:1.0:1789477432.348661:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 13 00000100:00100000:1.0:1789477432.348686:0:6711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d74e89c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9bc33f26-0aab-4a14-832f-c58d566de1b0+55:2354:x1876402783725568:12345-192.168.201.23@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789477432.348707:0:6711:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789477432.348739:0:6711:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d41646a00/0xafddb3c8f9282204 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2d28 expref: 55 pid: 12091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477432.348765:0:6711:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9d0d48f9bf00) 00010000:00010000:1.0:1789477432.348771:0:6711:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789477432.348850:0:6711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d74e89c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9bc33f26-0aab-4a14-832f-c58d566de1b0+54:2354:x1876402783725568:12345-192.168.201.23@tcp:103:ldlm_bl.0 Request processed in 167us (558us total) trans 0 rc 0/0 00000100:00100000:1.0:1789477432.348858:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 13 00000100:00100000:2.0:1789477432.349892:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783725440 00000100:00100000:2.0:1789477432.349906:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783725440 00000100:00100000:2.0:1789477432.349958:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 166 00000100:00100000:2.0:1789477432.349968:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d74e8aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9bc33f26-0aab-4a14-832f-c58d566de1b0+54:11476:x1876402783725440:12345-192.168.201.23@tcp:54:lfs.0 00010000:00010000:2.0:1789477432.350048:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d41647800/0xafddb3c8f9282212 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477432.350068:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d41647800/0xafddb3c8f9282212 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477432.350082:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d41647800/0xafddb3c8f9282212 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477432.350115:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d41647800/0xafddb3c8f9282212 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477432.350122:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d41647800/0xafddb3c8f9282212 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477432.350129:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d41647800/0xafddb3c8f9282212 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477432.350135:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d0d41647800 already unused, calling callback (ffffffffc1fd54f0) 00010000:00010000:2.0:1789477432.350139:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d41647800/0xafddb3c8f9282212 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477432.350147:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d41647800/0xafddb3c8f9282212 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477432.350157:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9d0d48f9bf00) 00010000:00010000:2.0:1789477432.350173:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789477432.350179:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d41647800/0xafddb3c8f9282212 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477432.350186:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d41647800/0xafddb3c8f9282212 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789477432.350251:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d74e8aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9bc33f26-0aab-4a14-832f-c58d566de1b0+54:11476:x1876402783725440:12345-192.168.201.23@tcp:54:lfs.0 Request processed in 285us (2813us total) trans 0 rc 0/0 00000100:00100000:2.0:1789477432.350260:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 166 00000100:00100000:0.0:1789477432.354642:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:2.0:1789477432.354724:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783725824 00000100:00100000:2.0:1789477432.354737:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783725824 00000100:00100000:2.0:1789477432.354817:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 47 00000100:00100000:2.0:1789477432.354828:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d75104a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9bc33f26-0aab-4a14-832f-c58d566de1b0+54:11476:x1876402783725824:12345-192.168.201.23@tcp:35:lfs.0 00000100:00100000:2.0:1789477432.355144:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d75104a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9bc33f26-0aab-4a14-832f-c58d566de1b0+55:11476:x1876402783725824:12345-192.168.201.23@tcp:35:lfs.0 Request processed in 315us (520us total) trans 4294967455 rc 0/0 00000100:00100000:2.0:1789477432.355152:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 47 00000100:00100000:3.0:1789477432.549364:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:0.0:1789477432.549802:0:6999:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783726080 00000100:00100000:0.0:1789477432.549817:0:6999:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783726080 00000100:00100000:0.0:1789477432.549898:0:6999:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 167 00000100:00100000:0.0:1789477432.549911:0:6999:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d74e8bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9bc33f26-0aab-4a14-832f-c58d566de1b0+55:11494:x1876402783726080:12345-192.168.201.23@tcp:101:cat.0 00010000:00010000:0.0:1789477432.549951:0:6999:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789477432.549980:0:6999:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be4800/0xafddb3c8f9282219 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa90d500d7b8f2d2f expref: -99 pid: 6999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477432.550124:0:6999:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be5200/0xafddb3c8f9282220 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477432.550144:0:6999:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be5200/0xafddb3c8f9282220 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477432.550177:0:6999:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be5200/0xafddb3c8f9282220 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789477432.550193:0:6999:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:0.0:1789477432.550362:0:6999:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be4800/0xafddb3c8f9282219 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2d2f expref: 58 pid: 6999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477432.550386:0:6999:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be5200/0xafddb3c8f9282220 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2d2f expref: 57 pid: 6999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477432.550396:0:6999:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9d0d48f9bf00) 00010000:00010000:0.0:1789477432.550400:0:6999:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1789477432.550404:0:6999:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d0d50be5200, rc 0) 00000100:00100000:0.0:1789477432.551005:0:6999:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d74e8bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9bc33f26-0aab-4a14-832f-c58d566de1b0+57:11494:x1876402783726080:12345-192.168.201.23@tcp:101:cat.0 Request processed in 1091us (1653us total) trans 4294967456 rc 0/0 00000100:00100000:0.0:1789477432.551016:0:6999:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 167 00000100:00100000:3.0:1789477432.596675:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:1.0:1789477432.596877:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783726208 00000100:00100000:1.0:1789477432.596891:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783726208 00000100:00100000:1.0:1789477432.596972:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 168 00000100:00100000:1.0:1789477432.596986:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d6d489c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9bc33f26-0aab-4a14-832f-c58d566de1b0+57:11495:x1876402783726208:12345-192.168.201.23@tcp:101:lfs.0 00010000:00010000:1.0:1789477432.597021:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789477432.597052:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f518000/0xafddb3c8f928222e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa90d500d7b8f2d36 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477432.597145:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f519800/0xafddb3c8f9282235 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477432.597163:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f519800/0xafddb3c8f9282235 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477432.597179:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f519800/0xafddb3c8f9282235 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789477432.597272:0:5846:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00000004:00200000:1.0:1789477432.597299:0:5846:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:1.0:1789477432.597333:0:5846:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f519800/0xafddb3c8f9282235 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477432.597368:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f518000/0xafddb3c8f928222e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2d36 expref: 59 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477432.597391:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f519800/0xafddb3c8f9282235 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2d36 expref: 58 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477432.597401:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9d0d44568d00) 00010000:00010000:1.0:1789477432.597404:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789477432.597409:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d0d7f519800, rc 0) 00000100:00100000:1.0:1789477432.597500:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d6d489c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9bc33f26-0aab-4a14-832f-c58d566de1b0+58:11495:x1876402783726208:12345-192.168.201.23@tcp:101:lfs.0 Request processed in 516us (840us total) trans 0 rc 0/0 00000100:00100000:1.0:1789477432.597508:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 168 00000100:00100000:1.0:1789477432.602926:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:2.0:1789477432.603037:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783726592 00000100:00100000:2.0:1789477432.603051:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783726592 00000100:00100000:2.0:1789477432.603146:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 48 00000100:00100000:2.0:1789477432.603159:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d7c3e5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9bc33f26-0aab-4a14-832f-c58d566de1b0+58:11495:x1876402783726592:12345-192.168.201.23@tcp:35:lfs.0 00000100:00100000:2.0:1789477432.603555:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d7c3e5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9bc33f26-0aab-4a14-832f-c58d566de1b0+59:11495:x1876402783726592:12345-192.168.201.23@tcp:35:lfs.0 Request processed in 396us (646us total) trans 4294967457 rc 0/0 00000100:00100000:2.0:1789477432.603566:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 48 00000100:00100000:0.0:1789477432.611993:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:1.0:1789477432.614522:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783726720 00000100:00100000:1.0:1789477432.614545:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783726720 00000100:00100000:1.0:1789477432.614692:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 14 00000100:00100000:1.0:1789477432.614705:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d50a82450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9bc33f26-0aab-4a14-832f-c58d566de1b0+59:11495:x1876402783726720:12345-192.168.201.23@tcp:103:lfs.0 00010000:00010000:1.0:1789477432.614730:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:1.0:1789477432.614764:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49ecbc00/0xafddb3c8f92821c5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2d1a expref: 59 pid: 12091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477432.614815:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be5200/0xafddb3c8f9282220 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2d2f expref: 58 pid: 6999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477432.614856:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f518c00/0xafddb3c8f92820d0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2cdb expref: 57 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477432.614869:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9d0d48f9bf00) 00010000:00010000:1.0:1789477432.614882:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789477432.614983:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d50a82450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9bc33f26-0aab-4a14-832f-c58d566de1b0+56:11495:x1876402783726720:12345-192.168.201.23@tcp:103:lfs.0 Request processed in 280us (3004us total) trans 0 rc 0/0 00000100:00100000:1.0:1789477432.614991:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 14 00000100:00100000:3.0:1789477432.619541:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:0.0:1789477432.619880:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783726848 00000100:00100000:0.0:1789477432.619895:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783726848 00000100:00100000:0.0:1789477432.619978:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 169 00000100:00100000:0.0:1789477432.619992:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d6d489500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9bc33f26-0aab-4a14-832f-c58d566de1b0+56:11495:x1876402783726848:12345-192.168.201.23@tcp:58:lfs.0 00010000:00010000:0.0:1789477432.621285:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be5e00/0xafddb3c8f928223c lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477432.621315:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be5e00/0xafddb3c8f928223c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477432.621330:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be5e00/0xafddb3c8f928223c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1789477432.622926:0:5845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].4, 136 off8736 00000100:00100000:0.0:1789477432.623827:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d6d489500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9bc33f26-0aab-4a14-832f-c58d566de1b0+56:11495:x1876402783726848:12345-192.168.201.23@tcp:58:lfs.0 Request processed in 3828us (4295us total) trans 0 rc 0/0 00000100:00100000:0.0:1789477432.623844:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 169 00000100:00100000:0.0:1789477432.641244:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:1.0:1789477432.642258:0:6999:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783726976 00000100:00100000:1.0:1789477432.642276:0:6999:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783726976 00000100:00100000:1.0:1789477432.642383:0:6999:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 170 00000100:00100000:1.0:1789477432.642396:0:6999:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d75105f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9bc33f26-0aab-4a14-832f-c58d566de1b0+56:11497:x1876402783726976:12345-192.168.201.23@tcp:101:lfs.0 00010000:00010000:1.0:1789477432.642425:0:6999:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789477432.642456:0:6999:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f518c00/0xafddb3c8f9282243 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa90d500d7b8f2d3d expref: -99 pid: 6999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477432.642569:0:6999:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f518000/0xafddb3c8f928224a lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477432.643100:0:6999:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f518000/0xafddb3c8f928224a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477432.643116:0:6999:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f518000/0xafddb3c8f928224a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477432.643138:0:6999:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f519200/0xafddb3c8f9282251 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477432.643173:0:6999:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f519200/0xafddb3c8f9282251 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477432.643181:0:6999:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f519200/0xafddb3c8f9282251 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477432.643337:0:6999:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f519400/0xafddb3c8f9282258 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477432.643347:0:6999:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f519400/0xafddb3c8f9282258 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477432.643354:0:6999:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f519400/0xafddb3c8f9282258 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789477432.643406:0:6999:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:1.0:1789477432.643412:0:6999:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1789477432.643438:0:6999:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f519400/0xafddb3c8f9282258 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477432.643451:0:6999:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f519400/0xafddb3c8f9282258 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477432.643461:0:6999:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f518000/0xafddb3c8f928224a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477432.643469:0:6999:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f518000/0xafddb3c8f928224a lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477432.643476:0:6999:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f518000/0xafddb3c8f928224a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477432.643494:0:6999:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d0d7f518000 already unused, calling callback (ffffffffc1fd54f0) 00010000:00010000:1.0:1789477432.643499:0:6999:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f518000/0xafddb3c8f928224a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477432.643509:0:6999:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f518000/0xafddb3c8f928224a lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477432.643525:0:6999:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9d0d44568d00) 00010000:00010000:1.0:1789477432.643529:0:6999:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789477432.643534:0:6999:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f518000/0xafddb3c8f928224a lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477432.643541:0:6999:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f518000/0xafddb3c8f928224a lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477432.644157:0:6999:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f519200/0xafddb3c8f9282251 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477432.644165:0:6999:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f519200/0xafddb3c8f9282251 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477432.644171:0:6999:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f519200/0xafddb3c8f9282251 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477432.644178:0:6999:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d0d7f519200 already unused, calling callback (ffffffffc1fd54f0) 00010000:00010000:1.0:1789477432.644181:0:6999:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f519200/0xafddb3c8f9282251 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477432.644188:0:6999:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f519200/0xafddb3c8f9282251 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477432.644214:0:6999:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9d0d48f9bf00) 00010000:00010000:1.0:1789477432.644217:0:6999:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789477432.644221:0:6999:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f519200/0xafddb3c8f9282251 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477432.644228:0:6999:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f519200/0xafddb3c8f9282251 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477432.648962:0:6999:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f518c00/0xafddb3c8f9282243 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2d3d expref: 58 pid: 6999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477432.649014:0:6999:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f519400/0xafddb3c8f9282258 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2d3d expref: 57 pid: 6999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477432.649027:0:6999:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9d0d596ae000) 00010000:00010000:1.0:1789477432.649030:0:6999:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789477432.649035:0:6999:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d0d7f519400, rc 0) 00000100:00100000:1.0:1789477432.649154:0:6999:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d75105f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9bc33f26-0aab-4a14-832f-c58d566de1b0+57:11497:x1876402783726976:12345-192.168.201.23@tcp:101:lfs.0 Request processed in 6758us (7923us total) trans 0 rc 0/0 00000100:00100000:1.0:1789477432.649166:0:6999:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 170 00000004:00080000:0.0:1789477432.751917:0:6717:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 377823334372ns, next at 378823331039ns, rc = 0 00000100:00100000:2.0:1789477432.751999:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d75107b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1876402802599168:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789477432.752102:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789477432.752300:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802599168 00000100:00100000:0.0:1789477432.752310:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802599168 00000100:00100000:0.0:1789477432.752393:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1789477432.752405:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d623c9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3312:x1876402802599168:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789477432.752455:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 1703936 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789477432.752526:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d623c9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3312:x1876402802599168:12345-0@lo:13:osp-pre-0-0.0 Request processed in 123us (423us total) trans 0 rc 0/0 00000100:00100000:0.0:1789477432.752534:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1789477432.752844:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d75107b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1876402802599168:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1789477432.753366:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1789477433.009139:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1789477433.010929:0:11717:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1789477433.010941:0:11717:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1789477433.010987:0:11717:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:0.0:1789477433.010994:0:11717:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1789477433.011752:0:11717:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d75106300 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11717:1876402802599296:192.168.201.23@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1789477433.011935:0:11717:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d0d754530c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789477433.032162:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:3.0:1789477433.032250:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783727104 00000100:00100000:3.0:1789477433.032263:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783727104 00000100:00100000:3.0:1789477433.032354:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 171 00000100:00100000:3.0:1789477433.032367:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d7c3e7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9bc33f26-0aab-4a14-832f-c58d566de1b0+58:11508:x1876402783727104:12345-192.168.201.23@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1789477433.032442:0:5844:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1789477433.032607:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d7c3e7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9bc33f26-0aab-4a14-832f-c58d566de1b0+58:11508:x1876402783727104:12345-192.168.201.23@tcp:53:lhsmtool_posix.0 Request processed in 242us (460us total) trans 0 rc 0/0 00000100:00100000:3.0:1789477433.032616:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 171 00000100:00080000:1.0:1789477433.033953:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789477433.037482:0:11717:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d75106300 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11717:1876402802599296:192.168.201.23@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1789477433.040415:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:1.0:1789477433.040520:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783727232 00000100:00100000:1.0:1789477433.040535:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783727232 00000100:00100000:1.0:1789477433.040651:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 172 00000100:00100000:1.0:1789477433.040665:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d6d488a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9bc33f26-0aab-4a14-832f-c58d566de1b0+57:11508:x1876402783727232:12345-192.168.201.23@tcp:34:lhsmtool_posix.0 00010000:00010000:1.0:1789477433.040763:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f519200/0xafddb3c8f928225f lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477433.040812:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f519200/0xafddb3c8f928225f lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477433.040826:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f519200/0xafddb3c8f928225f lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477433.040846:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f518000/0xafddb3c8f9282266 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477433.040854:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f518000/0xafddb3c8f9282266 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477433.040860:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f518000/0xafddb3c8f9282266 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477433.040893:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f518400/0xafddb3c8f928226d lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477433.040902:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f518400/0xafddb3c8f928226d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477433.040908:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f518400/0xafddb3c8f928226d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789477433.040957:0:5845:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:1.0:1789477433.040961:0:5845:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1789477433.040975:0:5845:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f518400/0xafddb3c8f928226d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477433.041002:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f519200/0xafddb3c8f928225f lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477433.041019:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f519200/0xafddb3c8f928225f lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477433.041026:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f519200/0xafddb3c8f928225f lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477433.041033:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d0d7f519200 already unused, calling callback (ffffffffc1fd54f0) 00010000:00010000:1.0:1789477433.041038:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f519200/0xafddb3c8f928225f lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477433.041045:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f519200/0xafddb3c8f928225f lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477433.041059:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9d0d48f9be00) 00010000:00010000:1.0:1789477433.041062:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789477433.041068:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f519200/0xafddb3c8f928225f lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477433.041075:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f519200/0xafddb3c8f928225f lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477433.041090:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f518000/0xafddb3c8f9282266 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477433.041096:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f518000/0xafddb3c8f9282266 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477433.041102:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f518000/0xafddb3c8f9282266 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477433.041108:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d0d7f518000 already unused, calling callback (ffffffffc1fd54f0) 00010000:00010000:1.0:1789477433.041116:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f518000/0xafddb3c8f9282266 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477433.041122:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f518000/0xafddb3c8f9282266 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477433.041130:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x19697575 (ffff9d0d48f9bf00) 00010000:00010000:1.0:1789477433.041132:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789477433.041135:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f518000/0xafddb3c8f9282266 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477433.041140:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f518000/0xafddb3c8f9282266 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477433.041157:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f518400/0xafddb3c8f928226d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477433.041161:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f518400/0xafddb3c8f928226d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477433.041167:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f518400/0xafddb3c8f928226d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477433.041172:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d0d7f518400 already unused, calling callback (ffffffffc1fd54f0) 00010000:00010000:1.0:1789477433.041175:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f518400/0xafddb3c8f928226d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477433.041182:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f518400/0xafddb3c8f928226d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477433.041187:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9d0d596ae000) 00010000:00010000:1.0:1789477433.041189:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789477433.041197:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f518400/0xafddb3c8f928226d lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477433.041203:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f518400/0xafddb3c8f928226d lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789477433.041290:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d6d488a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9bc33f26-0aab-4a14-832f-c58d566de1b0+57:11508:x1876402783727232:12345-192.168.201.23@tcp:34:lhsmtool_posix.0 Request processed in 628us (889us total) trans 0 rc 0/0 00000100:00100000:1.0:1789477433.041298:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 172 00000100:00100000:3.0:1789477433.049255:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:1.0:1789477433.049929:0:6999:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783727488 00000100:00100000:1.0:1789477433.049947:0:6999:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783727488 00000100:00100000:1.0:1789477433.050149:0:6999:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 173 00000100:00100000:1.0:1789477433.050163:0:6999:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d6d48aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9bc33f26-0aab-4a14-832f-c58d566de1b0+57:11508:x1876402783727488:12345-192.168.201.23@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789477433.050195:0:6999:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789477433.050226:0:6999:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f518c00/0xafddb3c8f9282274 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa90d500d7b8f2d44 expref: -99 pid: 6999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477433.050372:0:6999:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f518600/0xafddb3c8f928227b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477433.050394:0:6999:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f518600/0xafddb3c8f928227b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477433.050411:0:6999:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f518600/0xafddb3c8f928227b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789477433.050425:0:6999:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:1.0:1789477433.050560:0:6999:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f518600/0xafddb3c8f928227b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477433.050570:0:6999:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f518600/0xafddb3c8f928227b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477433.051174:0:6999:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f518600/0xafddb3c8f928227b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477433.051182:0:6999:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d0d7f518600 already unused, calling callback (ffffffffc1fd54f0) 00010000:00010000:1.0:1789477433.051188:0:6999:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f518600/0xafddb3c8f928227b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477433.051198:0:6999:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f518600/0xafddb3c8f928227b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477433.051215:0:6999:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9d0d596ae000) 00010000:00010000:1.0:1789477433.051218:0:6999:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789477433.051224:0:6999:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f518600/0xafddb3c8f928227b lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477433.051231:0:6999:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f518600/0xafddb3c8f928227b lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477433.051296:0:6999:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f518c00/0xafddb3c8f9282274 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2d44 expref: 59 pid: 6999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477433.051308:0:6999:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9d0d48f9be00) 00010000:00010000:1.0:1789477433.051311:0:6999:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1789477433.051316:0:6999:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f518c00/0xafddb3c8f9282274 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2d44 expref: 59 pid: 6999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477433.051327:0:6999:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d0d7f518c00, rc 0) 00000100:00100000:1.0:1789477433.051415:0:6999:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d6d48aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9bc33f26-0aab-4a14-832f-c58d566de1b0+58:11508:x1876402783727488:12345-192.168.201.23@tcp:101:lhsmtool_posix.0 Request processed in 1255us (2176us total) trans 4294967458 rc 301/301 00000100:00100000:1.0:1789477433.051435:0:6999:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 173 00000100:00100000:3.0:1789477433.054403:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:2.0:1789477433.054505:0:12091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783727616 00000100:00100000:2.0:1789477433.054520:0:12091:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783727616 00000100:00100000:2.0:1789477433.054629:0:12091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 174 00000100:00100000:2.0:1789477433.054727:0:12091:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d6d489f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9bc33f26-0aab-4a14-832f-c58d566de1b0+58:11508:x1876402783727616:12345-192.168.201.23@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1789477433.054790:0:12091:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1789477433.054944:0:12091:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d6d489f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9bc33f26-0aab-4a14-832f-c58d566de1b0+58:11508:x1876402783727616:12345-192.168.201.23@tcp:53:lhsmtool_posix.0 Request processed in 302us (555us total) trans 0 rc 0/0 00000100:00100000:0.0:1789477433.058756:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:0.0:1789477433.058819:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783727872 00000100:00100000:0.0:1789477433.058833:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783727872 00000100:00100000:0.0:1789477433.058902:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 175 00000100:00100000:0.0:1789477433.058917:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d75105500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9bc33f26-0aab-4a14-832f-c58d566de1b0+59:11508:x1876402783727872:12345-192.168.201.23@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789477433.058960:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789477433.058964:0:5846:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1789477433.059002:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f519800/0xafddb3c8f9282235 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2d36 expref: 59 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477433.059023:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9d0d44568d00) 00010000:00010000:0.0:1789477433.059028:0:5846:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789477433.059047:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be4c00/0xafddb3c8f9282289 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa90d500d7b8f2d4b expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1789477433.059725:0:5846:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x5:0x0], index 1: 0 00010000:00010000:0.0:1789477433.060038:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be5200/0xafddb3c8f9282290 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477433.060056:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be5200/0xafddb3c8f9282290 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477433.060069:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be5200/0xafddb3c8f9282290 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477433.060141:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be4c00/0xafddb3c8f9282289 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2d4b expref: 61 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477433.060160:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be5200/0xafddb3c8f9282290 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2d4b expref: 60 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477433.060170:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9d0d596aed00) 00010000:00010000:0.0:1789477433.060174:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789477433.060184:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d0d50be5200, rc 0) 00000100:00100000:0.0:1789477433.060267:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d75105500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9bc33f26-0aab-4a14-832f-c58d566de1b0+60:11508:x1876402783727872:12345-192.168.201.23@tcp:101:lhsmtool_posix.0 Request processed in 1355us (1526us total) trans 4294967459 rc 0/0 00000100:00100000:0.0:1789477433.060277:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 175 00000100:00100000:0.0:1789477433.063689:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:3.0:1789477433.063824:0:6999:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783728128 00000100:00100000:3.0:1789477433.063838:0:6999:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783728128 00000100:00100000:3.0:1789477433.063914:0:6999:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 176 00000100:00100000:3.0:1789477433.063927:0:6999:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d75106d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9bc33f26-0aab-4a14-832f-c58d566de1b0+60:11508:x1876402783728128:12345-192.168.201.23@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1789477433.064007:0:6999:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789477433.064043:0:6999:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be5200/0xafddb3c8f9282290 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2d4b expref: 60 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477433.064064:0:6999:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9d0d596aed00) 00010000:00010000:3.0:1789477433.064077:0:6999:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789477433.064221:0:6999:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49eca000/0xafddb3c8f928229e lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477433.064238:0:6999:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49eca000/0xafddb3c8f928229e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477433.064250:0:6999:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49eca000/0xafddb3c8f928229e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477433.064265:0:6999:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49eca600/0xafddb3c8f92822a5 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x9a5a888a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477433.064338:0:6999:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49eca600/0xafddb3c8f92822a5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x9a5a888a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477433.064346:0:6999:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49eca600/0xafddb3c8f92822a5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x9a5a888a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477433.064448:0:6999:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49eca000/0xafddb3c8f928229e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477433.064456:0:6999:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49eca000/0xafddb3c8f928229e lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477433.064462:0:6999:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49eca000/0xafddb3c8f928229e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477433.064469:0:6999:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d0d49eca000 already unused, calling callback (ffffffffc1fd54f0) 00010000:00010000:3.0:1789477433.064473:0:6999:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49eca000/0xafddb3c8f928229e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477433.064481:0:6999:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49eca000/0xafddb3c8f928229e lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477433.064566:0:6999:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9d0d44568d00) 00010000:00010000:3.0:1789477433.064569:0:6999:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789477433.064573:0:6999:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49eca000/0xafddb3c8f928229e lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477433.064659:0:6999:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49eca000/0xafddb3c8f928229e lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477433.064677:0:6999:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49eca600/0xafddb3c8f92822a5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x9a5a888a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477433.064683:0:6999:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49eca600/0xafddb3c8f92822a5 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x9a5a888a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477433.064688:0:6999:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49eca600/0xafddb3c8f92822a5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x9a5a888a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477433.064693:0:6999:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d0d49eca600 already unused, calling callback (ffffffffc1fd54f0) 00010000:00010000:3.0:1789477433.064696:0:6999:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49eca600/0xafddb3c8f92822a5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x9a5a888a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477433.064703:0:6999:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49eca600/0xafddb3c8f92822a5 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x9a5a888a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477433.064711:0:6999:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x9a5a888a (ffff9d0d44568400) 00010000:00010000:3.0:1789477433.064714:0:6999:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789477433.064717:0:6999:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49eca600/0xafddb3c8f92822a5 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x9a5a888a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477433.064723:0:6999:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49eca600/0xafddb3c8f92822a5 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x9a5a888a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789477433.064863:0:6999:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d75106d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9bc33f26-0aab-4a14-832f-c58d566de1b0+59:11508:x1876402783728128:12345-192.168.201.23@tcp:36:lhsmtool_posix.0 Request processed in 936us (1187us total) trans 0 rc -2/-2 00000100:00100000:3.0:1789477433.064871:0:6999:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 176 00000100:00100000:2.0:1789477433.067231:0:12091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 174 00000100:00100000:0.0:1789477433.068385:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:2.0:1789477433.068631:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783728256 00000100:00100000:2.0:1789477433.068645:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783728256 00000100:00100000:2.0:1789477433.068717:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 177 00000100:00100000:2.0:1789477433.068730:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d75104e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9bc33f26-0aab-4a14-832f-c58d566de1b0+58:11508:x1876402783728256:12345-192.168.201.23@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789477433.068761:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789477433.068804:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d41647000/0xafddb3c8f92822ac lrc: 2/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa90d500d7b8f2d52 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477433.068852:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d41647800/0xafddb3c8f92822b3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477433.068868:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d41647800/0xafddb3c8f92822b3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477433.068884:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d41647800/0xafddb3c8f92822b3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477433.069028:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d41647000/0xafddb3c8f92822ac lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2d52 expref: 60 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477433.069057:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d41647800/0xafddb3c8f92822b3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2d52 expref: 59 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477433.069068:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9d0d50919800) 00010000:00010000:2.0:1789477433.069072:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1789477433.069077:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d0d41647800, rc 0) 00000100:00100000:2.0:1789477433.069160:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d75104e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9bc33f26-0aab-4a14-832f-c58d566de1b0+59:11508:x1876402783728256:12345-192.168.201.23@tcp:101:lhsmtool_posix.0 Request processed in 432us (782us total) trans 0 rc 0/0 00000100:00100000:2.0:1789477433.069168:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 177 00000100:00100000:0.0:1789477433.075758:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:3.0:1789477433.075938:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783728512 00000100:00100000:3.0:1789477433.075953:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783728512 00000100:00100000:3.0:1789477433.076030:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 178 00000100:00100000:3.0:1789477433.076042:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d75105180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9bc33f26-0aab-4a14-832f-c58d566de1b0+59:11508:x1876402783728512:12345-192.168.201.23@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1789477433.076179:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49ecba00/0xafddb3c8f92822ba lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477433.076204:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49ecba00/0xafddb3c8f92822ba lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477433.076219:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49ecba00/0xafddb3c8f92822ba lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1789477433.076701:0:5845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].6, 88 off8648 00000004:00080000:3.0:1789477433.076717:0:5845:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 378148138342ns, next at 379148134203ns, rc = 0 00000004:00010000:3.0:1789477433.076856:0:5845:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000868f6579 reply state 00000000f69b7e80 transno 4294967460 ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49ecba00/0xafddb3c8f92822ba lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789477433.076867:0:5845:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789477433.077007:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d75105180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9bc33f26-0aab-4a14-832f-c58d566de1b0+61:11508:x1876402783728512:12345-192.168.201.23@tcp:36:lhsmtool_posix.0 Request processed in 965us (1259us total) trans 4294967460 rc 0/0 00000100:00100000:3.0:1789477433.077017:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 178 00010000:00010000:3.0:1789477433.078869:0:3296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49ecba00/0xafddb3c8f92822ba lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477433.078904:0:3296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49ecba00/0xafddb3c8f92822ba lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477433.078913:0:3296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49ecba00/0xafddb3c8f92822ba lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477433.078920:0:3296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d0d49ecba00 already unused, calling callback (ffffffffc1fd54f0) 00010000:00010000:3.0:1789477433.078925:0:3296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49ecba00/0xafddb3c8f92822ba lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477433.078933:0:3296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49ecba00/0xafddb3c8f92822ba lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477433.078956:0:3296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9d0d50919800) 00010000:00010000:3.0:1789477433.078960:0:3296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1789477433.078966:0:3296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49ecba00/0xafddb3c8f92822ba lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477433.078972:0:3296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49ecba00/0xafddb3c8f92822ba lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789477433.081155:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:3.0:1789477433.081287:0:12091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783728640 00000100:00100000:3.0:1789477433.081302:0:12091:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783728640 00000100:00100000:3.0:1789477433.081379:0:12091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 179 00000100:00100000:3.0:1789477433.081392:0:12091:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d75106680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9bc33f26-0aab-4a14-832f-c58d566de1b0+60:11508:x1876402783728640:12345-192.168.201.23@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789477433.081427:0:12091:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789477433.081458:0:12091:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49ecbc00/0xafddb3c8f92822c1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa90d500d7b8f2d59 expref: -99 pid: 12091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477433.081544:0:12091:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49ecbc00/0xafddb3c8f92822c1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2d59 expref: 61 pid: 12091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477433.081573:0:12091:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49ecbc00/0xafddb3c8f92822c1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2d59 expref: 61 pid: 12091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477433.081619:0:12091:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9d0d50919800) 00010000:00010000:3.0:1789477433.081623:0:12091:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789477433.081627:0:12091:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d0d49ecbc00, rc 0) 00000100:00100000:3.0:1789477433.081709:0:12091:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d75106680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9bc33f26-0aab-4a14-832f-c58d566de1b0+61:11508:x1876402783728640:12345-192.168.201.23@tcp:101:lhsmtool_posix.0 Request processed in 319us (563us total) trans 0 rc 0/0 00000100:00100000:3.0:1789477433.081717:0:12091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 179 00000100:00100000:3.0:1789477433.083897:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:2.0:1789477433.085890:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783728768 00000100:00100000:2.0:1789477433.085912:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783728768 00000100:00100000:2.0:1789477433.086038:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 51 00000100:00100000:2.0:1789477433.086053:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d7f544a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9bc33f26-0aab-4a14-832f-c58d566de1b0+6:2354:x1876402783728768:12345-192.168.201.23@tcp:2:lhsmtool_posix.0 00000100:00080000:3.0:1789477433.086167:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789477433.089441:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d7f544a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9bc33f26-0aab-4a14-832f-c58d566de1b0+7:2354:x1876402783728768:12345-192.168.201.23@tcp:2:lhsmtool_posix.0 Request processed in 3375us (5541us total) trans 4294967313 rc 0/0 00000100:00100000:3.0:1789477433.089457:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 51 00000100:00100000:1.0:1789477433.108938:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:0.0:1789477433.109131:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783729024 00000100:00100000:0.0:1789477433.109147:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783729024 00000100:00100000:0.0:1789477433.109230:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 49 00000100:00100000:0.0:1789477433.109243:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d7c3e4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9bc33f26-0aab-4a14-832f-c58d566de1b0+61:11508:x1876402783729024:12345-192.168.201.23@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1789477433.109604:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d7c3e4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9bc33f26-0aab-4a14-832f-c58d566de1b0+62:11508:x1876402783729024:12345-192.168.201.23@tcp:35:lhsmtool_posix.0 Request processed in 361us (682us total) trans 4294967461 rc 0/0 00000100:00100000:0.0:1789477433.109613:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 49 00000100:00100000:1.0:1789477433.118932:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:0.0:1789477433.119213:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783729280 00000100:00100000:0.0:1789477433.119226:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783729280 00000100:00100000:0.0:1789477433.119324:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 180 00000100:00100000:0.0:1789477433.119340:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d7c3e7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9bc33f26-0aab-4a14-832f-c58d566de1b0+62:11508:x1876402783729280:12345-192.168.201.23@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1789477433.119505:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d7c3e7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9bc33f26-0aab-4a14-832f-c58d566de1b0+62:11508:x1876402783729280:12345-192.168.201.23@tcp:57:lhsmtool_posix.0 Request processed in 168us (583us total) trans 0 rc 0/0 00000100:00100000:0.0:1789477433.119515:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 180 00000100:00100000:1.0:1789477433.126564:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:3.0:1789477433.129235:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783729408 00000100:00100000:3.0:1789477433.129253:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783729408 00000100:00100000:0.0:1789477433.133514:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 181 00000100:00100000:0.0:1789477433.133742:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d7c3e6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9bc33f26-0aab-4a14-832f-c58d566de1b0+62:11508:x1876402783729408:12345-192.168.201.23@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789477433.133783:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789477433.133826:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be5600/0xafddb3c8f92822c8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa90d500d7b8f2d60 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477433.133928:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be5000/0xafddb3c8f92822cf lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477433.133946:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be5000/0xafddb3c8f92822cf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477433.133962:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be5000/0xafddb3c8f92822cf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789477433.134027:0:5845:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1789477433.134049:0:5845:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be5000/0xafddb3c8f92822cf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477433.134081:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be5600/0xafddb3c8f92822c8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2d60 expref: 64 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477433.134098:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be5000/0xafddb3c8f92822cf lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2d60 expref: 63 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477433.134108:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9d0d50919800) 00010000:00010000:0.0:1789477433.134112:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1789477433.134117:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d0d50be5000, rc 0) 00000100:00100000:0.0:1789477433.134218:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d7c3e6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9bc33f26-0aab-4a14-832f-c58d566de1b0+63:11508:x1876402783729408:12345-192.168.201.23@tcp:101:lhsmtool_posix.0 Request processed in 483us (7674us total) trans 0 rc 0/0 00000100:00100000:3.0:1789477433.136488:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:1.0:1789477433.138311:0:8241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783729536 00000100:00100000:1.0:1789477433.138329:0:8241:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783729536 00000100:00100000:1.0:1789477433.138417:0:8241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 52 00000100:00100000:1.0:1789477433.138429:0:8241:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d7f547480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9bc33f26-0aab-4a14-832f-c58d566de1b0+7:2355:x1876402783729536:12345-192.168.201.23@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789477433.138452:0:8241:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789477433.138477:0:8241:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b71a00a7/0xafddb3c8f92822d6 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa90d500d7b8f2d67 expref: -99 pid: 8241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789477433.138510:0:8241:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6aa94238, blocks: 0x1 00010000:00010000:1.0:1789477433.138614:0:8241:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=378s v=(0 0) 00010000:00010000:1.0:1789477433.138620:0:8241:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789477433.138633:0:8241:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b71a00a7/0xafddb3c8f92822d6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2d67 expref: 8 pid: 8241 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477433.138654:0:8241:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000b71a00a7/0xafddb3c8f92822d6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2d67 expref: 8 pid: 8241 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477433.138671:0:8241:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d0d7f518600, rc 0) 00000100:00100000:1.0:1789477433.138748:0:8241:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d7f547480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9bc33f26-0aab-4a14-832f-c58d566de1b0+8:2355:x1876402783729536:12345-192.168.201.23@tcp:101:lhsmtool_posix.0 Request processed in 322us (2272us total) trans 0 rc 0/0 00000100:00100000:1.0:1789477433.138756:0:8241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 52 00000100:00100000:0.0:1789477433.140318:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 181 00000100:00100000:3.0:1789477433.141509:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:0.0:1789477433.144979:0:12091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783729792 00000100:00100000:0.0:1789477433.144995:0:12091:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783729792 00000100:00100000:0.0:1789477433.145083:0:12091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 182 00000100:00100000:0.0:1789477433.145096:0:12091:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d7f545f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9bc33f26-0aab-4a14-832f-c58d566de1b0+63:11508:x1876402783729792:12345-192.168.201.23@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1789477433.145255:0:12091:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d7f545f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9bc33f26-0aab-4a14-832f-c58d566de1b0+63:11508:x1876402783729792:12345-192.168.201.23@tcp:57:lhsmtool_posix.0 Request processed in 161us (3752us total) trans 0 rc 0/0 00000100:00100000:0.0:1789477433.145264:0:12091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 182 00000100:00100000:0.0:1789477433.159851:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:3.0:1789477433.160186:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783729920 00000100:00100000:3.0:1789477433.160200:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783729920 00000100:00100000:3.0:1789477433.160284:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 53 00000100:00100000:3.0:1789477433.160297:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d75107100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9bc33f26-0aab-4a14-832f-c58d566de1b0+8:11508:x1876402783729920:12345-192.168.201.23@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789477433.160323:0:6694:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789477433.160348:0:6694:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009a42fe57/0xafddb3c8f92822dd lrc: 2/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa90d500d7b8f2d6e expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477433.160407:0:6694:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000b71a00a7/0xafddb3c8f92822d6 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2d67 expref: 9 pid: 8241 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477433.160418:0:6694:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789477433.160423:0:6694:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789477433.160430:0:6694:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009a42fe57/0xafddb3c8f92822dd lrc: 4/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2d6e expref: 9 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477433.160475:0:6694:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000b71a00a7/0xafddb3c8f92822d6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2d67 expref: 9 pid: 8241 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477433.160492:0:6694:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000b71a00a7/0xafddb3c8f92822d6 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2d67 expref: 9 pid: 8241 timeout: 478 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789477433.160508:0:6694:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d7f700000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6694:1876402802599424:192.168.201.23@tcp:104: 00000100:00100000:3.0:1789477433.160651:0:6694:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d0d7c569b40 going to sleep for 11 seconds 00000100:00100000:2.0:1789477433.174847:0:6694:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d7f700000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6694:1876402802599424:192.168.201.23@tcp:104: 00010000:00010000:2.0:1789477433.174903:0:6694:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000009a42fe57/0xafddb3c8f92822dd lrc: 3/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2d6e expref: 9 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477433.174932:0:6694:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d0d49ecba00, rc 0) 00000100:00100000:2.0:1789477433.175025:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d75107100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9bc33f26-0aab-4a14-832f-c58d566de1b0+9:11508:x1876402783729920:12345-192.168.201.23@tcp:101:lhsmtool_posix.0 Request processed in 14729us (15187us total) trans 0 rc 0/0 00000100:00100000:2.0:1789477433.175036:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 53 00000100:00100000:3.0:1789477433.183257:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:0.0:1789477433.183455:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783730048 00000100:00100000:0.0:1789477433.183469:0:6711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783730048 00010000:00010000:0.0:1789477433.183544:0:6711:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000b71a00a7/0xafddb3c8f92822d6 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2d67 expref: 9 pid: 8241 timeout: 478 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789477433.183622:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 69 00000100:00100000:0.0:1789477433.183635:0:6711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d7f701880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9bc33f26-0aab-4a14-832f-c58d566de1b0+9:2354:x1876402783730048:12345-192.168.201.23@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789477433.183656:0:6711:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789477433.183688:0:6711:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000b71a00a7/0xafddb3c8f92822d6 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2d67 expref: 9 pid: 8241 timeout: 478 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477433.183704:0:6711:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000b71a00a7/0xafddb3c8f92822d6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2d67 expref: 9 pid: 8241 timeout: 478 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477433.183733:0:6711:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b71a00a7/0xafddb3c8f92822d6 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2d67 expref: 9 pid: 8241 timeout: 478 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477433.183755:0:6711:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789477433.183760:0:6711:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789477433.183781:0:6711:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000009a42fe57/0xafddb3c8f92822dd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2d6e expref: 8 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477433.183811:0:6711:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009a42fe57/0xafddb3c8f92822dd lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2d6e expref: 8 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477433.183869:0:6711:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000009a42fe57/0xafddb3c8f92822dd lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2d6e expref: 8 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789477433.183887:0:6711:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d75105c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:6711:1876402802599552:192.168.201.23@tcp:105: 00000100:00100000:0.0:1789477433.184004:0:6711:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d0d46cd8f00 going to sleep for 11 seconds 00000100:00100000:2.0:1789477433.192715:0:6711:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d75105c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:6711:1876402802599552:192.168.201.23@tcp:105: 00010000:00010000:2.0:1789477433.192754:0:6711:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789477433.192861:0:6711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d7f701880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9bc33f26-0aab-4a14-832f-c58d566de1b0+8:2354:x1876402783730048:12345-192.168.201.23@tcp:103:ldlm_bl.0 Request processed in 9227us (9620us total) trans 0 rc 0/0 00000100:00100000:2.0:1789477433.192875:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 69 00000100:00100000:3.0:1789477433.197957:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:2.0:1789477433.198047:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783730176 00000100:00100000:2.0:1789477433.198061:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783730176 00002000:00100000:2.0:1789477433.198142:0:6700:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x5:0x0] (0->8) req@ffff9d0d7f703800 x1876402783730176/t0(0) o4->9bc33f26-0aab-4a14-832f-c58d566de1b0@192.168.201.23@tcp:604/0 lens 504/0 e 0 to 0 dl 1789477444 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789477433.198156:0:6700:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9d0d7f703800 with x1876402783730176 ext(0->8) 00002000:00010000:2.0:1789477433.198164:0:6700:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9d0d7f703800 00000100:00100000:2.0:1789477433.198214:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 4 00000100:00100000:2.0:1789477433.198228:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d7f703800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:9bc33f26-0aab-4a14-832f-c58d566de1b0+8:2355:x1876402783730176:12345-192.168.201.23@tcp:4:lhsmtool_posix.0 00000100:00100000:2.0:1789477433.199159:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d7f703800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:9bc33f26-0aab-4a14-832f-c58d566de1b0+10:2355:x1876402783730176:12345-192.168.201.23@tcp:4:lhsmtool_posix.0 Request processed in 925us (1210us total) trans 4294967314 rc 0/0 00000100:00100000:2.0:1789477433.199172:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 4 00002000:00100000:2.0:1789477433.199183:0:6700:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x5:0x0] (0->8) req@ffff9d0d7f703800 x1876402783730176/t4294967314(0) o4->9bc33f26-0aab-4a14-832f-c58d566de1b0@192.168.201.23@tcp:604/0 lens 504/448 e 0 to 0 dl 1789477444 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789477433.199192:0:6700:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9d0d7f703800 with x1876402783730176 ext(0->8) 00002000:00010000:2.0:1789477433.199196:0:6700:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9d0d7f703800 00000100:00100000:3.0:1789477433.216038:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:1.0:1789477433.218662:0:6999:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783730304 00000100:00100000:1.0:1789477433.218685:0:6999:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783730304 00000100:00100000:1.0:1789477433.218802:0:6999:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 183 00000100:00100000:1.0:1789477433.218816:0:6999:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d7f701180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9bc33f26-0aab-4a14-832f-c58d566de1b0+63:11508:x1876402783730304:12345-192.168.201.23@tcp:44:lhsmtool_posix.0 00000001:00080000:1.0:1789477433.327774:0:6730:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967306 is committed 00000001:00080000:1.0:1789477433.327797:0:6730:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967305 is committed 00000001:00080000:2.0:1789477433.370893:0:5868:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967461 is committed 00000004:00080000:2.0:1789477433.370918:0:5868:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 5 committed 00000004:00080000:2.0:1789477433.371043:0:5868:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 4 committed 00000004:00080000:2.0:1789477433.371069:0:5868:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 7 committed 00000020:00080000:2.0:1789477433.371096:0:5868:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9d0d470ed780 refcount 2 committed 0 result 0 batchid 5 00000020:00080000:2.0:1789477433.371102:0:5868:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9d0d50b48e00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9d0d470ed900 00000020:00080000:2.0:1789477433.371107:0:5868:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9d0d50b48b00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9d0d7c3f8400 00000100:00100000:1.0:1789477433.371151:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d7f73b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1876402802599680:0@lo:6:osp-syn-0-0.0 00000020:00080000:2.0:1789477433.371234:0:5879:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 5 committed batchid 4 00000100:00100000:1.0:1789477433.371249:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789477433.371356:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802599680 00000100:00100000:1.0:1789477433.371367:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802599680 00000100:00100000:1.0:1789477433.371432:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1789477433.371444:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d50b05c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3313:x1876402802599680:12345-0@lo:6:osp-syn-0-0.0 00000020:00080000:2.0:1789477433.371467:0:5879:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00002000:00080000:1.0:1789477433.371480:0:6696:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:4 count 1 00000100:00100000:2.0:1789477433.371481:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d623cad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1876402802599808:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1789477433.371522:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789477433.371560:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802599808 00000100:00100000:2.0:1789477433.371564:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802599808 00000100:00100000:2.0:1789477433.371633:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1789477433.371640:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d753e3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3310:x1876402802599808:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1789477433.371686:0:6696:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 13, mtime: 0x6aa94235, atime: 0x6aa94235, ctime: 0x6aa94235, blocks: 0xb 00010000:00010000:1.0:1789477433.371698:0:6696:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000069b4af8a/0xafddb3c8f92822e4 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477433.371718:0:6696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=378s v=(0 0) 00010000:00010000:1.0:1789477433.371724:0:6696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789477433.371732:0:6696:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000069b4af8a/0xafddb3c8f92822e4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477433.371754:0:6696:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000069b4af8a/0xafddb3c8f92822e4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477433.371775:0:6696:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000069b4af8a/0xafddb3c8f92822e4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789477433.371798:0:6697:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb size from disk: 0 -> 9 00010000:00010000:1.0:1789477433.371798:0:6696:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000069b4af8a/0xafddb3c8f92822e4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789477433.371804:0:6697:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb mtime from disk: 0 -> 1789477432 00002000:00010000:2.0:1789477433.371811:0:6697:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1789477433.371814:0:6697:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb ctime from disk: 1789477432 -> 1789477432 00002000:00010000:2.0:1789477433.371817:0:6697:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb blocks from disk: 1 -> 1 00010000:00010000:1.0:1789477433.371828:0:6696:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1789477433.371867:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d753e3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3310:x1876402802599808:12345-0@lo:2:osp-syn-1-0.0 Request processed in 226us (342us total) trans 4294967315 rc 0/0 00000100:00100000:2.0:1789477433.371876:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000004:00080000:2.0:1789477433.371936:0:3310:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9d0d623cad80/2, rc 0, transno 4294967315 00000100:00100000:2.0:1789477433.371943:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d623cad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1876402802599808:0@lo:2:osp-syn-1-0.0 00010000:00010000:0.0:1789477433.372311:0:6710:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789477433.372321:0:6710:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000069b4af8a/0xafddb3c8f92822e4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477433.372332:0:6710:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d0d7f518800 already unused, calling callback (ffffffffc15972a0) 00010000:00010000:0.0:1789477433.372338:0:6710:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000069b4af8a/0xafddb3c8f92822e4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477433.372348:0:6710:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000069b4af8a/0xafddb3c8f92822e4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477433.372371:0:6710:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000069b4af8a/0xafddb3c8f92822e4 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477433.372378:0:6710:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000069b4af8a/0xafddb3c8f92822e4 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477433.372420:0:6710:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789477433.372423:0:6710:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789477433.372426:0:6710:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1789477433.372476:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789477433.372779:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d50b05c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3313:x1876402802599680:12345-0@lo:6:osp-syn-0-0.0 Request processed in 1325us (1517us total) trans 4294967307 rc 0/0 00000100:00100000:1.0:1789477433.372790:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1789477433.372818:0:3313:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967306 gen 2 00000004:00080000:0.0:1789477433.372826:0:3313:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967306 committed transno 4294967306 00000100:00100000:0.0:1789477433.372856:0:3313:0:(client.c:3169:ptlrpc_free_committed()) @@@ stopping search req@ffff9d0d7f73b100 x1876402802599680/t4294967307(4294967307) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1789477449 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:0.0:1789477433.372867:0:3313:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9d0d7f73b100/2, rc 0, transno 4294967307 00000100:00100000:0.0:1789477433.372873:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d7f73b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1876402802599680:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1789477433.372943:0:6999:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d7f701180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9bc33f26-0aab-4a14-832f-c58d566de1b0+18:11508:x1876402783730304:12345-192.168.201.23@tcp:44:lhsmtool_posix.0 Request processed in 154128us (156919us total) trans 0 rc 0/0 00000100:00100000:1.0:1789477433.372965:0:6999:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 183 00000100:00100000:0.0:1789477433.382004:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:1.0:1789477433.383855:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783730432 00000100:00100000:1.0:1789477433.383874:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783730432 00000100:00100000:1.0:1789477433.383958:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 56 00000100:00100000:1.0:1789477433.384048:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d75106a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9bc33f26-0aab-4a14-832f-c58d566de1b0+10:2355:x1876402783730432:12345-192.168.201.23@tcp:16:lhsmtool_posix.0 00000100:00100000:1.0:1789477433.454797:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d75106a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9bc33f26-0aab-4a14-832f-c58d566de1b0+10:2355:x1876402783730432:12345-192.168.201.23@tcp:16:lhsmtool_posix.0 Request processed in 70812us (72792us total) trans 0 rc 0/0 00000100:00100000:1.0:1789477433.454815:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 56 00000001:00080000:1.0:1789477433.454870:0:7678:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967315 is committed 00000001:00080000:1.0:1789477433.454882:0:7678:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967314 is committed 00000100:00100000:0.0:1789477433.463502:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:1.0:1789477433.463776:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783730688 00000100:00100000:1.0:1789477433.463792:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783730688 00000100:00100000:1.0:1789477433.463925:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 184 00000100:00100000:1.0:1789477433.463940:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d75104380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9bc33f26-0aab-4a14-832f-c58d566de1b0+18:11508:x1876402783730688:12345-192.168.201.23@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1789477433.464016:0:5845:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789477433.464065:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be5000/0xafddb3c8f92822cf lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2d60 expref: 18 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477433.464085:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9d0d50919800) 00010000:00010000:1.0:1789477433.464092:0:5845:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789477433.464136:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f518800/0xafddb3c8f92822eb lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477433.464153:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f518800/0xafddb3c8f92822eb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477433.464166:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f518800/0xafddb3c8f92822eb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789477433.464537:0:5845:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000bf852b0f reply state 000000005f5ea1f5 transno 4294967462 ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f518800/0xafddb3c8f92822eb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789477433.464550:0:5845:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1789477433.464806:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d75104380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9bc33f26-0aab-4a14-832f-c58d566de1b0+19:11508:x1876402783730688:12345-192.168.201.23@tcp:36:lhsmtool_posix.0 Request processed in 868us (1318us total) trans 4294967462 rc 0/0 00000100:00100000:1.0:1789477433.464815:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 184 00010000:00010000:3.0:1789477433.466459:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f518800/0xafddb3c8f92822eb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477433.466480:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f518800/0xafddb3c8f92822eb lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477433.466488:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f518800/0xafddb3c8f92822eb lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477433.466503:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d0d7f518800 already unused, calling callback (ffffffffc1fd54f0) 00010000:00010000:3.0:1789477433.466509:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f518800/0xafddb3c8f92822eb lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477433.466516:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f518800/0xafddb3c8f92822eb lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477433.466534:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9d0d50919800) 00010000:00010000:3.0:1789477433.466538:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789477433.466542:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f518800/0xafddb3c8f92822eb lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477433.466548:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f518800/0xafddb3c8f92822eb lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789477433.469046:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:1.0:1789477433.469152:0:8241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783730816 00000100:00100000:1.0:1789477433.469168:0:8241:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783730816 00000100:00100000:1.0:1789477433.469530:0:8241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 57 00000100:00100000:1.0:1789477433.469545:0:8241:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d753e3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9bc33f26-0aab-4a14-832f-c58d566de1b0+7:2353:x1876402783730816:12345-192.168.201.23@tcp:2:lhsmtool_posix.0 00002000:00010000:1.0:1789477433.469933:0:8241:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:1.0:1789477433.469937:0:8241:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb mtime from disk: 1789477432 -> 1789477431 00002000:00010000:1.0:1789477433.469940:0:8241:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb atime from disk: 0 -> 1789477429 00002000:00010000:1.0:1789477433.469942:0:8241:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb ctime from disk: 1789477432 -> 1789477431 00002000:00010000:1.0:1789477433.469959:0:8241:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:1.0:1789477433.470063:0:8241:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d753e3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9bc33f26-0aab-4a14-832f-c58d566de1b0+8:2353:x1876402783730816:12345-192.168.201.23@tcp:2:lhsmtool_posix.0 Request processed in 521us (1033us total) trans 4294967316 rc 0/0 00000100:00100000:1.0:1789477433.470072:0:8241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 57 00000100:00100000:3.0:1789477433.492702:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:0.0:1789477433.492809:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783731072 00000100:00100000:0.0:1789477433.492824:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783731072 00000100:00100000:0.0:1789477433.492905:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 185 00000100:00100000:0.0:1789477433.492917:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d7f700e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9bc33f26-0aab-4a14-832f-c58d566de1b0+18:11508:x1876402783731072:12345-192.168.201.23@tcp:55:lhsmtool_posix.0 00010000:00010000:0.0:1789477433.493025:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be5000/0xafddb3c8f92822f2 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477433.493046:0:5844:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d41647800/0xafddb3c8f92822b3 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2d52 expref: 18 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477433.493056:0:5844:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be5000/0xafddb3c8f92822f2 lrc: 4/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477433.493109:0:5844:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d41647800/0xafddb3c8f92822b3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2d52 expref: 18 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477433.493140:0:5844:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d41647800/0xafddb3c8f92822b3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2d52 expref: 18 pid: 5846 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789477433.493158:0:5844:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d75105c00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5844:1876402802599936:192.168.201.23@tcp:104: 00000100:00100000:0.0:1789477433.493260:0:5844:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d0d7fb8dd80 going to sleep for 11 seconds 00000100:00100000:3.0:1789477433.502174:0:5844:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d75105c00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5844:1876402802599936:192.168.201.23@tcp:104: 00010000:00010000:3.0:1789477433.502215:0:5844:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be5000/0xafddb3c8f92822f2 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789477433.521093:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:3.0:1789477433.521178:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783731200 00000100:00100000:3.0:1789477433.521192:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783731200 00010000:00010000:3.0:1789477433.521248:0:5831:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d41647800/0xafddb3c8f92822b3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2d52 expref: 19 pid: 5846 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789477433.521756:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 70 00000100:00100000:3.0:1789477433.521781:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d75106300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9bc33f26-0aab-4a14-832f-c58d566de1b0+19:2354:x1876402783731200:12345-192.168.201.23@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789477433.521803:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789477433.521820:0:5831:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d41647800/0xafddb3c8f92822b3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2d52 expref: 19 pid: 5846 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477433.521836:0:5831:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d41647800/0xafddb3c8f92822b3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2d52 expref: 19 pid: 5846 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477433.521865:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d41647800/0xafddb3c8f92822b3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2d52 expref: 19 pid: 5846 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477433.521882:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9d0d50919800) 00010000:00010000:3.0:1789477433.521889:0:5831:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be5000/0xafddb3c8f92822f2 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477433.522999:0:5831:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be5000/0xafddb3c8f92822f2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477433.523011:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be5000/0xafddb3c8f92822f2 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477433.523051:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789477433.523133:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d75106300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9bc33f26-0aab-4a14-832f-c58d566de1b0+18:2354:x1876402783731200:12345-192.168.201.23@tcp:103:ldlm_bl.0 Request processed in 1354us (2053us total) trans 0 rc 0/0 00000100:00100000:3.0:1789477433.523143:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 70 00010000:00010000:0.0:1789477433.525926:0:5844:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be5000/0xafddb3c8f92822f2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477433.525947:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be5000/0xafddb3c8f92822f2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477433.525987:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be5000/0xafddb3c8f92822f2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477433.525994:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be5000/0xafddb3c8f92822f2 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477433.526003:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be5000/0xafddb3c8f92822f2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477433.526010:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d0d50be5000 already unused, calling callback (ffffffffc1fd54f0) 00010000:00010000:0.0:1789477433.526016:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be5000/0xafddb3c8f92822f2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477433.526025:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be5000/0xafddb3c8f92822f2 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477433.526052:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9d0d50919800) 00010000:00010000:0.0:1789477433.526069:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:0.0:1789477433.526075:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be5000/0xafddb3c8f92822f2 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477433.526093:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be5000/0xafddb3c8f92822f2 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789477433.526193:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d7f700e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9bc33f26-0aab-4a14-832f-c58d566de1b0+17:11508:x1876402783731072:12345-192.168.201.23@tcp:55:lhsmtool_posix.0 Request processed in 33271us (33496us total) trans 0 rc -22/-22 00000100:00100000:0.0:1789477433.526205:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 185 00000100:00100000:1.0:1789477433.534755:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:3.0:1789477433.542048:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783731328 00000100:00100000:3.0:1789477433.542071:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783731328 00000100:00100000:3.0:1789477433.542210:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 58 00000100:00100000:3.0:1789477433.542224:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d50b05500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9bc33f26-0aab-4a14-832f-c58d566de1b0+8:2353:x1876402783731328:12345-192.168.201.23@tcp:1:lhsmtool_posix.0 00010000:00010000:3.0:1789477433.542278:0:6694:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000c88b4a1f/0xafddb3c8f92822f9 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477433.542316:0:6694:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000009a42fe57/0xafddb3c8f92822dd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2d6e expref: 8 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477433.542326:0:6694:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789477433.542331:0:6694:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789477433.542336:0:6694:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c88b4a1f/0xafddb3c8f92822f9 lrc: 4/1,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477433.542393:0:6694:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000009a42fe57/0xafddb3c8f92822dd lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2d6e expref: 8 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477433.542411:0:6694:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000009a42fe57/0xafddb3c8f92822dd lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2d6e expref: 8 pid: 6694 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789477433.543772:0:6694:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d7f703100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6694:1876402802600064:192.168.201.23@tcp:104: 00000100:00100000:3.0:1789477433.543934:0:6694:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d0d46219c00 going to sleep for 11 seconds 00000100:00100000:3.0:1789477433.546518:0:6694:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d7f703100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6694:1876402802600064:192.168.201.23@tcp:104: 00000100:00100000:1.0:1789477433.546810:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:2.0:1789477433.546884:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783731456 00000100:00100000:2.0:1789477433.546895:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783731456 00010000:00010000:2.0:1789477433.546951:0:5830:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000009a42fe57/0xafddb3c8f92822dd lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2d6e expref: 9 pid: 6694 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789477433.547007:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 71 00000100:00100000:2.0:1789477433.547021:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d74e89880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9bc33f26-0aab-4a14-832f-c58d566de1b0+9:2355:x1876402783731456:12345-192.168.201.23@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789477433.547047:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789477433.547080:0:5830:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000009a42fe57/0xafddb3c8f92822dd lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2d6e expref: 9 pid: 6694 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477433.547096:0:5830:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000009a42fe57/0xafddb3c8f92822dd lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2d6e expref: 9 pid: 6694 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477433.547125:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009a42fe57/0xafddb3c8f92822dd lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2d6e expref: 9 pid: 6694 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477433.547142:0:5830:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789477433.547147:0:5830:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789477433.547154:0:5830:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000c88b4a1f/0xafddb3c8f92822f9 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477433.547165:0:5830:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c88b4a1f/0xafddb3c8f92822f9 lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477433.547188:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789477433.547248:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d74e89880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9bc33f26-0aab-4a14-832f-c58d566de1b0+8:2355:x1876402783731456:12345-192.168.201.23@tcp:103:ldlm_bl.0 Request processed in 230us (440us total) trans 0 rc 0/0 00000100:00100000:2.0:1789477433.547257:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 71 00010000:00010000:3.0:1789477433.547916:0:6694:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000c88b4a1f/0xafddb3c8f92822f9 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477433.547931:0:6694:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000c88b4a1f/0xafddb3c8f92822f9 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477433.547939:0:6694:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c88b4a1f/0xafddb3c8f92822f9 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477433.547984:0:6694:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000c88b4a1f/0xafddb3c8f92822f9 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477433.547994:0:6694:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c88b4a1f/0xafddb3c8f92822f9 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477433.548003:0:6694:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c88b4a1f/0xafddb3c8f92822f9 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477433.548011:0:6694:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d0d49eca600 already unused, calling callback (ffffffffc15972a0) 00010000:00010000:3.0:1789477433.548017:0:6694:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c88b4a1f/0xafddb3c8f92822f9 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477433.548027:0:6694:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c88b4a1f/0xafddb3c8f92822f9 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477433.548042:0:6694:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c88b4a1f/0xafddb3c8f92822f9 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477433.548051:0:6694:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c88b4a1f/0xafddb3c8f92822f9 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789477433.548130:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d50b05500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9bc33f26-0aab-4a14-832f-c58d566de1b0+7:2353:x1876402783731328:12345-192.168.201.23@tcp:1:lhsmtool_posix.0 Request processed in 5908us (13386us total) trans 0 rc 0/0 00000100:00100000:3.0:1789477433.548140:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 58 00000100:00100000:1.0:1789477433.568827:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:2.0:1789477433.568924:0:6999:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783731712 00000100:00100000:2.0:1789477433.568937:0:6999:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783731712 00000100:00100000:2.0:1789477433.569018:0:6999:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 186 00000100:00100000:2.0:1789477433.569030:0:6999:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d74e89c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9bc33f26-0aab-4a14-832f-c58d566de1b0+17:11508:x1876402783731712:12345-192.168.201.23@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1789477433.569158:0:6999:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d41646a00/0xafddb3c8f9282300 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477433.569177:0:6999:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d41646a00/0xafddb3c8f9282300 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477433.569191:0:6999:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d41646a00/0xafddb3c8f9282300 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477433.569462:0:6999:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d41647800/0xafddb3c8f9282307 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477433.569475:0:6999:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49ecbc00/0xafddb3c8f92822c1 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2d59 expref: 18 pid: 12091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477433.569484:0:6999:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d41647800/0xafddb3c8f9282307 lrc: 4/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477433.569527:0:6999:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49ecbc00/0xafddb3c8f92822c1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2d59 expref: 18 pid: 12091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477433.569543:0:6999:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49ecbc00/0xafddb3c8f92822c1 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2d59 expref: 18 pid: 12091 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789477433.569561:0:6999:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d753e1f80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6999:1876402802600192:192.168.201.23@tcp:104: 00000100:00100000:2.0:1789477433.569699:0:6999:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d0d585b2300 going to sleep for 11 seconds 00000100:00100000:2.0:1789477433.572604:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:1.0:1789477433.572717:0:6999:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d753e1f80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6999:1876402802600192:192.168.201.23@tcp:104: 00010000:00010000:1.0:1789477433.572752:0:6999:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d41647800/0xafddb3c8f9282307 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789477433.572888:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783731840 00000100:00100000:3.0:1789477433.572898:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783731840 00010000:00010000:3.0:1789477433.572947:0:5829:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49ecbc00/0xafddb3c8f92822c1 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2d59 expref: 19 pid: 12091 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789477433.572995:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 72 00000100:00100000:3.0:1789477433.573006:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d753e3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9bc33f26-0aab-4a14-832f-c58d566de1b0+19:2354:x1876402783731840:12345-192.168.201.23@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789477433.573025:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789477433.573034:0:5829:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49ecbc00/0xafddb3c8f92822c1 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2d59 expref: 19 pid: 12091 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477433.573048:0:5829:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49ecbc00/0xafddb3c8f92822c1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2d59 expref: 19 pid: 12091 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477433.573073:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49ecbc00/0xafddb3c8f92822c1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2d59 expref: 19 pid: 12091 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477433.573106:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9d0d50919800) 00010000:00010000:3.0:1789477433.573113:0:5829:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d41647800/0xafddb3c8f9282307 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477433.573123:0:5829:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d41647800/0xafddb3c8f9282307 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477433.573132:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d41647800/0xafddb3c8f9282307 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477433.573159:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789477433.573212:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d753e3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9bc33f26-0aab-4a14-832f-c58d566de1b0+18:2354:x1876402783731840:12345-192.168.201.23@tcp:103:ldlm_bl.0 Request processed in 207us (649us total) trans 0 rc 0/0 00000100:00100000:3.0:1789477433.573236:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 72 00010000:00010000:2.0:1789477433.573353:0:6999:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d41647800/0xafddb3c8f9282307 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477433.573372:0:6999:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d41647800/0xafddb3c8f9282307 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789477433.573654:0:6999:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967463 00000001:00080000:2.0:1789477433.573831:0:6999:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967464 00000001:00080000:2.0:1789477433.573876:0:6999:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967465 00000100:00100000:2.0:1789477433.573972:0:6999:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d753e1880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:6999:1876402802600320:0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1789477433.574047:0:6999:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789477433.574310:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802600320 00000100:00100000:3.0:1789477433.574318:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802600320 00000100:00100000:3.0:1789477433.574380:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1789477433.574389:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d753e3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6999:x1876402802600320:12345-0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1789477433.574481:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d753e3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6999:x1876402802600320:12345-0@lo:1000:mdt00_003.0 Request processed in 93us (433us total) trans 0 rc 0/0 00000100:00100000:3.0:1789477433.574488:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1789477433.574953:0:6999:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d0d50a1e240 going to sleep for 11 seconds 00000100:00100000:2.0:1789477433.574982:0:6999:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967315 gen 2 00000004:00080000:2.0:1789477433.574988:0:6999:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9d0d623cad80, transno 4294967315 00000100:00100000:2.0:1789477433.575012:0:6999:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d753e1880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:6999:1876402802600320:0@lo:1000:mdt00_003.0 00000001:00080000:2.0:1789477433.576923:0:6999:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967466 00000100:00100000:2.0:1789477433.577033:0:6999:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d753e1880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:6999:1876402802600448:0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1789477433.578518:0:6999:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789477433.579271:0:6999:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d0d585b2300 going to sleep for 11 seconds 00000100:00100000:3.0:1789477433.582747:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802600448 00000100:00100000:3.0:1789477433.582777:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802600448 00000100:00100000:2.0:1789477433.583268:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1789477433.583281:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d753e1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6999:x1876402802600448:12345-0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1789477433.585633:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d753e1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:6999:x1876402802600448:12345-0@lo:1000:mdt00_003.0 Request processed in 2340us (7110us total) trans 4294967317 rc 0/0 00000100:00100000:2.0:1789477433.585652:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1789477433.588264:0:6999:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d753e1880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:6999:1876402802600448:0@lo:1000:mdt00_003.0 00010000:00010000:3.0:1789477433.588339:0:6999:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d41647800/0xafddb3c8f9282307 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477433.588737:0:6999:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d41647800/0xafddb3c8f9282307 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477433.588745:0:6999:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d41647800/0xafddb3c8f9282307 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477433.588752:0:6999:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d0d41647800 already unused, calling callback (ffffffffc1fd54f0) 00010000:00010000:3.0:1789477433.588758:0:6999:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d41647800/0xafddb3c8f9282307 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477433.588777:0:6999:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d41647800/0xafddb3c8f9282307 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477433.588798:0:6999:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9d0d50919800) 00010000:00010000:3.0:1789477433.588801:0:6999:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789477433.588814:0:6999:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d41647800/0xafddb3c8f9282307 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477433.588821:0:6999:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d41647800/0xafddb3c8f9282307 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477433.588865:0:6999:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be5e00/0xafddb3c8f928223c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477433.588872:0:6999:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be5e00/0xafddb3c8f928223c lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477433.588878:0:6999:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be5e00/0xafddb3c8f928223c lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477433.588883:0:6999:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d0d50be5e00 already unused, calling callback (ffffffffc1fd54f0) 00010000:00010000:3.0:1789477433.588886:0:6999:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be5e00/0xafddb3c8f928223c lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477433.588892:0:6999:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be5e00/0xafddb3c8f928223c lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477433.588902:0:6999:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9d0d596ae000) 00010000:00010000:3.0:1789477433.588905:0:6999:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789477433.588908:0:6999:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be5e00/0xafddb3c8f928223c lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477433.588914:0:6999:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be5e00/0xafddb3c8f928223c lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477433.588941:0:6999:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49ecbc00/0xafddb3c8f928230e lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477433.588959:0:6999:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f519400/0xafddb3c8f9282258 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2d3d expref: 21 pid: 6999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477433.588975:0:6999:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49ecbc00/0xafddb3c8f928230e lrc: 4/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477433.589025:0:6999:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f519400/0xafddb3c8f9282258 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2d3d expref: 21 pid: 6999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477433.589044:0:6999:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f519400/0xafddb3c8f9282258 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2d3d expref: 21 pid: 6999 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789477433.589061:0:6999:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d7f703100 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6999:1876402802600576:192.168.201.23@tcp:104: 00000100:00100000:3.0:1789477433.589882:0:6999:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d0d46219c00 going to sleep for 11 seconds 00000100:00100000:1.0:1789477433.594741:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:3.0:1789477433.594949:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783731968 00000100:00100000:3.0:1789477433.594958:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783731968 00000100:00100000:0.0:1789477433.594981:0:6999:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d7f703100 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6999:1876402802600576:192.168.201.23@tcp:104: 00010000:00010000:3.0:1789477433.595007:0:5830:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f519400/0xafddb3c8f9282258 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2d3d expref: 22 pid: 6999 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477433.595015:0:6999:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49ecbc00/0xafddb3c8f928230e lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789477433.595054:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 73 00000100:00100000:3.0:1789477433.595069:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d623cad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9bc33f26-0aab-4a14-832f-c58d566de1b0+22:2355:x1876402783731968:12345-192.168.201.23@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789477433.595099:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789477433.595108:0:5830:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f519400/0xafddb3c8f9282258 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2d3d expref: 22 pid: 6999 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477433.595121:0:5830:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f519400/0xafddb3c8f9282258 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2d3d expref: 22 pid: 6999 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477433.595150:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f519400/0xafddb3c8f9282258 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2d3d expref: 22 pid: 6999 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477433.595181:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9d0d596ae000) 00010000:00010000:3.0:1789477433.595186:0:5830:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49ecbc00/0xafddb3c8f928230e lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477433.595197:0:5830:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49ecbc00/0xafddb3c8f928230e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477433.595205:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49ecbc00/0xafddb3c8f928230e lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477433.595233:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789477433.595302:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d623cad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9bc33f26-0aab-4a14-832f-c58d566de1b0+21:2355:x1876402783731968:12345-192.168.201.23@tcp:103:ldlm_bl.0 Request processed in 236us (576us total) trans 0 rc 0/0 00000100:00100000:3.0:1789477433.595311:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 73 00010000:00010000:0.0:1789477433.595567:0:6999:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49ecbc00/0xafddb3c8f928230e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477433.595609:0:6999:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49ecbc00/0xafddb3c8f928230e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477433.595628:0:6999:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49ecbc00/0xafddb3c8f928230e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477433.595636:0:6999:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49ecbc00/0xafddb3c8f928230e lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477433.595643:0:6999:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49ecbc00/0xafddb3c8f928230e lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477433.595649:0:6999:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d0d49ecbc00 already unused, calling callback (ffffffffc1fd54f0) 00010000:00010000:0.0:1789477433.595655:0:6999:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49ecbc00/0xafddb3c8f928230e lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477433.595673:0:6999:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49ecbc00/0xafddb3c8f928230e lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477433.595684:0:6999:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9d0d596ae000) 00010000:00010000:0.0:1789477433.595686:0:6999:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789477433.595691:0:6999:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49ecbc00/0xafddb3c8f928230e lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477433.595697:0:6999:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49ecbc00/0xafddb3c8f928230e lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477433.595716:0:6999:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d41646a00/0xafddb3c8f9282300 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477433.595722:0:6999:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d41646a00/0xafddb3c8f9282300 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477433.595727:0:6999:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d41646a00/0xafddb3c8f9282300 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477433.595732:0:6999:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d0d41646a00 already unused, calling callback (ffffffffc1fd54f0) 00010000:00010000:0.0:1789477433.595734:0:6999:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d41646a00/0xafddb3c8f9282300 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477433.595740:0:6999:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d41646a00/0xafddb3c8f9282300 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477433.595747:0:6999:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9d0d596ae000) 00010000:00010000:0.0:1789477433.595749:0:6999:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1789477433.595752:0:6999:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d41646a00/0xafddb3c8f9282300 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477433.595778:0:6999:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d41646a00/0xafddb3c8f9282300 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789477433.597085:0:6999:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d74e89c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9bc33f26-0aab-4a14-832f-c58d566de1b0+20:11508:x1876402783731712:12345-192.168.201.23@tcp:57:lhsmtool_posix.0 Request processed in 28042us (28259us total) trans 4294967467 rc 0/0 00000100:00100000:1.0:1789477433.597101:0:6999:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 186 00000020:00080000:1.0:1789477433.597109:0:6999:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:0.0:1789477433.597700:0:11717:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1789477433.597708:0:11717:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1789477433.599688:0:11717:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 2 00000040:00080000:0.0:1789477433.599707:0:11717:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000040:00080000:1.0:1789477433.601840:0:12442:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1789477433.601855:0:12442:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789477433.602013:0:12442:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:1.0:1789477433.602019:0:12442:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1789477433.604153:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:3.0:1789477433.604722:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783732224 00000100:00100000:3.0:1789477433.604737:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783732224 00000100:00100000:3.0:1789477433.604821:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 50 00000100:00100000:3.0:1789477433.604832:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d5845f850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9bc33f26-0aab-4a14-832f-c58d566de1b0+20:11508:x1876402783732224:12345-192.168.201.23@tcp:35:lhsmtool_posix.0 00000004:00080000:3.0:1789477433.605883:0:5848:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0xd:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:3.0:1789477433.606003:0:5848:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967468 00010000:00010000:3.0:1789477433.606067:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49eca600/0xafddb3c8f9282315 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477433.606196:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49eca600/0xafddb3c8f9282315 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477433.606211:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49eca600/0xafddb3c8f9282315 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477433.606231:0:5848:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49eca600/0xafddb3c8f9282315 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477433.606237:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49eca600/0xafddb3c8f9282315 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477433.606244:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49eca600/0xafddb3c8f9282315 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477433.606331:0:5848:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1789477433.606460:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d5845f850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9bc33f26-0aab-4a14-832f-c58d566de1b0+22:11508:x1876402783732224:12345-192.168.201.23@tcp:35:lhsmtool_posix.0 Request processed in 1624us (2316us total) trans 4294967469 rc 0/0 00000100:00100000:3.0:1789477433.606472:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 50 00000020:00080000:3.0:1789477433.606478:0:5848:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1789477433.606501:0:5833:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789477433.606510:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49eca600/0xafddb3c8f9282315 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477433.606519:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d0d49eca600 already unused, calling callback (ffffffffc15972a0) 00010000:00010000:1.0:1789477433.606524:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49eca600/0xafddb3c8f9282315 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477433.606534:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49eca600/0xafddb3c8f9282315 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477433.606558:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9d0d44568900) 00010000:00010000:1.0:1789477433.606562:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1789477433.606568:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49eca600/0xafddb3c8f9282315 lrc: 1/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477433.606574:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49eca600/0xafddb3c8f9282315 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477433.606620:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789477433.606622:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789477433.606624:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789477433.749989:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:0.0:1789477433.750096:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783732480 00000100:00100000:0.0:1789477433.750110:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783732480 00000100:00100000:0.0:1789477433.750194:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 187 00000100:00100000:0.0:1789477433.750207:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d753e1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9bc33f26-0aab-4a14-832f-c58d566de1b0+22:11518:x1876402783732480:12345-192.168.201.23@tcp:101:lfs.0 00010000:00010000:0.0:1789477433.750243:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789477433.750274:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be5000/0xafddb3c8f928231c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa90d500d7b8f2d75 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477433.750717:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be4200/0xafddb3c8f9282323 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477433.750736:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be4200/0xafddb3c8f9282323 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477433.750749:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be4200/0xafddb3c8f9282323 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789477433.750773:0:5845:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 7680 00010000:00010000:0.0:1789477433.750974:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be5000/0xafddb3c8f928231c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2d75 expref: 25 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477433.751008:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be4200/0xafddb3c8f9282323 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2d75 expref: 24 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477433.751019:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9d0d44568d00) 00010000:00010000:0.0:1789477433.751022:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1789477433.751026:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d0d50be4200, rc 0) 00000100:00100000:0.0:1789477433.751106:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d753e1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9bc33f26-0aab-4a14-832f-c58d566de1b0+24:11518:x1876402783732480:12345-192.168.201.23@tcp:101:lfs.0 Request processed in 900us (1132us total) trans 4294967470 rc 0/0 00000100:00100000:0.0:1789477433.751114:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 187 00000100:00100000:0.0:1789477433.756794:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:3.0:1789477433.756877:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783732608 00000100:00100000:3.0:1789477433.756889:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783732608 00000100:00100000:3.0:1789477433.756962:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 188 00000100:00100000:3.0:1789477433.756975:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d75107b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9bc33f26-0aab-4a14-832f-c58d566de1b0+24:11518:x1876402783732608:12345-192.168.201.23@tcp:34:lfs.0 00010000:00010000:3.0:1789477433.757084:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49eca000/0xafddb3c8f9282331 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477433.757107:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49eca000/0xafddb3c8f9282331 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477433.757121:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49eca000/0xafddb3c8f9282331 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477433.757142:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49eca600/0xafddb3c8f9282338 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477433.757161:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49eca600/0xafddb3c8f9282338 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477433.757168:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49eca600/0xafddb3c8f9282338 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477433.757536:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49ecbc00/0xafddb3c8f928233f lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477433.757547:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49ecbc00/0xafddb3c8f928233f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477433.757555:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49ecbc00/0xafddb3c8f928233f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789477433.757638:0:5844:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49ecbc00/0xafddb3c8f928233f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477433.757655:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49eca000/0xafddb3c8f9282331 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477433.757662:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49eca000/0xafddb3c8f9282331 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477433.757670:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49eca000/0xafddb3c8f9282331 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477433.757676:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d0d49eca000 already unused, calling callback (ffffffffc1fd54f0) 00010000:00010000:3.0:1789477433.757681:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49eca000/0xafddb3c8f9282331 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477433.757689:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49eca000/0xafddb3c8f9282331 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477433.757710:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9d0d44568d00) 00010000:00010000:3.0:1789477433.757713:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789477433.757718:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49eca000/0xafddb3c8f9282331 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477433.757725:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49eca000/0xafddb3c8f9282331 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477433.757743:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49eca600/0xafddb3c8f9282338 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477433.757751:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49eca600/0xafddb3c8f9282338 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477433.757841:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49eca600/0xafddb3c8f9282338 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477433.757849:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d0d49eca600 already unused, calling callback (ffffffffc1fd54f0) 00010000:00010000:3.0:1789477433.757853:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49eca600/0xafddb3c8f9282338 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477433.757860:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49eca600/0xafddb3c8f9282338 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477433.757869:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9d0d44568f00) 00010000:00010000:3.0:1789477433.757871:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789477433.757874:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49eca600/0xafddb3c8f9282338 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477433.757881:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49eca600/0xafddb3c8f9282338 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477433.757908:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49ecbc00/0xafddb3c8f928233f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477433.757915:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49ecbc00/0xafddb3c8f928233f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477433.757920:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49ecbc00/0xafddb3c8f928233f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477433.757926:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d0d49ecbc00 already unused, calling callback (ffffffffc1fd54f0) 00010000:00010000:3.0:1789477433.757929:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49ecbc00/0xafddb3c8f928233f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477433.757935:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49ecbc00/0xafddb3c8f928233f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477433.757943:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9d0d44568a00) 00010000:00010000:3.0:1789477433.757946:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789477433.757948:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49ecbc00/0xafddb3c8f928233f lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477433.757955:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49ecbc00/0xafddb3c8f928233f lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789477433.758062:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d75107b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9bc33f26-0aab-4a14-832f-c58d566de1b0+24:11518:x1876402783732608:12345-192.168.201.23@tcp:34:lfs.0 Request processed in 1086us (1279us total) trans 0 rc 0/0 00000100:00100000:3.0:1789477433.758073:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 188 00000100:00100000:0.0:1789477433.814853:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:3.0:1789477433.814987:0:6999:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783732864 00000100:00100000:3.0:1789477433.815002:0:6999:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783732864 00000100:00100000:3.0:1789477433.815082:0:6999:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 189 00000100:00100000:3.0:1789477433.815104:0:6999:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d75104000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9bc33f26-0aab-4a14-832f-c58d566de1b0+24:11521:x1876402783732864:12345-192.168.201.23@tcp:101:lfs.0 00010000:00010000:3.0:1789477433.815134:0:6999:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789477433.815162:0:6999:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49ecbc00/0xafddb3c8f9282346 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa90d500d7b8f2d7c expref: -99 pid: 6999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477433.815260:0:6999:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49eca600/0xafddb3c8f928234d lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477433.815279:0:6999:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49eca600/0xafddb3c8f928234d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477433.815293:0:6999:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49eca600/0xafddb3c8f928234d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477433.815310:0:6999:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49eca000/0xafddb3c8f9282354 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477433.815318:0:6999:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49eca000/0xafddb3c8f9282354 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477433.815325:0:6999:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49eca000/0xafddb3c8f9282354 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477433.815795:0:6999:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49ecba00/0xafddb3c8f928235b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477433.815805:0:6999:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49ecba00/0xafddb3c8f928235b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477433.815813:0:6999:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49ecba00/0xafddb3c8f928235b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789477433.815836:0:6999:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 9 00010000:00010000:3.0:1789477433.815961:0:6999:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49eca600/0xafddb3c8f928234d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477433.815971:0:6999:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49eca600/0xafddb3c8f928234d lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477433.816146:0:6999:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49eca600/0xafddb3c8f928234d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477433.816156:0:6999:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d0d49eca600 already unused, calling callback (ffffffffc1fd54f0) 00010000:00010000:3.0:1789477433.816161:0:6999:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49eca600/0xafddb3c8f928234d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477433.816169:0:6999:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49eca600/0xafddb3c8f928234d lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477433.816183:0:6999:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9d0d44568d00) 00010000:00010000:3.0:1789477433.816187:0:6999:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789477433.816192:0:6999:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49eca600/0xafddb3c8f928234d lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477433.816198:0:6999:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49eca600/0xafddb3c8f928234d lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477433.816218:0:6999:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49eca000/0xafddb3c8f9282354 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477433.816224:0:6999:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49eca000/0xafddb3c8f9282354 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477433.816240:0:6999:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49eca000/0xafddb3c8f9282354 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477433.816245:0:6999:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d0d49eca000 already unused, calling callback (ffffffffc1fd54f0) 00010000:00010000:3.0:1789477433.816248:0:6999:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49eca000/0xafddb3c8f9282354 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477433.816255:0:6999:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49eca000/0xafddb3c8f9282354 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477433.816263:0:6999:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9d0d44568a00) 00010000:00010000:3.0:1789477433.816265:0:6999:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789477433.816268:0:6999:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49eca000/0xafddb3c8f9282354 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477433.816272:0:6999:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49eca000/0xafddb3c8f9282354 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477433.816327:0:6999:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49ecbc00/0xafddb3c8f9282346 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2d7c expref: 27 pid: 6999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477433.816342:0:6999:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49ecba00/0xafddb3c8f928235b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2d7c expref: 26 pid: 6999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477433.816350:0:6999:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9d0d44568f00) 00010000:00010000:3.0:1789477433.816352:0:6999:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789477433.816356:0:6999:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d0d49ecba00, rc 0) 00000100:00100000:3.0:1789477433.816607:0:6999:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d75104000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9bc33f26-0aab-4a14-832f-c58d566de1b0+26:11521:x1876402783732864:12345-192.168.201.23@tcp:101:lfs.0 Request processed in 1504us (1769us total) trans 4294967471 rc 0/0 00000100:00100000:3.0:1789477433.816625:0:6999:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 189 00000100:00100000:2.0:1789477433.819986:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:3.0:1789477433.820078:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783732992 00000100:00100000:3.0:1789477433.820091:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783732992 00000100:00100000:3.0:1789477433.820168:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 190 00000100:00100000:3.0:1789477433.820181:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d7c1fb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9bc33f26-0aab-4a14-832f-c58d566de1b0+26:11521:x1876402783732992:12345-192.168.201.23@tcp:54:lfs.0 00010000:00010000:3.0:1789477433.820282:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d59d6a400/0xafddb3c8f9282369 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477433.820305:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d59d6a400/0xafddb3c8f9282369 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477433.820318:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d59d6a400/0xafddb3c8f9282369 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477433.820353:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d59d6a400/0xafddb3c8f9282369 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477433.820359:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d59d6a400/0xafddb3c8f9282369 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477433.820366:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d59d6a400/0xafddb3c8f9282369 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477433.820373:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d0d59d6a400 already unused, calling callback (ffffffffc1fd54f0) 00010000:00010000:3.0:1789477433.820378:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d59d6a400/0xafddb3c8f9282369 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477433.820386:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d59d6a400/0xafddb3c8f9282369 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477433.820398:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9d0d44568f00) 00010000:00010000:3.0:1789477433.820675:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789477433.820682:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d59d6a400/0xafddb3c8f9282369 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477433.820689:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d59d6a400/0xafddb3c8f9282369 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789477433.833219:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d7c1fb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9bc33f26-0aab-4a14-832f-c58d566de1b0+26:11521:x1876402783732992:12345-192.168.201.23@tcp:54:lfs.0 Request processed in 13023us (13230us total) trans 0 rc 0/0 00000100:00100000:1.0:1789477433.833240:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 190 00000100:00100000:1.0:1789477433.845026:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:2.0:1789477433.845416:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783733248 00000100:00100000:2.0:1789477433.845431:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783733248 00000100:00100000:2.0:1789477433.845505:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 51 00000100:00100000:2.0:1789477433.845532:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d623c9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9bc33f26-0aab-4a14-832f-c58d566de1b0+26:11521:x1876402783733248:12345-192.168.201.23@tcp:35:lfs.0 00000100:00100000:2.0:1789477433.845885:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d623c9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9bc33f26-0aab-4a14-832f-c58d566de1b0+27:11521:x1876402783733248:12345-192.168.201.23@tcp:35:lfs.0 Request processed in 353us (874us total) trans 4294967472 rc 0/0 00000100:00100000:2.0:1789477433.845893:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 51 00000100:00100000:2.0:1789477433.898142:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:0.0:1789477433.898202:0:12091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783733504 00000100:00100000:0.0:1789477433.898217:0:12091:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783733504 00000100:00100000:0.0:1789477433.898313:0:12091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 191 00000100:00100000:0.0:1789477433.898327:0:12091:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d7c1f8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9bc33f26-0aab-4a14-832f-c58d566de1b0+27:11056:x1876402783733504:12345-192.168.201.23@tcp:101:bash.0 00010000:00010000:0.0:1789477433.898361:0:12091:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789477433.898392:0:12091:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be5a00/0xafddb3c8f9282370 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa90d500d7b8f2d83 expref: -99 pid: 12091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477433.900056:0:12091:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be4c00/0xafddb3c8f9282377 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477433.900085:0:12091:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49ecba00/0xafddb3c8f928235b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2d7c expref: 28 pid: 6999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477433.900096:0:12091:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be4c00/0xafddb3c8f9282377 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477433.900171:0:12091:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49ecba00/0xafddb3c8f928235b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2d7c expref: 28 pid: 6999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477433.900187:0:12091:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49ecba00/0xafddb3c8f928235b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2d7c expref: 28 pid: 6999 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789477433.900204:0:12091:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d75105880 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12091:1876402802600704:192.168.201.23@tcp:104: 00000100:00100000:0.0:1789477433.900337:0:12091:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d0d7fb8dc00 going to sleep for 11 seconds 00000100:00100000:0.0:1789477433.903089:0:12091:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d75105880 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12091:1876402802600704:192.168.201.23@tcp:104: 00000100:00100000:2.0:1789477433.903097:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00010000:00010000:0.0:1789477433.903129:0:12091:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be4c00/0xafddb3c8f9282377 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12091 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789477433.903194:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783733632 00000100:00100000:3.0:1789477433.903203:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783733632 00010000:00010000:3.0:1789477433.903253:0:5829:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49ecba00/0xafddb3c8f928235b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2d7c expref: 29 pid: 6999 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789477433.903311:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 74 00000100:00100000:3.0:1789477433.903324:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d7c1f8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9bc33f26-0aab-4a14-832f-c58d566de1b0+29:2354:x1876402783733632:12345-192.168.201.23@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789477433.903346:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789477433.903355:0:5829:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49ecba00/0xafddb3c8f928235b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2d7c expref: 29 pid: 6999 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477433.903368:0:5829:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49ecba00/0xafddb3c8f928235b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2d7c expref: 29 pid: 6999 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477433.903394:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49ecba00/0xafddb3c8f928235b lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2d7c expref: 29 pid: 6999 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477433.903418:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9d0d44568f00) 00010000:00010000:3.0:1789477433.903425:0:5829:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be4c00/0xafddb3c8f9282377 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477433.903435:0:5829:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be4c00/0xafddb3c8f9282377 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 12091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477433.903455:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be4c00/0xafddb3c8f9282377 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 12091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477433.903477:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789477433.903544:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d7c1f8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9bc33f26-0aab-4a14-832f-c58d566de1b0+28:2354:x1876402783733632:12345-192.168.201.23@tcp:103:ldlm_bl.0 Request processed in 222us (449us total) trans 0 rc 0/0 00000100:00100000:3.0:1789477433.903552:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 74 00010000:00010000:0.0:1789477433.903786:0:12091:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be4c00/0xafddb3c8f9282377 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477433.903795:0:12091:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be4c00/0xafddb3c8f9282377 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12091 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789477433.903819:0:12091:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 9 00010000:00010000:0.0:1789477433.904010:0:12091:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be5a00/0xafddb3c8f9282370 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2d83 expref: 29 pid: 12091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477433.904029:0:12091:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be4c00/0xafddb3c8f9282377 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2d83 expref: 28 pid: 12091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477433.904038:0:12091:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9d0d44568f00) 00010000:00010000:0.0:1789477433.904040:0:12091:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1789477433.904050:0:12091:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d0d50be4c00, rc 0) 00000100:00100000:0.0:1789477433.904094:0:12091:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d7c1f8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9bc33f26-0aab-4a14-832f-c58d566de1b0+28:11056:x1876402783733504:12345-192.168.201.23@tcp:101:bash.0 Request processed in 5770us (5964us total) trans 4294967473 rc 0/0 00000100:00100000:0.0:1789477433.904102:0:12091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 191 00000100:00100000:2.0:1789477433.906310:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:3.0:1789477433.906354:0:6999:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783733888 00000100:00100000:3.0:1789477433.906366:0:6999:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783733888 00000100:00100000:3.0:1789477433.906480:0:6999:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 192 00000100:00100000:3.0:1789477433.906493:0:6999:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d7c1f9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9bc33f26-0aab-4a14-832f-c58d566de1b0+28:11056:x1876402783733888:12345-192.168.201.23@tcp:36:bash.0 00010000:00010000:3.0:1789477433.907017:0:6999:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d59d6a400/0xafddb3c8f9282385 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477433.907039:0:6999:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d59d6a400/0xafddb3c8f9282385 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477433.907053:0:6999:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d59d6a400/0xafddb3c8f9282385 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789477433.907128:0:6999:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967474 00000004:00010000:3.0:1789477433.907156:0:6999:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000d68ddb1f reply state 00000000c649b2a7 transno 4294967475 ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d59d6a400/0xafddb3c8f9282385 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789477433.907167:0:6999:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:3.0:1789477433.907214:0:6999:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967475 00000100:00100000:3.0:1789477433.907354:0:6999:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d7c1f9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9bc33f26-0aab-4a14-832f-c58d566de1b0+32:11056:x1876402783733888:12345-192.168.201.23@tcp:36:bash.0 Request processed in 862us (1057us total) trans 4294967476 rc 0/0 00000100:00100000:3.0:1789477433.907363:0:6999:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 192 00000020:00080000:3.0:1789477433.907387:0:6999:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:2.0:1789477433.909670:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:1.0:1789477433.909785:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783734016 00000100:00100000:1.0:1789477433.909799:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783734016 00000100:00100000:1.0:1789477433.909868:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 193 00000100:00100000:1.0:1789477433.909881:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d7c1fb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9bc33f26-0aab-4a14-832f-c58d566de1b0+32:11056:x1876402783734016:12345-192.168.201.23@tcp:101:bash.0 00010000:00010000:1.0:1789477433.909915:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789477433.909941:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f518c00/0xafddb3c8f928238c lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa90d500d7b8f2d8a expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477433.910242:0:3296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d59d6a400/0xafddb3c8f9282385 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477433.910254:0:3296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d59d6a400/0xafddb3c8f9282385 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477433.910414:0:3296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d59d6a400/0xafddb3c8f9282385 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477433.910451:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f518c00/0xafddb3c8f928238c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2d8a expref: 33 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477433.910471:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f518c00/0xafddb3c8f928238c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2d8a expref: 33 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477433.910525:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9d0d44568f00) 00010000:00010000:1.0:1789477433.910528:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789477433.910532:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d0d7f518c00, rc 0) 00000100:00100000:1.0:1789477433.910641:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d7c1fb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9bc33f26-0aab-4a14-832f-c58d566de1b0+33:11056:x1876402783734016:12345-192.168.201.23@tcp:101:bash.0 Request processed in 762us (984us total) trans 0 rc 0/0 00000100:00100000:1.0:1789477433.910649:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 193 00010000:00010000:3.0:1789477433.910722:0:3296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d0d59d6a400 already unused, calling callback (ffffffffc1fd54f0) 00010000:00010000:3.0:1789477433.910729:0:3296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d59d6a400/0xafddb3c8f9282385 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477433.910740:0:3296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d59d6a400/0xafddb3c8f9282385 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477433.911024:0:3296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9d0d44568f00) 00010000:00010000:3.0:1789477433.911029:0:3296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789477433.911035:0:3296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d59d6a400/0xafddb3c8f9282385 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477433.911043:0:3296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d59d6a400/0xafddb3c8f9282385 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789477433.913799:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:3.0:1789477433.913935:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783734144 00000100:00100000:3.0:1789477433.913948:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783734144 00000100:00100000:3.0:1789477433.914047:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 59 00000100:00100000:3.0:1789477433.914060:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d75105880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9bc33f26-0aab-4a14-832f-c58d566de1b0+7:11056:x1876402783734144:12345-192.168.201.23@tcp:101:bash.0 00010000:00010000:3.0:1789477433.914095:0:6696:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789477433.914126:0:6696:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000062480330/0xafddb3c8f9282393 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa90d500d7b8f2d91 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789477433.914187:0:6696:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x5:0x0] initial LVB size: 9, mtime: 0x6aa94237, atime: 0x6aa94235, ctime: 0x6aa94237, blocks: 0xb 00010000:00010000:3.0:1789477433.914216:0:6696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=378s v=(0 0) 00010000:00010000:3.0:1789477433.914222:0:6696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789477433.914232:0:6696:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000062480330/0xafddb3c8f9282393 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2d91 expref: 8 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477433.914252:0:6696:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000062480330/0xafddb3c8f9282393 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2d91 expref: 8 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477433.914277:0:6696:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d0d59d6b400, rc 0) 00000100:00100000:3.0:1789477433.914354:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d75105880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9bc33f26-0aab-4a14-832f-c58d566de1b0+8:11056:x1876402783734144:12345-192.168.201.23@tcp:101:bash.0 Request processed in 296us (572us total) trans 0 rc 0/0 00000100:00100000:3.0:1789477433.914362:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 59 00000100:00100000:2.0:1789477433.919332:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:0.0:1789477433.919458:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783734272 00000100:00100000:0.0:1789477433.919471:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783734272 00002000:00010000:0.0:1789477433.919533:0:6701:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/5 (0->18446744073709551615) 00002000:00100000:0.0:1789477433.919538:0:6701:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9d0d7c1f8a80 with x1876402783734272 ext(0->18446744073709551615) 00002000:00010000:0.0:1789477433.919552:0:6701:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9d0d7c1f8a80. 00000100:00100000:0.0:1789477433.919626:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 5 00000100:00100000:0.0:1789477433.919638:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d7c1f8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:9bc33f26-0aab-4a14-832f-c58d566de1b0+8:2353:x1876402783734272:12345-192.168.201.23@tcp:10:bash.0 00002000:00010000:0.0:1789477433.920001:0:6701:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:0.0:1789477433.920005:0:6701:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb mtime from disk: 1789477431 -> 1789477433 00002000:00010000:0.0:1789477433.920008:0:6701:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb atime from disk: 1789477429 -> 1789477429 00002000:00010000:0.0:1789477433.920010:0:6701:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb ctime from disk: 1789477431 -> 1789477433 00002000:00010000:0.0:1789477433.920011:0:6701:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:0.0:1789477433.920088:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d7c1f8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:9bc33f26-0aab-4a14-832f-c58d566de1b0+9:2353:x1876402783734272:12345-192.168.201.23@tcp:10:bash.0 Request processed in 442us (764us total) trans 4294967318 rc 0/0 00000100:00100000:0.0:1789477433.920097:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 5 00002000:00010000:0.0:1789477433.920101:0:6701:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/5 (0->18446744073709551615) 00002000:00100000:0.0:1789477433.920105:0:6701:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9d0d7c1f8a80 with x1876402783734272 ext(0->18446744073709551615) 00002000:00010000:0.0:1789477433.920109:0:6701:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9d0d7c1f8a80. 00000100:00100000:1.0:1789477433.994669:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:0.0:1789477433.994782:0:12091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783734400 00000100:00100000:0.0:1789477433.994796:0:12091:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783734400 00000100:00100000:0.0:1789477433.994886:0:12091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 194 00000100:00100000:0.0:1789477433.994908:0:12091:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d74f84700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9bc33f26-0aab-4a14-832f-c58d566de1b0+32:11535:x1876402783734400:12345-192.168.201.23@tcp:34:lfs.0 00010000:00010000:0.0:1789477433.995026:0:12091:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be5a00/0xafddb3c8f928239a lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477433.995048:0:12091:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be5a00/0xafddb3c8f928239a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477433.995064:0:12091:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be5a00/0xafddb3c8f928239a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477433.995081:0:12091:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be5200/0xafddb3c8f92823a1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477433.995088:0:12091:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be5200/0xafddb3c8f92823a1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477433.995095:0:12091:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be5200/0xafddb3c8f92823a1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477433.995450:0:12091:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be4a00/0xafddb3c8f92823a8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477433.995460:0:12091:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be4a00/0xafddb3c8f92823a8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477433.995467:0:12091:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be4a00/0xafddb3c8f92823a8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12091 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789477433.995513:0:12091:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be4a00/0xafddb3c8f92823a8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477433.995526:0:12091:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be5a00/0xafddb3c8f928239a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477433.995543:0:12091:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be5a00/0xafddb3c8f928239a lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 12091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477433.995551:0:12091:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be5a00/0xafddb3c8f928239a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477433.995557:0:12091:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d0d50be5a00 already unused, calling callback (ffffffffc1fd54f0) 00010000:00010000:0.0:1789477433.995563:0:12091:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be5a00/0xafddb3c8f928239a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477433.995571:0:12091:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be5a00/0xafddb3c8f928239a lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 12091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477433.995612:0:12091:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9d0d44568d00) 00010000:00010000:0.0:1789477433.995615:0:12091:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789477433.995620:0:12091:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be5a00/0xafddb3c8f928239a lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477433.995626:0:12091:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be5a00/0xafddb3c8f928239a lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477433.995640:0:12091:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be5200/0xafddb3c8f92823a1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477433.995646:0:12091:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be5200/0xafddb3c8f92823a1 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477433.995652:0:12091:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be5200/0xafddb3c8f92823a1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477433.995657:0:12091:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d0d50be5200 already unused, calling callback (ffffffffc1fd54f0) 00010000:00010000:0.0:1789477433.995664:0:12091:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be5200/0xafddb3c8f92823a1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477433.995671:0:12091:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be5200/0xafddb3c8f92823a1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477433.995678:0:12091:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9d0d596ae000) 00010000:00010000:0.0:1789477433.995680:0:12091:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789477433.995682:0:12091:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be5200/0xafddb3c8f92823a1 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477433.995688:0:12091:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be5200/0xafddb3c8f92823a1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477433.995703:0:12091:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be4a00/0xafddb3c8f92823a8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477433.995709:0:12091:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be4a00/0xafddb3c8f92823a8 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 12091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477433.995715:0:12091:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be4a00/0xafddb3c8f92823a8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477433.995720:0:12091:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d0d50be4a00 already unused, calling callback (ffffffffc1fd54f0) 00010000:00010000:0.0:1789477433.995723:0:12091:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be4a00/0xafddb3c8f92823a8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477433.995728:0:12091:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be4a00/0xafddb3c8f92823a8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 12091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477433.995734:0:12091:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9d0d44568f00) 00010000:00010000:0.0:1789477433.995736:0:12091:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789477433.995743:0:12091:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be4a00/0xafddb3c8f92823a8 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477433.995749:0:12091:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be4a00/0xafddb3c8f92823a8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12091 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789477433.995857:0:12091:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d74f84700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9bc33f26-0aab-4a14-832f-c58d566de1b0+32:11535:x1876402783734400:12345-192.168.201.23@tcp:34:lfs.0 Request processed in 951us (1202us total) trans 0 rc 0/0 00000100:00100000:0.0:1789477433.995865:0:12091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 194 00000100:00100000:2.0:1789477434.029706:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:3.0:1789477434.029961:0:6999:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783734656 00000100:00100000:3.0:1789477434.029975:0:6999:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783734656 00000100:00100000:3.0:1789477434.030049:0:6999:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 195 00000100:00100000:3.0:1789477434.030061:0:6999:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d7c1f9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9bc33f26-0aab-4a14-832f-c58d566de1b0+32:11538:x1876402783734656:12345-192.168.201.23@tcp:101:lfs.0 00010000:00010000:3.0:1789477434.030097:0:6999:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789477434.030123:0:6999:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d59d6a400/0xafddb3c8f92823af lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa90d500d7b8f2d98 expref: -99 pid: 6999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477434.030219:0:6999:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d59d6b600/0xafddb3c8f92823b6 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477434.030238:0:6999:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d59d6b600/0xafddb3c8f92823b6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477434.030281:0:6999:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d59d6b600/0xafddb3c8f92823b6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477434.030300:0:6999:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49ecba00/0xafddb3c8f92823bd lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477434.030309:0:6999:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49ecba00/0xafddb3c8f92823bd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477434.030317:0:6999:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49ecba00/0xafddb3c8f92823bd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477434.030764:0:6999:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49ecbc00/0xafddb3c8f92823c4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477434.030776:0:6999:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49ecbc00/0xafddb3c8f92823c4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477434.030784:0:6999:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49ecbc00/0xafddb3c8f92823c4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789477434.030796:0:6999:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:3.0:1789477434.030921:0:6999:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d59d6b600/0xafddb3c8f92823b6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477434.030930:0:6999:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d59d6b600/0xafddb3c8f92823b6 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477434.030937:0:6999:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d59d6b600/0xafddb3c8f92823b6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477434.030944:0:6999:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d0d59d6b600 already unused, calling callback (ffffffffc1fd54f0) 00010000:00010000:3.0:1789477434.030956:0:6999:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d59d6b600/0xafddb3c8f92823b6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477434.030966:0:6999:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d59d6b600/0xafddb3c8f92823b6 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477434.030981:0:6999:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9d0d44568d00) 00010000:00010000:3.0:1789477434.030987:0:6999:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789477434.030993:0:6999:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d59d6b600/0xafddb3c8f92823b6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477434.030999:0:6999:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d59d6b600/0xafddb3c8f92823b6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477434.031017:0:6999:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49ecba00/0xafddb3c8f92823bd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477434.031023:0:6999:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49ecba00/0xafddb3c8f92823bd lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477434.031029:0:6999:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49ecba00/0xafddb3c8f92823bd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477434.031034:0:6999:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d0d49ecba00 already unused, calling callback (ffffffffc1fd54f0) 00010000:00010000:3.0:1789477434.031037:0:6999:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49ecba00/0xafddb3c8f92823bd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477434.031042:0:6999:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49ecba00/0xafddb3c8f92823bd lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477434.031049:0:6999:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9d0d44568000) 00010000:00010000:3.0:1789477434.031052:0:6999:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789477434.031060:0:6999:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49ecba00/0xafddb3c8f92823bd lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477434.031065:0:6999:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49ecba00/0xafddb3c8f92823bd lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477434.031114:0:6999:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d59d6a400/0xafddb3c8f92823af lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2d98 expref: 35 pid: 6999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477434.031130:0:6999:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49ecbc00/0xafddb3c8f92823c4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2d98 expref: 34 pid: 6999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477434.031137:0:6999:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9d0d44568f00) 00010000:00010000:3.0:1789477434.031140:0:6999:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1789477434.031142:0:6999:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d0d49ecbc00, rc 0) 00000100:00100000:3.0:1789477434.031232:0:6999:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d7c1f9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9bc33f26-0aab-4a14-832f-c58d566de1b0+34:11538:x1876402783734656:12345-192.168.201.23@tcp:101:lfs.0 Request processed in 1172us (1541us total) trans 4294967477 rc 0/0 00000100:00100000:3.0:1789477434.031240:0:6999:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 195 00010000:00010000:2.0:1789477434.031751:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789477434.034024:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:1.0:1789477434.034152:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783734784 00000100:00100000:1.0:1789477434.034164:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783734784 00000100:00100000:1.0:1789477434.034229:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 196 00000100:00100000:1.0:1789477434.034240:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d75104a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9bc33f26-0aab-4a14-832f-c58d566de1b0+34:11538:x1876402783734784:12345-192.168.201.23@tcp:54:lfs.0 00010000:00010000:1.0:1789477434.034331:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f518600/0xafddb3c8f92823d2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477434.034349:0:5846:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be4c00/0xafddb3c8f9282377 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2d83 expref: 34 pid: 12091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477434.034360:0:5846:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f518600/0xafddb3c8f92823d2 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477434.034401:0:5846:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be4c00/0xafddb3c8f9282377 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2d83 expref: 34 pid: 12091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477434.034416:0:5846:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be4c00/0xafddb3c8f9282377 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2d83 expref: 34 pid: 12091 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789477434.034432:0:5846:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d75369180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5846:1876402802600832:192.168.201.23@tcp:104: 00000100:00100000:1.0:1789477434.034611:0:5846:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d0d7fad2240 going to sleep for 11 seconds 00000100:00100000:1.0:1789477434.037470:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:3.0:1789477434.037662:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783735040 00000100:00100000:3.0:1789477434.037673:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783735040 00000100:00100000:3.0:1789477434.037737:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 52 00000100:00100000:3.0:1789477434.037748:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d7536b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9bc33f26-0aab-4a14-832f-c58d566de1b0+35:9241:x1876402783735040:12345-192.168.201.23@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1789477434.038196:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d7536b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9bc33f26-0aab-4a14-832f-c58d566de1b0+36:9241:x1876402783735040:12345-192.168.201.23@tcp:35:ldlm_bl.0 Request processed in 447us (738us total) trans 4294967478 rc 0/0 00000100:00100000:3.0:1789477434.038205:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 52 00000100:00100000:2.0:1789477434.038514:0:5846:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d75369180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5846:1876402802600832:192.168.201.23@tcp:104: 00010000:00010000:2.0:1789477434.038551:0:5846:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f518600/0xafddb3c8f92823d2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789477434.041514:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:1.0:1789477434.041663:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783735168 00000100:00100000:1.0:1789477434.041675:0:6711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783735168 00010000:00010000:1.0:1789477434.041731:0:6711:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be4c00/0xafddb3c8f9282377 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2d83 expref: 36 pid: 12091 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789477434.041792:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 75 00000100:00100000:1.0:1789477434.041805:0:6711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d50a80050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9bc33f26-0aab-4a14-832f-c58d566de1b0+36:2354:x1876402783735168:12345-192.168.201.23@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789477434.041825:0:6711:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789477434.041833:0:6711:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be4c00/0xafddb3c8f9282377 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2d83 expref: 36 pid: 12091 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477434.041848:0:6711:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be4c00/0xafddb3c8f9282377 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2d83 expref: 36 pid: 12091 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477434.041876:0:6711:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be4c00/0xafddb3c8f9282377 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2d83 expref: 36 pid: 12091 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477434.041897:0:6711:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9d0d44568f00) 00010000:00010000:1.0:1789477434.041903:0:6711:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f518600/0xafddb3c8f92823d2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477434.041914:0:6711:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f518600/0xafddb3c8f92823d2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477434.041922:0:6711:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f518600/0xafddb3c8f92823d2 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477434.041980:0:6711:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789477434.042054:0:6711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d50a80050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9bc33f26-0aab-4a14-832f-c58d566de1b0+35:2354:x1876402783735168:12345-192.168.201.23@tcp:103:ldlm_bl.0 Request processed in 251us (568us total) trans 0 rc 0/0 00000100:00100000:1.0:1789477434.042062:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 75 00010000:00010000:2.0:1789477434.043110:0:5846:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f518600/0xafddb3c8f92823d2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477434.043128:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f518600/0xafddb3c8f92823d2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477434.043170:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f518600/0xafddb3c8f92823d2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477434.043178:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f518600/0xafddb3c8f92823d2 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477434.043185:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f518600/0xafddb3c8f92823d2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477434.043206:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d0d7f518600 already unused, calling callback (ffffffffc1fd54f0) 00010000:00010000:2.0:1789477434.043212:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f518600/0xafddb3c8f92823d2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477434.043220:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f518600/0xafddb3c8f92823d2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477434.043238:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9d0d44568f00) 00010000:00010000:2.0:1789477434.043241:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789477434.043246:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f518600/0xafddb3c8f92823d2 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477434.043253:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f518600/0xafddb3c8f92823d2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789477434.043350:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d75104a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9bc33f26-0aab-4a14-832f-c58d566de1b0+34:11538:x1876402783734784:12345-192.168.201.23@tcp:54:lfs.0 Request processed in 9106us (9335us total) trans 0 rc 0/0 00000100:00100000:2.0:1789477434.043362:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 196 00000100:00100000:2.0:1789477434.048533:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:3.0:1789477434.048804:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783735424 00000100:00100000:3.0:1789477434.048818:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783735424 00000100:00100000:3.0:1789477434.048896:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 53 00000100:00100000:3.0:1789477434.048910:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d7c1fbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9bc33f26-0aab-4a14-832f-c58d566de1b0+34:11538:x1876402783735424:12345-192.168.201.23@tcp:35:lfs.0 00000100:00100000:3.0:1789477434.049709:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d7c1fbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9bc33f26-0aab-4a14-832f-c58d566de1b0+35:11538:x1876402783735424:12345-192.168.201.23@tcp:35:lfs.0 Request processed in 796us (1186us total) trans 4294967479 rc 0/0 00000100:00100000:3.0:1789477434.049721:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 53 00000100:00100000:0.0:1789477434.134392:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:3.0:1789477434.134526:0:12091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783735680 00000100:00100000:3.0:1789477434.134539:0:12091:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783735680 00000100:00100000:3.0:1789477434.134661:0:12091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 197 00000100:00100000:3.0:1789477434.134675:0:12091:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d75105c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9bc33f26-0aab-4a14-832f-c58d566de1b0+35:11549:x1876402783735680:12345-192.168.201.23@tcp:101:cat.0 00010000:00010000:3.0:1789477434.134711:0:12091:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789477434.134741:0:12091:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49ecba00/0xafddb3c8f92823d9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa90d500d7b8f2d9f expref: -99 pid: 12091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477434.134868:0:12091:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49eca000/0xafddb3c8f92823e0 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 12091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477434.134886:0:12091:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49eca000/0xafddb3c8f92823e0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477434.134900:0:12091:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49eca000/0xafddb3c8f92823e0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477434.134916:0:12091:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49eca600/0xafddb3c8f92823e7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477434.134923:0:12091:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49eca600/0xafddb3c8f92823e7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477434.134929:0:12091:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49eca600/0xafddb3c8f92823e7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477434.135660:0:12091:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d59d6a400/0xafddb3c8f92823ee lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477434.135684:0:12091:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d59d6a400/0xafddb3c8f92823ee lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477434.135693:0:12091:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d59d6a400/0xafddb3c8f92823ee lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12091 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789477434.135705:0:12091:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 8 00010000:00010000:3.0:1789477434.135848:0:12091:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49eca000/0xafddb3c8f92823e0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477434.135857:0:12091:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49eca000/0xafddb3c8f92823e0 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 12091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477434.135865:0:12091:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49eca000/0xafddb3c8f92823e0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477434.135871:0:12091:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d0d49eca000 already unused, calling callback (ffffffffc1fd54f0) 00010000:00010000:3.0:1789477434.135876:0:12091:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49eca000/0xafddb3c8f92823e0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477434.135884:0:12091:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49eca000/0xafddb3c8f92823e0 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 12091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477434.135900:0:12091:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9d0d44568d00) 00010000:00010000:3.0:1789477434.135904:0:12091:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789477434.135909:0:12091:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49eca000/0xafddb3c8f92823e0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477434.135916:0:12091:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49eca000/0xafddb3c8f92823e0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477434.135936:0:12091:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49eca600/0xafddb3c8f92823e7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477434.135949:0:12091:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49eca600/0xafddb3c8f92823e7 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477434.135955:0:12091:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49eca600/0xafddb3c8f92823e7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477434.135960:0:12091:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d0d49eca600 already unused, calling callback (ffffffffc1fd54f0) 00010000:00010000:3.0:1789477434.135964:0:12091:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49eca600/0xafddb3c8f92823e7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477434.135970:0:12091:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49eca600/0xafddb3c8f92823e7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477434.135978:0:12091:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9d0d44568000) 00010000:00010000:3.0:1789477434.135980:0:12091:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789477434.135983:0:12091:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49eca600/0xafddb3c8f92823e7 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477434.135989:0:12091:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49eca600/0xafddb3c8f92823e7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477434.136046:0:12091:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49ecba00/0xafddb3c8f92823d9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2d9f expref: 38 pid: 12091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477434.136062:0:12091:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d59d6a400/0xafddb3c8f92823ee lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2d9f expref: 37 pid: 12091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477434.136069:0:12091:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9d0d44568f00) 00010000:00010000:3.0:1789477434.136410:0:12091:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789477434.136421:0:12091:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d0d59d6a400, rc 0) 00000100:00100000:3.0:1789477434.136694:0:12091:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d75105c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9bc33f26-0aab-4a14-832f-c58d566de1b0+37:11549:x1876402783735680:12345-192.168.201.23@tcp:101:cat.0 Request processed in 2019us (2315us total) trans 4294967480 rc 0/0 00000100:00100000:3.0:1789477434.136704:0:12091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 197 00000100:00100000:0.0:1789477434.141356:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:1.0:1789477434.141470:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783735936 00000100:00100000:1.0:1789477434.141485:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783735936 00000100:00100000:1.0:1789477434.141785:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 54 00000100:00100000:1.0:1789477434.141798:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d75106300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9bc33f26-0aab-4a14-832f-c58d566de1b0+37:11549:x1876402783735936:12345-192.168.201.23@tcp:35:cat.0 00000100:00100000:1.0:1789477434.142137:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d75106300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9bc33f26-0aab-4a14-832f-c58d566de1b0+38:11549:x1876402783735936:12345-192.168.201.23@tcp:35:cat.0 Request processed in 340us (795us total) trans 4294967481 rc 0/0 00000100:00100000:1.0:1789477434.142144:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 54 00000100:00100000:2.0:1789477434.157879:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:0.0:1789477434.157997:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783736192 00000100:00100000:0.0:1789477434.158011:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783736192 00000100:00100000:0.0:1789477434.158096:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 198 00000100:00100000:0.0:1789477434.158110:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d7c1fa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9bc33f26-0aab-4a14-832f-c58d566de1b0+38:11550:x1876402783736192:12345-192.168.201.23@tcp:36:rm.0 00010000:00010000:0.0:1789477434.158206:0:5845:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:0.0:1789477434.158246:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d59d6a400/0xafddb3c8f92823ee lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2d9f expref: 38 pid: 12091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477434.158393:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49ecbc00/0xafddb3c8f92823c4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2d98 expref: 37 pid: 6999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477434.158408:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f518c00/0xafddb3c8f928238c lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2d8a expref: 36 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477434.158420:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9d0d44568f00) 00010000:00010000:0.0:1789477434.158434:0:5845:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789477434.158463:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be4800/0xafddb3c8f92823fc lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477434.158500:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be4800/0xafddb3c8f92823fc lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477434.158511:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be4800/0xafddb3c8f92823fc lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477434.158530:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be5800/0xafddb3c8f9282403 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477434.158539:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be5800/0xafddb3c8f9282403 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477434.158545:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be5800/0xafddb3c8f9282403 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477434.159007:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be4c00/0xafddb3c8f928240a lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477434.159016:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be4c00/0xafddb3c8f928240a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477434.159023:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be4c00/0xafddb3c8f928240a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1789477434.161308:0:5845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].7, 64 off8712 00000004:00080000:0.0:1789477434.161333:0:5845:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 379232754393ns, next at 380232748833ns, rc = 0 00010000:00010000:0.0:1789477434.161435:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be5a00/0xafddb3c8f9282411 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477434.161456:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be5a00/0xafddb3c8f9282411 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477434.161882:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be5a00/0xafddb3c8f9282411 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477434.161897:0:5845:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be5a00/0xafddb3c8f9282411 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477434.161904:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be5a00/0xafddb3c8f9282411 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477434.161910:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be5a00/0xafddb3c8f9282411 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477434.162026:0:5845:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789477434.162064:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be4c00/0xafddb3c8f928240a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477434.162084:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be4c00/0xafddb3c8f928240a lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477434.162091:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be4c00/0xafddb3c8f928240a lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477434.162098:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d0d50be4c00 already unused, calling callback (ffffffffc1fd54f0) 00010000:00010000:0.0:1789477434.162102:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be4c00/0xafddb3c8f928240a lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477434.162111:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be4c00/0xafddb3c8f928240a lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477434.162127:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9d0d596ae100) 00010000:00010000:0.0:1789477434.162130:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1789477434.162146:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be4c00/0xafddb3c8f928240a lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477434.162154:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be4c00/0xafddb3c8f928240a lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477434.162180:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be4800/0xafddb3c8f92823fc lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477434.162186:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be4800/0xafddb3c8f92823fc lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477434.162192:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be4800/0xafddb3c8f92823fc lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477434.162196:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d0d50be4800 already unused, calling callback (ffffffffc1fd54f0) 00010000:00010000:0.0:1789477434.162198:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be4800/0xafddb3c8f92823fc lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477434.162204:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be4800/0xafddb3c8f92823fc lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477434.162213:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9d0d44568d00) 00010000:00010000:0.0:1789477434.162215:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789477434.162218:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be4800/0xafddb3c8f92823fc lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477434.162224:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be4800/0xafddb3c8f92823fc lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789477434.162233:0:5845:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000f7735fad reply state 000000006784ca66 transno 4294967482 ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be5800/0xafddb3c8f9282403 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789477434.162382:0:5845:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789477434.162536:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d7c1fa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9bc33f26-0aab-4a14-832f-c58d566de1b0+37:11550:x1876402783736192:12345-192.168.201.23@tcp:36:rm.0 Request processed in 4422us (4666us total) trans 4294967482 rc 0/0 00000100:00100000:0.0:1789477434.162547:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 198 00010000:00010000:3.0:1789477434.170781:0:6710:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789477434.170801:0:6710:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be5a00/0xafddb3c8f9282411 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477434.170814:0:6710:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d0d50be5a00 already unused, calling callback (ffffffffc15972a0) 00010000:00010000:3.0:1789477434.170820:0:6710:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be5a00/0xafddb3c8f9282411 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477434.170831:0:6710:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be5a00/0xafddb3c8f9282411 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477434.170855:0:6710:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9d0d596ae100) 00010000:00010000:3.0:1789477434.170858:0:6710:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1789477434.170863:0:6710:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be5a00/0xafddb3c8f9282411 lrc: 1/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477434.170870:0:6710:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be5a00/0xafddb3c8f9282411 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477434.170900:0:6710:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789477434.170902:0:6710:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789477434.170903:0:6710:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789477434.171721:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be5800/0xafddb3c8f9282403 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477434.171738:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be5800/0xafddb3c8f9282403 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477434.171780:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be5800/0xafddb3c8f9282403 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477434.171786:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d0d50be5800 already unused, calling callback (ffffffffc1fd54f0) 00010000:00010000:3.0:1789477434.171792:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be5800/0xafddb3c8f9282403 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477434.171802:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be5800/0xafddb3c8f9282403 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477434.171818:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9d0d596ae000) 00010000:00010000:3.0:1789477434.171821:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789477434.171826:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be5800/0xafddb3c8f9282403 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477434.171831:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be5800/0xafddb3c8f9282403 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789477434.205338:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:1.0:1789477434.205556:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783736448 00000100:00100000:1.0:1789477434.205571:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783736448 00000100:00100000:1.0:1789477434.205689:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 199 00000100:00100000:1.0:1789477434.205702:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d7c1f9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9bc33f26-0aab-4a14-832f-c58d566de1b0+36:11556:x1876402783736448:12345-192.168.201.23@tcp:101:bash.0 00010000:00010000:1.0:1789477434.205741:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789477434.205781:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f519200/0xafddb3c8f9282418 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa90d500d7b8f2da6 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477434.206101:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f518800/0xafddb3c8f928241f lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477434.206121:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f518800/0xafddb3c8f928241f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477434.206136:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f518800/0xafddb3c8f928241f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477434.206179:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f518c00/0xafddb3c8f9282426 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477434.206187:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f518c00/0xafddb3c8f9282426 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477434.206195:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f518c00/0xafddb3c8f9282426 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1789477434.211056:0:5846:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x5:0x0], index 0: 0 00010000:00010000:1.0:1789477434.213224:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f518000/0xafddb3c8f928242d lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477434.213264:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f518000/0xafddb3c8f928242d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477434.213278:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f518000/0xafddb3c8f928242d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477434.213333:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f518800/0xafddb3c8f928241f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477434.213341:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f518800/0xafddb3c8f928241f lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477434.213349:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f518800/0xafddb3c8f928241f lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477434.213356:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d0d7f518800 already unused, calling callback (ffffffffc1fd54f0) 00010000:00010000:1.0:1789477434.213361:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f518800/0xafddb3c8f928241f lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477434.213403:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f518800/0xafddb3c8f928241f lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477434.213421:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9d0d44568d00) 00010000:00010000:1.0:1789477434.213424:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789477434.213431:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f518800/0xafddb3c8f928241f lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477434.213437:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f518800/0xafddb3c8f928241f lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789477434.213456:0:5846:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000adc418d0 reply state 00000000c9162010 transno 4294967483 ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f518c00/0xafddb3c8f9282426 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789477434.213467:0:5846:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1789477434.213518:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f519200/0xafddb3c8f9282418 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2da6 expref: 39 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477434.213546:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f518000/0xafddb3c8f928242d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2da6 expref: 38 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477434.213554:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9d0d44f4eb00) 00010000:00010000:1.0:1789477434.213556:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789477434.214198:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d0d7f518000, rc 0) 00000100:00100000:1.0:1789477434.214507:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d7c1f9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9bc33f26-0aab-4a14-832f-c58d566de1b0+39:11556:x1876402783736448:12345-192.168.201.23@tcp:101:bash.0 Request processed in 8805us (9183us total) trans 4294967483 rc 0/0 00000100:00100000:1.0:1789477434.214519:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 199 00010000:00010000:3.0:1789477434.222566:0:3296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f518c00/0xafddb3c8f9282426 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477434.222743:0:3296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f518c00/0xafddb3c8f9282426 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477434.222760:0:3296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f518c00/0xafddb3c8f9282426 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477434.222768:0:3296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d0d7f518c00 already unused, calling callback (ffffffffc1fd54f0) 00010000:00010000:3.0:1789477434.222775:0:3296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f518c00/0xafddb3c8f9282426 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477434.222811:0:3296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f518c00/0xafddb3c8f9282426 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477434.222835:0:3296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9d0d44f4e100) 00010000:00010000:3.0:1789477434.222839:0:3296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789477434.222846:0:3296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f518c00/0xafddb3c8f9282426 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477434.222861:0:3296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f518c00/0xafddb3c8f9282426 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789477434.226311:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:1.0:1789477434.226448:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783736576 00000100:00100000:1.0:1789477434.226481:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783736576 00000100:00100000:1.0:1789477434.226667:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 60 00000100:00100000:1.0:1789477434.226684:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d7c1fad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9bc33f26-0aab-4a14-832f-c58d566de1b0+5:2355:x1876402783736576:12345-192.168.201.23@tcp:101:bash.0 00010000:00010000:1.0:1789477434.226710:0:6697:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789477434.226742:0:6697:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000802fb185/0xafddb3c8f928243b lrc: 2/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa90d500d7b8f2dad expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789477434.226795:0:6697:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789477434.226822:0:6697:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=379s v=(0 0) 00010000:00010000:1.0:1789477434.226827:0:6697:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789477434.226840:0:6697:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000802fb185/0xafddb3c8f928243b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2dad expref: 6 pid: 6697 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477434.226864:0:6697:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000802fb185/0xafddb3c8f928243b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2dad expref: 6 pid: 6697 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477434.226882:0:6697:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d0d7f519200, rc 0) 00000100:00100000:1.0:1789477434.226965:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d7c1fad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9bc33f26-0aab-4a14-832f-c58d566de1b0+6:2355:x1876402783736576:12345-192.168.201.23@tcp:101:bash.0 Request processed in 285us (670us total) trans 0 rc 0/0 00000100:00100000:1.0:1789477434.226973:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 60 00000100:00080000:2.0:1789477434.227957:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789477434.231086:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:2.0:1789477434.231909:0:8241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783736704 00000100:00100000:2.0:1789477434.231926:0:8241:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783736704 00000100:00100000:2.0:1789477434.232054:0:8241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 61 00000100:00100000:2.0:1789477434.232067:0:8241:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d75284380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9bc33f26-0aab-4a14-832f-c58d566de1b0+6:11556:x1876402783736704:12345-192.168.201.23@tcp:101:bash.0 00010000:00010000:2.0:1789477434.232100:0:8241:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789477434.232136:0:8241:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006c968605/0xafddb3c8f9282442 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa90d500d7b8f2db4 expref: -99 pid: 8241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477434.232184:0:8241:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000802fb185/0xafddb3c8f928243b lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2dad expref: 7 pid: 6697 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477434.232196:0:8241:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789477434.232201:0:8241:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789477434.232207:0:8241:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006c968605/0xafddb3c8f9282442 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2db4 expref: 7 pid: 8241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477434.232268:0:8241:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000802fb185/0xafddb3c8f928243b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2dad expref: 7 pid: 6697 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477434.232284:0:8241:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000802fb185/0xafddb3c8f928243b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2dad expref: 7 pid: 6697 timeout: 479 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789477434.232302:0:8241:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d7c1f8e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8241:1876402802600960:192.168.201.23@tcp:104: 00000100:00100000:2.0:1789477434.232434:0:8241:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d0d46990b40 going to sleep for 11 seconds 00000100:00100000:2.0:1789477434.235380:0:8241:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d7c1f8e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8241:1876402802600960:192.168.201.23@tcp:104: 00010000:00010000:2.0:1789477434.235443:0:8241:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000006c968605/0xafddb3c8f9282442 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2db4 expref: 7 pid: 8241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477434.235472:0:8241:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d0d41647800, rc 0) 00000100:00100000:2.0:1789477434.235548:0:8241:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d75284380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9bc33f26-0aab-4a14-832f-c58d566de1b0+7:11556:x1876402783736704:12345-192.168.201.23@tcp:101:bash.0 Request processed in 3482us (4476us total) trans 0 rc 0/0 00000100:00100000:2.0:1789477434.236459:0:8241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 61 00000100:00100000:0.0:1789477434.237981:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:3.0:1789477434.238142:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783736832 00000100:00100000:3.0:1789477434.238156:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783736832 00010000:00010000:3.0:1789477434.238214:0:5829:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000802fb185/0xafddb3c8f928243b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2dad expref: 7 pid: 6697 timeout: 479 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789477434.238373:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 76 00000100:00100000:3.0:1789477434.238396:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d75287480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9bc33f26-0aab-4a14-832f-c58d566de1b0+7:2355:x1876402783736832:12345-192.168.201.23@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789477434.238416:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789477434.238449:0:5829:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000802fb185/0xafddb3c8f928243b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2dad expref: 7 pid: 6697 timeout: 479 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477434.238465:0:5829:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000802fb185/0xafddb3c8f928243b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2dad expref: 7 pid: 6697 timeout: 479 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477434.238500:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000802fb185/0xafddb3c8f928243b lrc: 0/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2dad expref: 7 pid: 6697 timeout: 479 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477434.238548:0:5829:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789477434.238553:0:5829:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789477434.238573:0:5829:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000006c968605/0xafddb3c8f9282442 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2db4 expref: 6 pid: 8241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477434.238640:0:5829:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006c968605/0xafddb3c8f9282442 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2db4 expref: 6 pid: 8241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477434.238690:0:5829:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000006c968605/0xafddb3c8f9282442 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2db4 expref: 6 pid: 8241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789477434.238709:0:5829:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d7f702a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:5829:1876402802601088:192.168.201.23@tcp:105: 00000100:00100000:3.0:1789477434.238820:0:5829:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d0d585b2cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1789477434.245852:0:5829:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d7f702a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:5829:1876402802601088:192.168.201.23@tcp:105: 00010000:00010000:3.0:1789477434.245892:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789477434.247719:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:3.0:1789477434.248322:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783737088 00000100:00100000:3.0:1789477434.248341:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783737088 00000100:00100000:3.0:1789477434.248429:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 55 00000100:00100000:3.0:1789477434.248442:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d75284700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9bc33f26-0aab-4a14-832f-c58d566de1b0+38:11556:x1876402783737088:12345-192.168.201.23@tcp:35:bash.0 00000100:00100000:3.0:1789477434.249290:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d75284700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9bc33f26-0aab-4a14-832f-c58d566de1b0+39:11556:x1876402783737088:12345-192.168.201.23@tcp:35:bash.0 Request processed in 528us (1262us total) trans 4294967484 rc 0/0 00000100:00100000:3.0:1789477434.249303:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 55 00000100:00100000:2.0:1789477434.262848:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d75287480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9bc33f26-0aab-4a14-832f-c58d566de1b0+6:2355:x1876402783736832:12345-192.168.201.23@tcp:103:ldlm_bl.0 Request processed in 20578us (20992us total) trans 0 rc 0/0 00000100:00100000:2.0:1789477434.262875:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 76 00000100:00100000:0.0:1789477434.340326:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:1.0:1789477434.340455:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783737216 00000100:00100000:1.0:1789477434.340469:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783737216 00000100:00100000:1.0:1789477434.340549:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 297 00000100:00100000:1.0:1789477434.340572:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d44522450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5c82dded-6a10-4ce8-abd1-52bd956b9523+13:2353:x1876402783737216:12345-192.168.201.23@tcp:400:kworker.0 00000100:00100000:1.0:1789477434.340698:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d44522450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5c82dded-6a10-4ce8-abd1-52bd956b9523+13:2353:x1876402783737216:12345-192.168.201.23@tcp:400:kworker.0 Request processed in 140us (388us total) trans 0 rc 0/0 00000100:00100000:1.0:1789477434.340726:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 297 00000100:00100000:3.0:1789477434.343880:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:1.0:1789477434.344117:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783737344 00000100:00100000:1.0:1789477434.344130:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783737344 00000100:00100000:1.0:1789477434.344203:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 77 00000100:00100000:1.0:1789477434.344215:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d7f702a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9bc33f26-0aab-4a14-832f-c58d566de1b0+9:2352:x1876402783737344:12345-192.168.201.23@tcp:400:kworker.0 00000100:00100000:1.0:1789477434.344326:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d7f702a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9bc33f26-0aab-4a14-832f-c58d566de1b0+9:2352:x1876402783737344:12345-192.168.201.23@tcp:400:kworker.0 Request processed in 113us (463us total) trans 0 rc 0/0 00000100:00100000:1.0:1789477434.344334:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 77 00000100:00100000:0.0:1789477434.349886:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:3.0:1789477434.350301:0:12091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783737472 00000100:00100000:3.0:1789477434.350332:0:12091:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783737472 00000100:00100000:3.0:1789477434.350427:0:12091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 157 00000100:00100000:3.0:1789477434.350440:0:12091:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d75284000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:cf70c55a-e056-446b-8936-49e7cd31fc79+5:2352:x1876402783737472:12345-192.168.201.23@tcp:400:kworker.0 00000100:00100000:3.0:1789477434.350547:0:12091:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d75284000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:cf70c55a-e056-446b-8936-49e7cd31fc79+5:2352:x1876402783737472:12345-192.168.201.23@tcp:400:kworker.0 Request processed in 110us (676us total) trans 0 rc 0/0 00000100:00100000:3.0:1789477434.350800:0:12091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 157 00000100:00080000:2.0:1789477434.351831:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789477434.459533:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:1.0:1789477434.459853:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783737600 00000100:00100000:1.0:1789477434.459868:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783737600 00000100:00100000:3.0:1789477434.460042:0:6999:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 200 00000100:00100000:3.0:1789477434.460058:0:6999:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d75285880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9bc33f26-0aab-4a14-832f-c58d566de1b0+39:11572:x1876402783737600:12345-192.168.201.23@tcp:101:lfs.0 00010000:00010000:3.0:1789477434.460095:0:6999:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789477434.460123:0:6999:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d59d6b600/0xafddb3c8f9282449 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa90d500d7b8f2dbb expref: -99 pid: 6999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477434.460210:0:6999:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d59d6a400/0xafddb3c8f9282450 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477434.460227:0:6999:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d59d6a400/0xafddb3c8f9282450 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477434.460241:0:6999:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d59d6a400/0xafddb3c8f9282450 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789477434.460323:0:6999:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 7680 00000004:00200000:3.0:1789477434.460327:0:6999:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:3.0:1789477434.460355:0:6999:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d59d6a400/0xafddb3c8f9282450 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477434.460387:0:6999:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d59d6b600/0xafddb3c8f9282449 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2dbb expref: 41 pid: 6999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477434.460440:0:6999:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d59d6a400/0xafddb3c8f9282450 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2dbb expref: 40 pid: 6999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477434.460451:0:6999:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9d0d44568d00) 00010000:00010000:3.0:1789477434.460455:0:6999:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789477434.460459:0:6999:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d0d59d6a400, rc 0) 00000100:00100000:3.0:1789477434.460555:0:6999:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d75285880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9bc33f26-0aab-4a14-832f-c58d566de1b0+40:11572:x1876402783737600:12345-192.168.201.23@tcp:101:lfs.0 Request processed in 501us (1050us total) trans 0 rc 0/0 00000100:00100000:3.0:1789477434.460563:0:6999:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 200 00000100:00100000:1.0:1789477434.473508:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:2.0:1789477434.473849:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783737856 00000100:00100000:2.0:1789477434.473866:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783737856 00000100:00100000:2.0:1789477434.473960:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 201 00000100:00100000:2.0:1789477434.473973:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d7536bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9bc33f26-0aab-4a14-832f-c58d566de1b0+40:11572:x1876402783737856:12345-192.168.201.23@tcp:101:lfs.0 00010000:00010000:2.0:1789477434.474001:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789477434.474028:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d41647a00/0xafddb3c8f9282457 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa90d500d7b8f2dc2 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477434.474181:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d41646a00/0xafddb3c8f928245e lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477434.474198:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d41646a00/0xafddb3c8f928245e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477434.474212:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d41646a00/0xafddb3c8f928245e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789477434.474227:0:5846:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:2.0:1789477434.474424:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d41647a00/0xafddb3c8f9282457 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2dc2 expref: 43 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477434.474449:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d41646a00/0xafddb3c8f928245e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2dc2 expref: 42 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477434.474486:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9d0d44f4eb00) 00010000:00010000:2.0:1789477434.474490:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789477434.474494:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d0d41646a00, rc 0) 00000100:00100000:2.0:1789477434.474658:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d7536bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9bc33f26-0aab-4a14-832f-c58d566de1b0+42:11572:x1876402783737856:12345-192.168.201.23@tcp:101:lfs.0 Request processed in 687us (1168us total) trans 4294967485 rc 0/0 00000100:00100000:2.0:1789477434.474667:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 201 00000100:00100000:0.0:1789477434.486801:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:0.0:1789477434.486858:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:3.0:1789477434.487092:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783737984 00000100:00100000:3.0:1789477434.487107:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783737984 00000100:00100000:3.0:1789477434.487202:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 15 00000100:00100000:3.0:1789477434.487214:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d75287800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9bc33f26-0aab-4a14-832f-c58d566de1b0+42:2355:x1876402783737984:12345-192.168.201.23@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789477434.487237:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789477434.487269:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d41646a00/0xafddb3c8f928245e lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2dc2 expref: 42 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477434.487309:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9d0d44f4eb00) 00010000:00010000:3.0:1789477434.487316:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789477434.487399:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d75287800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9bc33f26-0aab-4a14-832f-c58d566de1b0+41:2355:x1876402783737984:12345-192.168.201.23@tcp:103:ldlm_bl.0 Request processed in 187us (613us total) trans 0 rc 0/0 00000100:00100000:3.0:1789477434.487408:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 15 00000100:00100000:1.0:1789477434.487828:0:12091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783738240 00000100:00100000:1.0:1789477434.487836:0:12091:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783738240 00000100:00100000:1.0:1789477434.487880:0:12091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 202 00000100:00100000:1.0:1789477434.487888:0:12091:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d75284a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9bc33f26-0aab-4a14-832f-c58d566de1b0+41:11572:x1876402783738240:12345-192.168.201.23@tcp:101:lfs.0 00010000:00010000:1.0:1789477434.487919:0:12091:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789477434.487950:0:12091:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f518400/0xafddb3c8f928246c lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa90d500d7b8f2dc9 expref: -99 pid: 12091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477434.488081:0:12091:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f519800/0xafddb3c8f9282473 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477434.488098:0:12091:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f519800/0xafddb3c8f9282473 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477434.488112:0:12091:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f519800/0xafddb3c8f9282473 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12091 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789477434.488151:0:12091:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:1.0:1789477434.488435:0:12091:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f518400/0xafddb3c8f928246c lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2dc9 expref: 44 pid: 12091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477434.488455:0:12091:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f519800/0xafddb3c8f9282473 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2dc9 expref: 43 pid: 12091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477434.488464:0:12091:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9d0d44f4eb00) 00010000:00010000:1.0:1789477434.488466:0:12091:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1789477434.488470:0:12091:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d0d7f519800, rc 0) 00000100:00100000:1.0:1789477434.488531:0:12091:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d75284a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9bc33f26-0aab-4a14-832f-c58d566de1b0+43:11572:x1876402783738240:12345-192.168.201.23@tcp:101:lfs.0 Request processed in 643us (1672us total) trans 4294967486 rc 0/0 00000100:00100000:1.0:1789477434.488539:0:12091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 202 00000100:00100000:1.0:1789477434.510058:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:3.0:1789477434.510260:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783738368 00000100:00100000:3.0:1789477434.510273:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783738368 00000100:00100000:3.0:1789477434.510345:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 62 00000100:00100000:3.0:1789477434.510373:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d75369180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9bc33f26-0aab-4a14-832f-c58d566de1b0+6:2354:x1876402783738368:12345-192.168.201.23@tcp:1:lfs.0 00010000:00010000:3.0:1789477434.510433:0:6696:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a29b55f4/0xafddb3c8f9282481 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477434.510458:0:6696:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000006c968605/0xafddb3c8f9282442 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2db4 expref: 6 pid: 8241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477434.510468:0:6696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789477434.510473:0:6696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789477434.510478:0:6696:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a29b55f4/0xafddb3c8f9282481 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477434.510517:0:6696:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000006c968605/0xafddb3c8f9282442 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2db4 expref: 6 pid: 8241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477434.510533:0:6696:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000006c968605/0xafddb3c8f9282442 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2db4 expref: 6 pid: 8241 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789477434.510549:0:6696:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d7f700380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6696:1876402802601216:192.168.201.23@tcp:104: 00000100:00100000:3.0:1789477434.510689:0:6696:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d0d585b2cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1789477434.513728:0:6696:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d7f700380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6696:1876402802601216:192.168.201.23@tcp:104: 00010000:00010000:3.0:1789477434.513781:0:6696:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000a29b55f4/0xafddb3c8f9282481 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789477434.514140:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:2.0:1789477434.514222:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783738496 00000100:00100000:2.0:1789477434.514231:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783738496 00002000:00100000:2.0:1789477434.514310:0:6700:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x5:0x0] (0->8) req@ffff9d0d74e89880 x1876402783738496/t0(0) o4->9bc33f26-0aab-4a14-832f-c58d566de1b0@192.168.201.23@tcp:605/0 lens 504/0 e 0 to 0 dl 1789477445 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789477434.514321:0:6700:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9d0d74e89880 with x1876402783738496 ext(0->8) 00010000:00010000:2.0:1789477434.514330:0:6700:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 000000006c968605/0xafddb3c8f9282442 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2db4 expref: 7 pid: 8241 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477434.514347:0:6700:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 000000006c968605/0xafddb3c8f9282442 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2db4 expref: 7 pid: 8241 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789477434.514355:0:6700:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff9d0d74e89880 00000100:00100000:2.0:1789477434.514393:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 3 00000100:00100000:2.0:1789477434.514404:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d74e89880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:9bc33f26-0aab-4a14-832f-c58d566de1b0+7:2355:x1876402783738496:12345-192.168.201.23@tcp:4:lfs.0 00000100:00100000:2.0:1789477434.515460:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d74e89880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:9bc33f26-0aab-4a14-832f-c58d566de1b0+9:2355:x1876402783738496:12345-192.168.201.23@tcp:4:lfs.0 Request processed in 1049us (1314us total) trans 4294967308 rc 0/0 00000100:00100000:2.0:1789477434.515472:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 3 00002000:00100000:2.0:1789477434.515482:0:6700:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x5:0x0] (0->8) req@ffff9d0d74e89880 x1876402783738496/t4294967308(0) o4->9bc33f26-0aab-4a14-832f-c58d566de1b0@192.168.201.23@tcp:605/0 lens 504/448 e 0 to 0 dl 1789477445 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789477434.515499:0:6700:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9d0d74e89880 with x1876402783738496 ext(0->8) 00010000:00010000:2.0:1789477434.515508:0:6700:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 000000006c968605/0xafddb3c8f9282442 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2db4 expref: 9 pid: 8241 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477434.515527:0:6700:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 000000006c968605/0xafddb3c8f9282442 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2db4 expref: 9 pid: 8241 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789477434.515535:0:6700:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff9d0d74e89880 00000100:00100000:0.0:1789477434.518869:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:1.0:1789477434.520467:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783738624 00000100:00100000:1.0:1789477434.520490:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783738624 00010000:00010000:1.0:1789477434.520564:0:5831:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000006c968605/0xafddb3c8f9282442 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2db4 expref: 9 pid: 8241 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789477434.520669:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 77 00000100:00100000:1.0:1789477434.520682:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d75285f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9bc33f26-0aab-4a14-832f-c58d566de1b0+9:2353:x1876402783738624:12345-192.168.201.23@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789477434.520714:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:1.0:1789477434.520742:0:5831:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:1.0:1789477434.520755:0:5831:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb mtime from disk: 0 -> 1789477433 00002000:00010000:1.0:1789477434.520757:0:5831:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb atime from disk: 0 -> 1789477433 00002000:00010000:1.0:1789477434.520778:0:5831:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb ctime from disk: 0 -> 1789477433 00010000:00010000:1.0:1789477434.520788:0:5831:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000006c968605/0xafddb3c8f9282442 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2db4 expref: 9 pid: 8241 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477434.520804:0:5831:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000006c968605/0xafddb3c8f9282442 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2db4 expref: 9 pid: 8241 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477434.520833:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006c968605/0xafddb3c8f9282442 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2db4 expref: 9 pid: 8241 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477434.520854:0:5831:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789477434.520859:0:5831:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789477434.520865:0:5831:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000a29b55f4/0xafddb3c8f9282481 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477434.520877:0:5831:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a29b55f4/0xafddb3c8f9282481 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477434.520925:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789477434.521136:0:6696:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000a29b55f4/0xafddb3c8f9282481 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477434.521161:0:6696:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a29b55f4/0xafddb3c8f9282481 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477434.521193:0:6696:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a29b55f4/0xafddb3c8f9282481 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477434.521202:0:6696:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a29b55f4/0xafddb3c8f9282481 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477434.521210:0:6696:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a29b55f4/0xafddb3c8f9282481 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477434.521219:0:6696:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d0d59d6b600 already unused, calling callback (ffffffffc15972a0) 00010000:00010000:3.0:1789477434.521224:0:6696:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a29b55f4/0xafddb3c8f9282481 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477434.521234:0:6696:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a29b55f4/0xafddb3c8f9282481 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477434.521247:0:6696:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a29b55f4/0xafddb3c8f9282481 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477434.521254:0:6696:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a29b55f4/0xafddb3c8f9282481 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789477434.521401:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d75369180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9bc33f26-0aab-4a14-832f-c58d566de1b0+8:2354:x1876402783738368:12345-192.168.201.23@tcp:1:lfs.0 Request processed in 11028us (11356us total) trans 0 rc 0/0 00000100:00100000:3.0:1789477434.521414:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 62 00000100:00100000:1.0:1789477434.522545:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d75285f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9bc33f26-0aab-4a14-832f-c58d566de1b0+7:2353:x1876402783738624:12345-192.168.201.23@tcp:103:ldlm_bl.0 Request processed in 1853us (3680us total) trans 0 rc 0/0 00000100:00100000:1.0:1789477434.522559:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 77 00000100:00100000:0.0:1789477434.525186:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:1.0:1789477434.525341:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783738880 00000100:00100000:1.0:1789477434.525357:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783738880 00000100:00100000:1.0:1789477434.525437:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 56 00000100:00100000:1.0:1789477434.525450:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d5845e450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9bc33f26-0aab-4a14-832f-c58d566de1b0+43:11572:x1876402783738880:12345-192.168.201.23@tcp:35:lfs.0 00000004:00010000:1.0:1789477434.525550:0:5848:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0xe:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f519800/0xafddb3c8f9282473 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2dc9 expref: 43 pid: 12091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789477434.526572:0:5848:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967487 00000001:00080000:1.0:1789477434.527161:0:5848:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967488 00000001:00080000:1.0:1789477434.533288:0:5848:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967489 00010000:00010000:1.0:1789477434.533432:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f518a00/0xafddb3c8f9282488 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477434.533458:0:5848:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f518000/0xafddb3c8f928242d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2da6 expref: 47 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477434.533468:0:5848:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f518a00/0xafddb3c8f9282488 lrc: 4/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477434.533521:0:5848:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f518000/0xafddb3c8f928242d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2da6 expref: 47 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477434.533544:0:5848:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f518000/0xafddb3c8f928242d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2da6 expref: 47 pid: 5846 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789477434.533561:0:5848:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d753e3b80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5848:1876402802601344:192.168.201.23@tcp:104: 00000100:00100000:1.0:1789477434.533730:0:5848:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d0d47741e40 going to sleep for 11 seconds 00000100:00100000:0.0:1789477434.543738:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:1.0:1789477434.544005:0:5848:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d753e3b80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5848:1876402802601344:192.168.201.23@tcp:104: 00010000:00010000:1.0:1789477434.544049:0:5848:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f518a00/0xafddb3c8f9282488 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789477434.544338:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783739008 00000100:00100000:3.0:1789477434.544349:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783739008 00010000:00010000:3.0:1789477434.544399:0:5830:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f518000/0xafddb3c8f928242d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2da6 expref: 48 pid: 5846 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789477434.544447:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 78 00000100:00100000:3.0:1789477434.544458:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d75287b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9bc33f26-0aab-4a14-832f-c58d566de1b0+48:2354:x1876402783739008:12345-192.168.201.23@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789477434.544476:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789477434.544484:0:5830:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f518000/0xafddb3c8f928242d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2da6 expref: 48 pid: 5846 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477434.544498:0:5830:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f518000/0xafddb3c8f928242d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2da6 expref: 48 pid: 5846 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477434.545089:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f518000/0xafddb3c8f928242d lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2da6 expref: 48 pid: 5846 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477434.545113:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9d0d44f4eb00) 00010000:00010000:3.0:1789477434.545120:0:5830:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f518a00/0xafddb3c8f9282488 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477434.545132:0:5830:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f518a00/0xafddb3c8f9282488 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477434.545167:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f518a00/0xafddb3c8f9282488 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477434.545206:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789477434.545286:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d75287b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9bc33f26-0aab-4a14-832f-c58d566de1b0+47:2354:x1876402783739008:12345-192.168.201.23@tcp:103:ldlm_bl.0 Request processed in 829us (1564us total) trans 0 rc 0/0 00010000:00010000:1.0:1789477434.545482:0:5848:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f518a00/0xafddb3c8f9282488 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477434.545492:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f518a00/0xafddb3c8f9282488 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789477434.545856:0:5848:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967490 00000001:00080000:1.0:1789477434.546243:0:5848:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967491 00000100:00100000:3.0:1789477434.547893:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 78 00000100:00100000:0.0:1789477434.558131:0:5848:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d75286300 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5848:1876402802601472:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1789477434.558241:0:5848:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789477434.558304:0:5848:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d0d7fb8dd80 going to sleep for 11 seconds 00000100:00100000:3.0:1789477434.558399:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802601472 00000100:00100000:3.0:1789477434.558410:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802601472 00000100:00100000:3.0:1789477434.558515:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1789477434.558528:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d75285500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5848:x1876402802601472:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1789477434.558677:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d75285500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5848:x1876402802601472:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 151us (436us total) trans 0 rc 0/0 00000100:00100000:3.0:1789477434.558686:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00080000:2.0:1789477434.558849:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789477434.559673:0:5848:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d75286300 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5848:1876402802601472:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:0.0:1789477434.560367:0:5848:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967492 00000100:00100000:0.0:1789477434.560485:0:5848:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d75286300 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5848:1876402802601600:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1789477434.560569:0:5848:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789477434.562516:0:5848:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d0d7fb8d600 going to sleep for 11 seconds 00000100:00100000:3.0:1789477434.574924:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802601600 00000100:00100000:3.0:1789477434.574961:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802601600 00000100:00100000:2.0:1789477434.575379:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1789477434.575394:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d75286d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5848:x1876402802601600:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1789477434.575823:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d75286d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:5848:x1876402802601600:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 430us (15251us total) trans 4294967309 rc 0/0 00000100:00100000:2.0:1789477434.575833:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1789477434.576333:0:5848:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d75286300 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5848:1876402802601600:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:0.0:1789477434.576439:0:5848:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967493 00010000:00010000:0.0:1789477434.576525:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f518a00/0xafddb3c8f9282488 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477434.576539:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f518a00/0xafddb3c8f9282488 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477434.576549:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f518a00/0xafddb3c8f9282488 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477434.576557:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d0d7f518a00 already unused, calling callback (ffffffffc1fd54f0) 00010000:00010000:0.0:1789477434.576563:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f518a00/0xafddb3c8f9282488 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477434.576572:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f518a00/0xafddb3c8f9282488 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477434.576636:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9d0d44f4eb00) 00010000:00010000:0.0:1789477434.576639:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:0.0:1789477434.576644:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f518a00/0xafddb3c8f9282488 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477434.576650:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f518a00/0xafddb3c8f9282488 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1789477434.576919:0:5848:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0xf:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:0.0:1789477434.578482:0:5848:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].5, 64 off8512 00000004:00080000:0.0:1789477434.578509:0:5848:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 379649930247ns, next at 380649923857ns, rc = 0 00000001:00080000:0.0:1789477434.578525:0:5848:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967494 00010000:00010000:0.0:1789477434.578855:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9d0d44f4eb00) 00010000:00010000:0.0:1789477434.578862:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1789477434.578874:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f519800/0xafddb3c8f9282473 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2dc9 expref: 51 pid: 12091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789477434.580098:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d5845e450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9bc33f26-0aab-4a14-832f-c58d566de1b0+50:11572:x1876402783738880:12345-192.168.201.23@tcp:35:lfs.0 Request processed in 54637us (54915us total) trans 4294967495 rc 0/0 00000100:00100000:0.0:1789477434.580116:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 56 00000020:00080000:0.0:1789477434.580125:0:5848:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:0.0:1789477434.589491:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:1.0:1789477434.590255:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783739136 00000100:00100000:1.0:1789477434.590272:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783739136 00000100:00100000:1.0:1789477434.590365:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 203 00000100:00100000:1.0:1789477434.590379:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d75284700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9bc33f26-0aab-4a14-832f-c58d566de1b0+50:11572:x1876402783739136:12345-192.168.201.23@tcp:101:lfs.0 00010000:00010000:1.0:1789477434.590418:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789477434.590451:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f519800/0xafddb3c8f928248f lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa90d500d7b8f2dd0 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477434.590536:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f519800/0xafddb3c8f928248f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2dd0 expref: 51 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477434.590554:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f519800/0xafddb3c8f928248f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2dd0 expref: 51 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477434.590650:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9d0d44f4e500) 00010000:00010000:1.0:1789477434.590654:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789477434.590659:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d0d7f519800, rc 0) 00000100:00100000:1.0:1789477434.590777:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d75284700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9bc33f26-0aab-4a14-832f-c58d566de1b0+51:11572:x1876402783739136:12345-192.168.201.23@tcp:101:lfs.0 Request processed in 400us (1300us total) trans 0 rc 0/0 00000100:00100000:1.0:1789477434.590786:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 203 00000100:00100000:1.0:1789477434.594923:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:3.0:1789477434.595194:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783739392 00000100:00100000:3.0:1789477434.595209:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783739392 00000100:00100000:3.0:1789477434.595290:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 57 00000100:00100000:3.0:1789477434.595302:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d753e3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9bc33f26-0aab-4a14-832f-c58d566de1b0+51:11572:x1876402783739392:12345-192.168.201.23@tcp:35:lfs.0 00000100:00100000:3.0:1789477434.595688:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d753e3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9bc33f26-0aab-4a14-832f-c58d566de1b0+52:11572:x1876402783739392:12345-192.168.201.23@tcp:35:lfs.0 Request processed in 386us (778us total) trans 4294967496 rc 0/0 00000100:00100000:3.0:1789477434.595698:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 57 00000100:00100000:0.0:1789477434.767809:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:3.0:1789477434.767911:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783739520 00000100:00100000:3.0:1789477434.767925:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783739520 00000100:00100000:3.0:1789477434.768521:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 204 00000100:00100000:3.0:1789477434.768535:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d75284e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9bc33f26-0aab-4a14-832f-c58d566de1b0+52:11582:x1876402783739520:12345-192.168.201.23@tcp:34:lfs.0 00010000:00010000:3.0:1789477434.768712:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d59d6b600/0xafddb3c8f9282496 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477434.768747:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d59d6b600/0xafddb3c8f9282496 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477434.768766:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d59d6b600/0xafddb3c8f9282496 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477434.768791:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49ecbc00/0xafddb3c8f928249d lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477434.768800:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49ecbc00/0xafddb3c8f928249d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477434.768807:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49ecbc00/0xafddb3c8f928249d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477434.768957:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49ecba00/0xafddb3c8f92824a4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477434.768966:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49ecba00/0xafddb3c8f92824a4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477434.768973:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49ecba00/0xafddb3c8f92824a4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789477434.770369:0:5844:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49ecba00/0xafddb3c8f92824a4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477434.770399:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d59d6b600/0xafddb3c8f9282496 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477434.770431:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d59d6b600/0xafddb3c8f9282496 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477434.770439:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d59d6b600/0xafddb3c8f9282496 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477434.770446:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d0d59d6b600 already unused, calling callback (ffffffffc1fd54f0) 00010000:00010000:3.0:1789477434.770450:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d59d6b600/0xafddb3c8f9282496 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477434.770459:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d59d6b600/0xafddb3c8f9282496 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477434.770477:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9d0d44568d00) 00010000:00010000:3.0:1789477434.770480:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789477434.770486:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d59d6b600/0xafddb3c8f9282496 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477434.770492:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d59d6b600/0xafddb3c8f9282496 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477434.770517:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49ecbc00/0xafddb3c8f928249d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477434.770525:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49ecbc00/0xafddb3c8f928249d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477434.770531:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49ecbc00/0xafddb3c8f928249d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477434.770536:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d0d49ecbc00 already unused, calling callback (ffffffffc1fd54f0) 00010000:00010000:3.0:1789477434.770547:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49ecbc00/0xafddb3c8f928249d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477434.770553:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49ecbc00/0xafddb3c8f928249d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477434.770562:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9d0d44568000) 00010000:00010000:3.0:1789477434.770564:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789477434.770568:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49ecbc00/0xafddb3c8f928249d lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477434.770574:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49ecbc00/0xafddb3c8f928249d lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477434.770638:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49ecba00/0xafddb3c8f92824a4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477434.770644:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49ecba00/0xafddb3c8f92824a4 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477434.770650:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49ecba00/0xafddb3c8f92824a4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477434.770655:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d0d49ecba00 already unused, calling callback (ffffffffc1fd54f0) 00010000:00010000:3.0:1789477434.770658:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49ecba00/0xafddb3c8f92824a4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477434.770664:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49ecba00/0xafddb3c8f92824a4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477434.770672:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9d0d44f4e500) 00010000:00010000:3.0:1789477434.770674:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789477434.770684:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49ecba00/0xafddb3c8f92824a4 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477434.770690:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49ecba00/0xafddb3c8f92824a4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789477434.770832:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d75284e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9bc33f26-0aab-4a14-832f-c58d566de1b0+52:11582:x1876402783739520:12345-192.168.201.23@tcp:34:lfs.0 Request processed in 2292us (3032us total) trans 0 rc 0/0 00000100:00100000:3.0:1789477434.770843:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 204 00000100:00100000:2.0:1789477434.818806:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:3.0:1789477434.819081:0:6999:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783739776 00000100:00100000:3.0:1789477434.819095:0:6999:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783739776 00000100:00100000:3.0:1789477434.819174:0:6999:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 205 00000100:00100000:3.0:1789477434.819297:0:6999:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d7c1f8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9bc33f26-0aab-4a14-832f-c58d566de1b0+52:11585:x1876402783739776:12345-192.168.201.23@tcp:101:lfs.0 00010000:00010000:3.0:1789477434.819326:0:6999:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789477434.819355:0:6999:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49ecba00/0xafddb3c8f92824ab lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa90d500d7b8f2dd7 expref: -99 pid: 6999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477434.819487:0:6999:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49ecbc00/0xafddb3c8f92824b2 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477434.819518:0:6999:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49ecbc00/0xafddb3c8f92824b2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477434.819533:0:6999:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49ecbc00/0xafddb3c8f92824b2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477434.819551:0:6999:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49eca600/0xafddb3c8f92824b9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477434.819558:0:6999:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49eca600/0xafddb3c8f92824b9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477434.819621:0:6999:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49eca600/0xafddb3c8f92824b9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477434.819799:0:6999:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49eca000/0xafddb3c8f92824c0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477434.819808:0:6999:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49eca000/0xafddb3c8f92824c0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477434.819815:0:6999:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49eca000/0xafddb3c8f92824c0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789477434.819828:0:6999:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:3.0:1789477434.819959:0:6999:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49ecbc00/0xafddb3c8f92824b2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477434.819968:0:6999:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49ecbc00/0xafddb3c8f92824b2 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477434.819975:0:6999:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49ecbc00/0xafddb3c8f92824b2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477434.819982:0:6999:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d0d49ecbc00 already unused, calling callback (ffffffffc1fd54f0) 00010000:00010000:3.0:1789477434.819987:0:6999:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49ecbc00/0xafddb3c8f92824b2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477434.819994:0:6999:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49ecbc00/0xafddb3c8f92824b2 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477434.820009:0:6999:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9d0d44568d00) 00010000:00010000:3.0:1789477434.820013:0:6999:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789477434.820025:0:6999:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49ecbc00/0xafddb3c8f92824b2 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477434.820032:0:6999:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49ecbc00/0xafddb3c8f92824b2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477434.820054:0:6999:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49eca600/0xafddb3c8f92824b9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477434.820060:0:6999:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49eca600/0xafddb3c8f92824b9 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477434.820067:0:6999:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49eca600/0xafddb3c8f92824b9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477434.820073:0:6999:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d0d49eca600 already unused, calling callback (ffffffffc1fd54f0) 00010000:00010000:3.0:1789477434.820076:0:6999:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49eca600/0xafddb3c8f92824b9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477434.820081:0:6999:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49eca600/0xafddb3c8f92824b9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477434.820090:0:6999:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9d0d44568000) 00010000:00010000:3.0:1789477434.820092:0:6999:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789477434.820095:0:6999:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49eca600/0xafddb3c8f92824b9 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477434.820102:0:6999:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49eca600/0xafddb3c8f92824b9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477434.820155:0:6999:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49ecba00/0xafddb3c8f92824ab lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2dd7 expref: 55 pid: 6999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477434.820199:0:6999:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49eca000/0xafddb3c8f92824c0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2dd7 expref: 54 pid: 6999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477434.820207:0:6999:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9d0d44f4e500) 00010000:00010000:3.0:1789477434.820210:0:6999:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789477434.820212:0:6999:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d0d49eca000, rc 0) 00000100:00100000:3.0:1789477434.820285:0:6999:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d7c1f8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9bc33f26-0aab-4a14-832f-c58d566de1b0+54:11585:x1876402783739776:12345-192.168.201.23@tcp:101:lfs.0 Request processed in 993us (1495us total) trans 4294967497 rc 0/0 00000100:00100000:3.0:1789477434.824114:0:6999:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 205 00000100:00100000:1.0:1789477434.835574:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:2.0:1789477434.836262:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783739904 00000100:00100000:2.0:1789477434.836279:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783739904 00000100:00100000:2.0:1789477434.836366:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 206 00000100:00100000:2.0:1789477434.836379:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d623c9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9bc33f26-0aab-4a14-832f-c58d566de1b0+54:11585:x1876402783739904:12345-192.168.201.23@tcp:54:lfs.0 00010000:00010000:2.0:1789477434.836481:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d41647a00/0xafddb3c8f92824ce lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477434.837079:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d41647a00/0xafddb3c8f92824ce lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477434.837096:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d41647a00/0xafddb3c8f92824ce lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477434.837155:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d41647a00/0xafddb3c8f92824ce lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477434.837163:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d41647a00/0xafddb3c8f92824ce lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477434.837171:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d41647a00/0xafddb3c8f92824ce lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477434.837284:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d0d41647a00 already unused, calling callback (ffffffffc1fd54f0) 00010000:00010000:2.0:1789477434.837290:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d41647a00/0xafddb3c8f92824ce lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477434.837300:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d41647a00/0xafddb3c8f92824ce lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477434.837316:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9d0d44f4e500) 00010000:00010000:2.0:1789477434.837319:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789477434.837325:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d41647a00/0xafddb3c8f92824ce lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477434.837333:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d41647a00/0xafddb3c8f92824ce lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789477434.837456:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d623c9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9bc33f26-0aab-4a14-832f-c58d566de1b0+54:11585:x1876402783739904:12345-192.168.201.23@tcp:54:lfs.0 Request processed in 1075us (2480us total) trans 0 rc 0/0 00000100:00100000:2.0:1789477434.837466:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 206 00000100:00100000:0.0:1789477434.843356:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:3.0:1789477434.847943:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783740160 00000100:00100000:3.0:1789477434.847965:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783740160 00000100:00100000:2.0:1789477434.856024:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 58 00000100:00100000:2.0:1789477434.856044:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d75285180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9bc33f26-0aab-4a14-832f-c58d566de1b0+54:11585:x1876402783740160:12345-192.168.201.23@tcp:35:lfs.0 00000100:00100000:2.0:1789477434.856834:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d75285180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9bc33f26-0aab-4a14-832f-c58d566de1b0+55:11585:x1876402783740160:12345-192.168.201.23@tcp:35:lfs.0 Request processed in 792us (13492us total) trans 4294967498 rc 0/0 00000100:00100000:2.0:1789477434.856844:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 58 00000100:00100000:0.0:1789477434.986723:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:3.0:1789477434.988122:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783740416 00000100:00100000:3.0:1789477434.988143:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783740416 00000100:00100000:3.0:1789477434.988233:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 207 00000100:00100000:3.0:1789477434.988248:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d75286680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9bc33f26-0aab-4a14-832f-c58d566de1b0+55:11595:x1876402783740416:12345-192.168.201.23@tcp:101:bash.0 00010000:00010000:3.0:1789477434.988283:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789477434.988288:0:5844:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1789477434.988326:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d59d6a400/0xafddb3c8f9282450 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2dbb expref: 55 pid: 6999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477434.988359:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9d0d44568d00) 00010000:00010000:3.0:1789477434.988366:0:5844:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789477434.988383:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49ecba00/0xafddb3c8f92824d5 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa90d500d7b8f2dde expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477434.988546:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49eca600/0xafddb3c8f92824dc lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477434.988639:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49eca600/0xafddb3c8f92824dc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477434.988652:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49eca600/0xafddb3c8f92824dc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789477434.988668:0:5844:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:3.0:1789477434.988876:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49ecba00/0xafddb3c8f92824d5 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2dde expref: 57 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477434.988893:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49eca600/0xafddb3c8f92824dc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2dde expref: 56 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477434.988902:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9d0d44f4e500) 00010000:00010000:3.0:1789477434.988906:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789477434.988908:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d0d49eca600, rc 0) 00000100:00100000:3.0:1789477434.989004:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d75286680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9bc33f26-0aab-4a14-832f-c58d566de1b0+56:11595:x1876402783740416:12345-192.168.201.23@tcp:101:bash.0 Request processed in 759us (2295us total) trans 4294967499 rc 0/0 00000100:00100000:3.0:1789477434.989013:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 207 00000100:00100000:1.0:1789477434.994319:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:2.0:1789477434.996093:0:6999:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783740672 00000100:00100000:2.0:1789477434.996127:0:6999:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783740672 00000100:00100000:2.0:1789477434.996242:0:6999:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 208 00000100:00100000:2.0:1789477434.996256:0:6999:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d623cad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9bc33f26-0aab-4a14-832f-c58d566de1b0+56:11595:x1876402783740672:12345-192.168.201.23@tcp:36:bash.0 00010000:00010000:2.0:1789477434.996347:0:6999:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:2.0:1789477434.996384:0:6999:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49eca600/0xafddb3c8f92824dc lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2dde expref: 56 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477434.996420:0:6999:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49eca000/0xafddb3c8f92824c0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2dd7 expref: 55 pid: 6999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477434.996434:0:6999:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9d0d44f4e500) 00010000:00010000:2.0:1789477434.996440:0:6999:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789477434.996981:0:6999:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d41647800/0xafddb3c8f92824ea lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477434.997000:0:6999:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d41647800/0xafddb3c8f92824ea lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477434.997012:0:6999:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d41647800/0xafddb3c8f92824ea lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789477434.997077:0:6999:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967500 00000004:00010000:2.0:1789477434.997108:0:6999:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000002bf4853a reply state 0000000035349d6e transno 4294967501 ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d41647800/0xafddb3c8f92824ea lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789477434.997155:0:6999:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789477434.997288:0:6999:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d623cad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9bc33f26-0aab-4a14-832f-c58d566de1b0+57:11595:x1876402783740672:12345-192.168.201.23@tcp:36:bash.0 Request processed in 1033us (2984us total) trans 4294967501 rc 0/0 00000100:00100000:2.0:1789477434.997297:0:6999:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 208 00000020:00080000:2.0:1789477434.997302:0:6999:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1789477435.008079:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d41647800/0xafddb3c8f92824ea lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477435.008103:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d41647800/0xafddb3c8f92824ea lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477435.008118:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d41647800/0xafddb3c8f92824ea lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477435.008125:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d0d41647800 already unused, calling callback (ffffffffc1fd54f0) 00010000:00010000:3.0:1789477435.008150:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d41647800/0xafddb3c8f92824ea lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477435.008159:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d41647800/0xafddb3c8f92824ea lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477435.008189:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9d0d44f4e500) 00010000:00010000:3.0:1789477435.008192:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789477435.008197:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d41647800/0xafddb3c8f92824ea lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477435.008204:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d41647800/0xafddb3c8f92824ea lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789477435.011552:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:2.0:1789477435.011952:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783740800 00000100:00100000:2.0:1789477435.011966:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783740800 00000100:00100000:2.0:1789477435.012061:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 209 00000100:00100000:2.0:1789477435.012075:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d6d464e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9bc33f26-0aab-4a14-832f-c58d566de1b0+56:11595:x1876402783740800:12345-192.168.201.23@tcp:101:bash.0 00010000:00010000:2.0:1789477435.012108:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789477435.012144:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d41646a00/0xafddb3c8f92824f1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa90d500d7b8f2de5 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477435.012297:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d41647000/0xafddb3c8f92824f8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477435.012317:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d41647000/0xafddb3c8f92824f8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477435.012333:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d41647000/0xafddb3c8f92824f8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789477435.012373:0:5846:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:2.0:1789477435.012378:0:5846:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1789477435.012404:0:5846:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d41647000/0xafddb3c8f92824f8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477435.012438:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d41646a00/0xafddb3c8f92824f1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2de5 expref: 58 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477435.012476:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d41647000/0xafddb3c8f92824f8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2de5 expref: 57 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477435.012489:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9d0d44f4e500) 00010000:00010000:2.0:1789477435.012493:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789477435.012497:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d0d41647000, rc 0) 00000100:00100000:2.0:1789477435.012613:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d6d464e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9bc33f26-0aab-4a14-832f-c58d566de1b0+57:11595:x1876402783740800:12345-192.168.201.23@tcp:101:bash.0 Request processed in 540us (1079us total) trans 0 rc 0/0 00000100:00100000:2.0:1789477435.012621:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 209 00000100:00080000:3.0:1789477435.015394:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789477435.017262:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:3.0:1789477435.017317:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783741056 00000100:00100000:3.0:1789477435.017332:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783741056 00000100:00100000:3.0:1789477435.017403:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 59 00000100:00100000:3.0:1789477435.017418:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d7f700380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9bc33f26-0aab-4a14-832f-c58d566de1b0+57:11595:x1876402783741056:12345-192.168.201.23@tcp:35:bash.0 00000100:00100000:3.0:1789477435.017812:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d7f700380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9bc33f26-0aab-4a14-832f-c58d566de1b0+58:11595:x1876402783741056:12345-192.168.201.23@tcp:35:bash.0 Request processed in 396us (564us total) trans 4294967502 rc 0/0 00000100:00100000:3.0:1789477435.017822:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 59 00010000:00010000:1.0:1789477435.058088:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789477435.151020:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:1.0:1789477435.152663:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783741184 00000100:00100000:1.0:1789477435.152684:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783741184 00000100:00100000:1.0:1789477435.152812:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 210 00000100:00100000:1.0:1789477435.152826:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d7c1f9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9bc33f26-0aab-4a14-832f-c58d566de1b0+58:11601:x1876402783741184:12345-192.168.201.23@tcp:101:lfs.0 00010000:00010000:1.0:1789477435.152862:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789477435.152891:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f518000/0xafddb3c8f92824ff lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa90d500d7b8f2dec expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477435.152978:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f518400/0xafddb3c8f9282506 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477435.152998:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f518400/0xafddb3c8f9282506 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477435.153013:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f518400/0xafddb3c8f9282506 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789477435.153173:0:5845:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 7680 00000004:00200000:1.0:1789477435.153179:0:5845:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:1.0:1789477435.153207:0:5845:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f518400/0xafddb3c8f9282506 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477435.153405:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f518000/0xafddb3c8f92824ff lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2dec expref: 60 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477435.153430:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f518400/0xafddb3c8f9282506 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2dec expref: 59 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477435.153440:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9d0d44568d00) 00010000:00010000:1.0:1789477435.153461:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789477435.153466:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d0d7f518400, rc 0) 00000100:00100000:1.0:1789477435.154458:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d7c1f9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9bc33f26-0aab-4a14-832f-c58d566de1b0+59:11601:x1876402783741184:12345-192.168.201.23@tcp:101:lfs.0 Request processed in 1626us (3446us total) trans 0 rc 0/0 00000100:00100000:1.0:1789477435.154469:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 210 00000100:00100000:3.0:1789477435.160747:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:1.0:1789477435.160878:0:12091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783741312 00000100:00100000:1.0:1789477435.160893:0:12091:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783741312 00000100:00100000:1.0:1789477435.160963:0:12091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 211 00000100:00100000:1.0:1789477435.160975:0:12091:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d7f701880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9bc33f26-0aab-4a14-832f-c58d566de1b0+59:11601:x1876402783741312:12345-192.168.201.23@tcp:101:lfs.0 00010000:00010000:1.0:1789477435.161002:0:12091:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789477435.161030:0:12091:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f518600/0xafddb3c8f928250d lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa90d500d7b8f2df3 expref: -99 pid: 12091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477435.161134:0:12091:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f518800/0xafddb3c8f9282514 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 12091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477435.161153:0:12091:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f518800/0xafddb3c8f9282514 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 12091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477435.161168:0:12091:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f518800/0xafddb3c8f9282514 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 12091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477435.161187:0:12091:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f519200/0xafddb3c8f928251b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477435.161195:0:12091:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f519200/0xafddb3c8f928251b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477435.161201:0:12091:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f519200/0xafddb3c8f928251b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477435.161361:0:12091:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f518c00/0xafddb3c8f9282522 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477435.161372:0:12091:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f518c00/0xafddb3c8f9282522 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477435.161379:0:12091:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f518c00/0xafddb3c8f9282522 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12091 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789477435.161428:0:12091:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:1.0:1789477435.161434:0:12091:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1789477435.161459:0:12091:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f518c00/0xafddb3c8f9282522 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477435.161474:0:12091:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f518c00/0xafddb3c8f9282522 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477435.161483:0:12091:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f518800/0xafddb3c8f9282514 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 12091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477435.161491:0:12091:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f518800/0xafddb3c8f9282514 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 12091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477435.161498:0:12091:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f518800/0xafddb3c8f9282514 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 12091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477435.161505:0:12091:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d0d7f518800 already unused, calling callback (ffffffffc1fd54f0) 00010000:00010000:1.0:1789477435.161509:0:12091:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f518800/0xafddb3c8f9282514 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 12091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477435.161518:0:12091:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f518800/0xafddb3c8f9282514 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 12091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477435.161543:0:12091:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9d0d44568d00) 00010000:00010000:1.0:1789477435.161564:0:12091:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789477435.161571:0:12091:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f518800/0xafddb3c8f9282514 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 12091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477435.161622:0:12091:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f518800/0xafddb3c8f9282514 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 12091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477435.161638:0:12091:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f519200/0xafddb3c8f928251b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477435.161645:0:12091:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f519200/0xafddb3c8f928251b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477435.161651:0:12091:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f519200/0xafddb3c8f928251b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477435.161657:0:12091:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d0d7f519200 already unused, calling callback (ffffffffc1fd54f0) 00010000:00010000:1.0:1789477435.161660:0:12091:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f519200/0xafddb3c8f928251b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477435.161666:0:12091:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f519200/0xafddb3c8f928251b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477435.161674:0:12091:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9d0d44f4e800) 00010000:00010000:1.0:1789477435.161676:0:12091:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789477435.161679:0:12091:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f519200/0xafddb3c8f928251b lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477435.161685:0:12091:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f519200/0xafddb3c8f928251b lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477435.161728:0:12091:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f518600/0xafddb3c8f928250d lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2df3 expref: 61 pid: 12091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477435.161756:0:12091:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f518c00/0xafddb3c8f9282522 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2df3 expref: 60 pid: 12091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477435.161765:0:12091:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9d0d44f4e500) 00010000:00010000:1.0:1789477435.161767:0:12091:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789477435.161770:0:12091:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d0d7f518c00, rc 0) 00000100:00100000:1.0:1789477435.161855:0:12091:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d7f701880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9bc33f26-0aab-4a14-832f-c58d566de1b0+60:11601:x1876402783741312:12345-192.168.201.23@tcp:101:lfs.0 Request processed in 881us (1135us total) trans 0 rc 0/0 00000100:00100000:1.0:1789477435.161863:0:12091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 211 00000100:00100000:3.0:1789477435.170089:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:3.0:1789477435.170183:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:2.0:1789477435.170795:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783741696 00000100:00100000:2.0:1789477435.170812:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783741696 00000100:00100000:2.0:1789477435.170905:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 16 00000100:00100000:2.0:1789477435.170917:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d7f700000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9bc33f26-0aab-4a14-832f-c58d566de1b0+60:2353:x1876402783741696:12345-192.168.201.23@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789477435.170939:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789477435.170971:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f518c00/0xafddb3c8f9282522 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2df3 expref: 60 pid: 12091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477435.170996:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9d0d44f4e500) 00010000:00010000:2.0:1789477435.171002:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789477435.171081:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d7f700000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9bc33f26-0aab-4a14-832f-c58d566de1b0+59:2353:x1876402783741696:12345-192.168.201.23@tcp:103:ldlm_bl.0 Request processed in 166us (896us total) trans 0 rc 0/0 00000100:00100000:2.0:1789477435.171089:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 16 00000100:00100000:1.0:1789477435.171294:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783741568 00000100:00100000:1.0:1789477435.171301:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783741568 00000100:00100000:1.0:1789477435.171348:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 212 00000100:00100000:1.0:1789477435.171356:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d7f703100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9bc33f26-0aab-4a14-832f-c58d566de1b0+59:11601:x1876402783741568:12345-192.168.201.23@tcp:101:lfs.0 00010000:00010000:1.0:1789477435.171381:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789477435.171403:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f519400/0xafddb3c8f9282529 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa90d500d7b8f2dfa expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477435.171547:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f518a00/0xafddb3c8f9282530 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477435.171566:0:5844:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d41647000/0xafddb3c8f92824f8 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2de5 expref: 60 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477435.171605:0:5844:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f518a00/0xafddb3c8f9282530 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477435.171672:0:5844:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d41647000/0xafddb3c8f92824f8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2de5 expref: 60 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477435.171687:0:5844:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d41647000/0xafddb3c8f92824f8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2de5 expref: 60 pid: 5846 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789477435.171705:0:5844:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d58245500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5844:1876402802601728:192.168.201.23@tcp:104: 00000100:00100000:1.0:1789477435.171810:0:5844:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d0d47741480 going to sleep for 11 seconds 00000100:00100000:0.0:1789477435.174844:0:5844:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d58245500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5844:1876402802601728:192.168.201.23@tcp:104: 00010000:00010000:0.0:1789477435.174891:0:5844:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f518a00/0xafddb3c8f9282530 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789477435.177347:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:2.0:1789477435.177443:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783741824 00000100:00100000:2.0:1789477435.177456:0:6711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783741824 00010000:00010000:2.0:1789477435.177540:0:6711:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d41647000/0xafddb3c8f92824f8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2de5 expref: 61 pid: 5846 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789477435.177620:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 79 00000100:00100000:2.0:1789477435.177632:0:6711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d7c3e5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9bc33f26-0aab-4a14-832f-c58d566de1b0+61:2355:x1876402783741824:12345-192.168.201.23@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789477435.177654:0:6711:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789477435.177663:0:6711:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d41647000/0xafddb3c8f92824f8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2de5 expref: 61 pid: 5846 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477435.177677:0:6711:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d41647000/0xafddb3c8f92824f8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2de5 expref: 61 pid: 5846 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477435.177706:0:6711:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d41647000/0xafddb3c8f92824f8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2de5 expref: 61 pid: 5846 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477435.177728:0:6711:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9d0d44f4e500) 00010000:00010000:2.0:1789477435.177744:0:6711:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f518a00/0xafddb3c8f9282530 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477435.177755:0:6711:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f518a00/0xafddb3c8f9282530 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477435.177763:0:6711:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f518a00/0xafddb3c8f9282530 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477435.177793:0:6711:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789477435.177870:0:6711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d7c3e5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9bc33f26-0aab-4a14-832f-c58d566de1b0+60:2355:x1876402783741824:12345-192.168.201.23@tcp:103:ldlm_bl.0 Request processed in 240us (538us total) trans 0 rc 0/0 00000100:00100000:2.0:1789477435.177879:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 79 00010000:00010000:0.0:1789477435.178032:0:5844:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f518a00/0xafddb3c8f9282530 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477435.178042:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f518a00/0xafddb3c8f9282530 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789477435.178068:0:5844:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:0.0:1789477435.178267:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f519400/0xafddb3c8f9282529 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2dfa expref: 61 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477435.178287:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f518a00/0xafddb3c8f9282530 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2dfa expref: 60 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477435.178295:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9d0d44f4e500) 00010000:00010000:0.0:1789477435.178297:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1789477435.178308:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d0d7f518a00, rc 0) 00000100:00100000:0.0:1789477435.178339:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d7f703100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9bc33f26-0aab-4a14-832f-c58d566de1b0+60:11601:x1876402783741568:12345-192.168.201.23@tcp:101:lfs.0 Request processed in 6985us (8265us total) trans 4294967503 rc 0/0 00000100:00100000:0.0:1789477435.178346:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 212 00000100:00100000:3.0:1789477435.181401:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:2.0:1789477435.181657:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783742080 00000100:00100000:2.0:1789477435.181670:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783742080 00000100:00100000:2.0:1789477435.181763:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 17 00000100:00100000:2.0:1789477435.181776:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d50a83050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9bc33f26-0aab-4a14-832f-c58d566de1b0+60:11601:x1876402783742080:12345-192.168.201.23@tcp:103:lfs.0 00010000:00010000:2.0:1789477435.181799:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789477435.181829:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f519800/0xafddb3c8f928248f lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2dd0 expref: 60 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477435.181854:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9d0d44f4e500) 00010000:00010000:2.0:1789477435.181860:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789477435.181926:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d50a83050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9bc33f26-0aab-4a14-832f-c58d566de1b0+59:11601:x1876402783742080:12345-192.168.201.23@tcp:103:lfs.0 Request processed in 152us (540us total) trans 0 rc 0/0 00000100:00100000:2.0:1789477435.181934:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 17 00000100:00100000:1.0:1789477435.189042:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:0.0:1789477435.189220:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783742208 00000100:00100000:0.0:1789477435.189236:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783742208 00000100:00100000:0.0:1789477435.189313:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 213 00000100:00100000:0.0:1789477435.189325:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d58245500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9bc33f26-0aab-4a14-832f-c58d566de1b0+59:11601:x1876402783742208:12345-192.168.201.23@tcp:58:lfs.0 00010000:00010000:0.0:1789477435.189464:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be5800/0xafddb3c8f928253e lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477435.189498:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be5800/0xafddb3c8f928253e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477435.189512:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be5800/0xafddb3c8f928253e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1789477435.189818:0:5845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5, 136 off8872 00000100:00100000:0.0:1789477435.189928:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d58245500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9bc33f26-0aab-4a14-832f-c58d566de1b0+59:11601:x1876402783742208:12345-192.168.201.23@tcp:58:lfs.0 Request processed in 605us (899us total) trans 0 rc 0/0 00000100:00100000:0.0:1789477435.189937:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 213 00000100:00100000:1.0:1789477435.197699:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:2.0:1789477435.197832:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783742336 00000100:00100000:2.0:1789477435.197847:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783742336 00000100:00100000:2.0:1789477435.197929:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 214 00000100:00100000:2.0:1789477435.197941:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d4766b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9bc33f26-0aab-4a14-832f-c58d566de1b0+59:11601:x1876402783742336:12345-192.168.201.23@tcp:101:lfs.0 00010000:00010000:2.0:1789477435.197970:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789477435.197998:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d41647000/0xafddb3c8f9282545 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa90d500d7b8f2e01 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477435.198089:0:5846:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be5800/0xafddb3c8f928253e lrc: 2/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477435.198101:0:5846:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d41647000/0xafddb3c8f9282545 lrc: 4/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2e01 expref: 60 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477435.198123:0:5846:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be5800/0xafddb3c8f928253e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477435.198171:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d41647000/0xafddb3c8f9282545 lrc: 3/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2e01 expref: 60 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477435.198189:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9d0d44f4e500) 00010000:00010000:2.0:1789477435.198193:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789477435.198196:0:5846:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d41647000/0xafddb3c8f9282545 lrc: 3/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2e01 expref: 60 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477435.198205:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d0d41647000, rc 0) 00000100:00100000:2.0:1789477435.198278:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d4766b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9bc33f26-0aab-4a14-832f-c58d566de1b0+60:11601:x1876402783742336:12345-192.168.201.23@tcp:101:lfs.0 Request processed in 339us (594us total) trans 0 rc 0/0 00000100:00100000:2.0:1789477435.198286:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 214 00000004:00080000:2.0:1789477435.312191:0:8044:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 380383604760ns, next at 381383601265ns, rc = 0 00000100:00100000:3.0:1789477435.312302:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d7c1fa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1876402802601856:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789477435.312414:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789477435.312517:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802601856 00000100:00100000:3.0:1789477435.312527:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802601856 00000100:00100000:3.0:1789477435.312622:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1789477435.312634:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d7c3e4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3311:x1876402802601856:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789477435.312679:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789477435.312744:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d7c3e4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3311:x1876402802601856:12345-0@lo:13:osp-pre-1-0.0 Request processed in 98us (316us total) trans 0 rc 0/0 00000100:00100000:3.0:1789477435.312753:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00080000:3.0:1789477435.312778:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789477435.312837:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d7c1fa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1876402802601856:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789477435.313376:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789477435.313472:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d47668a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3313:1876402802602112:0@lo:400:kworker.0 00000100:00100000:0.0:1789477435.313523:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789477435.313614:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d4766b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:07d5e05c-913f-419f-adbc-d3cf15e9cd51:3313:1876402802601984:0@lo:400:kworker.0 00000100:00100000:0.0:1789477435.313647:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789477435.313752:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802601984 00000100:00100000:3.0:1789477435.313759:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802601984 00000100:00100000:3.0:1789477435.313819:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 298 00000100:00100000:3.0:1789477435.313828:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d44520050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:07d5e05c-913f-419f-adbc-d3cf15e9cd51+19:3313:x1876402802601984:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789477435.314030:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d44520050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:07d5e05c-913f-419f-adbc-d3cf15e9cd51+19:3313:x1876402802601984:12345-0@lo:400:kworker.0 Request processed in 203us (381us total) trans 0 rc 0/0 00000100:00100000:3.0:1789477435.314037:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 298 00000100:00100000:0.0:1789477435.314135:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d4766b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:07d5e05c-913f-419f-adbc-d3cf15e9cd51:3313:1876402802601984:0@lo:400:kworker.0 00000100:00100000:1.0:1789477435.316478:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d4766b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1876402802602240:0@lo:400:kworker.0 00000100:00100000:1.0:1789477435.316575:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789477435.316639:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789477435.316645:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d4e640000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3310:1876402802602368:0@lo:400:kworker.0 00000100:00100000:1.0:1789477435.316673:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789477435.316753:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d7c64d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3312:1876402802602496:0@lo:400:kworker.0 00000100:00100000:0.0:1789477435.317028:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802602240 00000100:00100000:0.0:1789477435.317069:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802602240 00000100:00100000:0.0:1789477435.317383:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1789477435.317398:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d74a89f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3310:x1876402802602240:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789477435.317486:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d74a89f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3310:x1876402802602240:12345-0@lo:400:kworker.0 Request processed in 92us (910us total) trans 0 rc 0/0 00000100:00100000:0.0:1789477435.317494:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1789477435.324290:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802602112 00000100:00100000:2.0:1789477435.324316:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802602112 00000100:00100000:2.0:1789477435.324414:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802602368 00000100:00100000:2.0:1789477435.324418:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802602368 00000100:00100000:2.0:1789477435.324470:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:2.0:1789477435.324482:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d75287100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1876402802602112:12345-0@lo:400:kworker.0 00000100:00080000:3.0:1789477435.325428:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789477435.325464:0:12091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:3.0:1789477435.325481:0:12091:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d74a89880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1876402802602368:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789477435.326305:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d75287100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1876402802602112:12345-0@lo:400:kworker.0 Request processed in 1820us (12776us total) trans 0 rc 0/0 00000100:00100000:2.0:1789477435.326318:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:2.0:1789477435.326395:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d47668a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3313:1876402802602112:0@lo:400:kworker.0 00000100:00100000:0.0:1789477435.326557:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789477435.326676:0:6999:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802602496 00000100:00100000:2.0:1789477435.326685:0:6999:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802602496 00000100:00100000:2.0:1789477435.326839:0:6999:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:2.0:1789477435.326870:0:6999:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d75285c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1876402802602496:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789477435.326927:0:6999:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d75285c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1876402802602496:12345-0@lo:400:kworker.0 Request processed in 60us (371us total) trans 0 rc 0/0 00000100:00100000:2.0:1789477435.326934:0:6999:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00080000:0.0:1789477435.327013:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789477435.327040:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d7c64d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3312:1876402802602496:0@lo:400:kworker.0 00000100:00100000:3.0:1789477435.327402:0:12091:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d74a89880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1876402802602368:12345-0@lo:400:kworker.0 Request processed in 1927us (10725us total) trans 0 rc 0/0 00000100:00100000:3.0:1789477435.327410:0:12091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:1.0:1789477435.330424:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d4e640000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3310:1876402802602368:0@lo:400:kworker.0 00000100:00100000:1.0:1789477435.330451:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d4766b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1876402802602240:0@lo:400:kworker.0 00000040:00080000:0.0:1789477435.632045:0:11717:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1789477435.632059:0:11717:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1789477435.632172:0:11717:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 3 00000040:00080000:0.0:1789477435.632180:0:11717:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1789477435.632908:0:11717:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d75286a00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11717:1876402802602624:192.168.201.23@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1789477435.633047:0:11717:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d0d7fb8d000 going to sleep for 11 seconds 00000100:00100000:0.0:1789477435.638757:0:11717:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d75286a00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11717:1876402802602624:192.168.201.23@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1789477435.647404:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:2.0:1789477435.647621:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783742464 00000100:00100000:2.0:1789477435.647634:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783742464 00000100:00100000:2.0:1789477435.647749:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 215 00000100:00100000:2.0:1789477435.647763:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d7c3e5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9bc33f26-0aab-4a14-832f-c58d566de1b0+60:11602:x1876402783742464:12345-192.168.201.23@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1789477435.647847:0:5844:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1789477435.647986:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d7c3e5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9bc33f26-0aab-4a14-832f-c58d566de1b0+60:11602:x1876402783742464:12345-192.168.201.23@tcp:53:lhsmtool_posix.0 Request processed in 225us (598us total) trans 0 rc 0/0 00000100:00100000:2.0:1789477435.647994:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 215 00000100:00100000:1.0:1789477435.651335:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:2.0:1789477435.651469:0:6999:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783742592 00000100:00100000:2.0:1789477435.651486:0:6999:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783742592 00000100:00100000:2.0:1789477435.651615:0:6999:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 216 00000100:00100000:2.0:1789477435.651629:0:6999:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d74a8b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9bc33f26-0aab-4a14-832f-c58d566de1b0+60:11602:x1876402783742592:12345-192.168.201.23@tcp:34:lhsmtool_posix.0 00010000:00010000:2.0:1789477435.652280:0:6999:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d41646a00/0xafddb3c8f928254c lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477435.652304:0:6999:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d41646a00/0xafddb3c8f928254c lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477435.652318:0:6999:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d41646a00/0xafddb3c8f928254c lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477435.652337:0:6999:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d41647800/0xafddb3c8f9282553 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477435.652368:0:6999:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d41647800/0xafddb3c8f9282553 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477435.652376:0:6999:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d41647800/0xafddb3c8f9282553 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477435.652405:0:6999:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d41647a00/0xafddb3c8f928255a lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477435.652414:0:6999:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d41647a00/0xafddb3c8f928255a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477435.652420:0:6999:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d41647a00/0xafddb3c8f928255a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789477435.652471:0:6999:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:2.0:1789477435.652476:0:6999:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1789477435.652491:0:6999:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d41647a00/0xafddb3c8f928255a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477435.652504:0:6999:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d41646a00/0xafddb3c8f928254c lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477435.652511:0:6999:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d41646a00/0xafddb3c8f928254c lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477435.652519:0:6999:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d41646a00/0xafddb3c8f928254c lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477435.652525:0:6999:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d0d41646a00 already unused, calling callback (ffffffffc1fd54f0) 00010000:00010000:2.0:1789477435.652530:0:6999:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d41646a00/0xafddb3c8f928254c lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477435.652546:0:6999:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d41646a00/0xafddb3c8f928254c lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477435.652561:0:6999:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9d0d48f9be00) 00010000:00010000:2.0:1789477435.652565:0:6999:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789477435.652570:0:6999:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d41646a00/0xafddb3c8f928254c lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477435.652618:0:6999:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d41646a00/0xafddb3c8f928254c lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477435.652638:0:6999:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d41647800/0xafddb3c8f9282553 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477435.652644:0:6999:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d41647800/0xafddb3c8f9282553 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477435.652650:0:6999:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d41647800/0xafddb3c8f9282553 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477435.656025:0:6999:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d0d41647800 already unused, calling callback (ffffffffc1fd54f0) 00010000:00010000:2.0:1789477435.656041:0:6999:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d41647800/0xafddb3c8f9282553 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477435.656058:0:6999:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d41647800/0xafddb3c8f9282553 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477435.656083:0:6999:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0xafd4eada (ffff9d0d50919b00) 00010000:00010000:2.0:1789477435.656086:0:6999:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789477435.656092:0:6999:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d41647800/0xafddb3c8f9282553 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477435.656129:0:6999:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d41647800/0xafddb3c8f9282553 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477435.656169:0:6999:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d41647a00/0xafddb3c8f928255a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477435.656177:0:6999:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d41647a00/0xafddb3c8f928255a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477435.656183:0:6999:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d41647a00/0xafddb3c8f928255a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477435.656188:0:6999:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d0d41647a00 already unused, calling callback (ffffffffc1fd54f0) 00010000:00010000:2.0:1789477435.656191:0:6999:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d41647a00/0xafddb3c8f928255a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477435.656196:0:6999:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d41647a00/0xafddb3c8f928255a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477435.656204:0:6999:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9d0d44f4e500) 00010000:00010000:2.0:1789477435.656207:0:6999:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789477435.656210:0:6999:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d41647a00/0xafddb3c8f928255a lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477435.656216:0:6999:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d41647a00/0xafddb3c8f928255a lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789477435.656441:0:6999:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d74a8b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9bc33f26-0aab-4a14-832f-c58d566de1b0+60:11602:x1876402783742592:12345-192.168.201.23@tcp:34:lhsmtool_posix.0 Request processed in 4808us (5113us total) trans 0 rc 0/0 00000100:00100000:2.0:1789477435.656456:0:6999:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 216 00000100:00100000:3.0:1789477435.668987:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:1.0:1789477435.688164:0:12091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783742848 00000100:00100000:1.0:1789477435.688188:0:12091:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783742848 00000100:00100000:1.0:1789477435.688305:0:12091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 217 00000100:00100000:1.0:1789477435.688318:0:12091:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d7c60e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9bc33f26-0aab-4a14-832f-c58d566de1b0+60:11602:x1876402783742848:12345-192.168.201.23@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789477435.688348:0:12091:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789477435.688376:0:12091:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f518800/0xafddb3c8f9282561 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa90d500d7b8f2e08 expref: -99 pid: 12091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477435.688528:0:12091:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f518000/0xafddb3c8f9282568 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 12091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477435.688554:0:12091:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f518000/0xafddb3c8f9282568 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477435.688595:0:12091:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f518000/0xafddb3c8f9282568 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12091 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789477435.688611:0:12091:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:1.0:1789477435.688752:0:12091:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f518000/0xafddb3c8f9282568 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477435.688761:0:12091:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f518000/0xafddb3c8f9282568 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 12091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477435.688768:0:12091:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f518000/0xafddb3c8f9282568 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477435.688773:0:12091:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d0d7f518000 already unused, calling callback (ffffffffc1fd54f0) 00010000:00010000:1.0:1789477435.688778:0:12091:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f518000/0xafddb3c8f9282568 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477435.688786:0:12091:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f518000/0xafddb3c8f9282568 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 12091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477435.688802:0:12091:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9d0d44f4e500) 00010000:00010000:1.0:1789477435.688805:0:12091:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1789477435.688810:0:12091:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f518000/0xafddb3c8f9282568 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477435.688831:0:12091:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f518000/0xafddb3c8f9282568 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477435.688882:0:12091:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f518800/0xafddb3c8f9282561 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2e08 expref: 62 pid: 12091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477435.688893:0:12091:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9d0d48f9be00) 00010000:00010000:1.0:1789477435.688896:0:12091:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1789477435.688899:0:12091:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f518800/0xafddb3c8f9282561 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2e08 expref: 62 pid: 12091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477435.688908:0:12091:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d0d7f518800, rc 0) 00000100:00100000:1.0:1789477435.689003:0:12091:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d7c60e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9bc33f26-0aab-4a14-832f-c58d566de1b0+61:11602:x1876402783742848:12345-192.168.201.23@tcp:101:lhsmtool_posix.0 Request processed in 688us (20031us total) trans 4294967504 rc 301/301 00000100:00100000:1.0:1789477435.689011:0:12091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 217 00000100:00100000:3.0:1789477435.701163:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:0.0:1789477435.701413:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783742976 00000100:00100000:0.0:1789477435.701425:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783742976 00000100:00100000:0.0:1789477435.701510:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 218 00000100:00100000:0.0:1789477435.701523:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d7c60f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9bc33f26-0aab-4a14-832f-c58d566de1b0+61:11602:x1876402783742976:12345-192.168.201.23@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1789477435.701571:0:5846:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1789477435.702499:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d7c60f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9bc33f26-0aab-4a14-832f-c58d566de1b0+61:11602:x1876402783742976:12345-192.168.201.23@tcp:53:lhsmtool_posix.0 Request processed in 971us (1345us total) trans 0 rc 0/0 00000100:00100000:0.0:1789477435.702511:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 218 00000100:00100000:3.0:1789477435.706469:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:2.0:1789477435.706623:0:6999:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783743232 00000100:00100000:2.0:1789477435.706638:0:6999:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783743232 00000100:00100000:2.0:1789477435.706711:0:6999:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 219 00000100:00100000:2.0:1789477435.707091:0:6999:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d7c60dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9bc33f26-0aab-4a14-832f-c58d566de1b0+61:11602:x1876402783743232:12345-192.168.201.23@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789477435.707123:0:6999:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789477435.707128:0:6999:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1789477435.707166:0:6999:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f518400/0xafddb3c8f9282506 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2dec expref: 61 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477435.707194:0:6999:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9d0d44568d00) 00010000:00010000:2.0:1789477435.707200:0:6999:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789477435.707217:0:6999:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d41647a00/0xafddb3c8f9282576 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa90d500d7b8f2e0f expref: -99 pid: 6999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1789477435.708380:0:6999:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x6:0x0], index 1: 0 00010000:00010000:2.0:1789477435.708646:0:6999:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d41647800/0xafddb3c8f928257d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477435.708664:0:6999:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d41647800/0xafddb3c8f928257d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477435.708678:0:6999:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d41647800/0xafddb3c8f928257d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477435.708761:0:6999:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d41647a00/0xafddb3c8f9282576 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2e0f expref: 63 pid: 6999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477435.708980:0:6999:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d41647800/0xafddb3c8f928257d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2e0f expref: 62 pid: 6999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477435.709017:0:6999:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9d0d50919b00) 00010000:00010000:2.0:1789477435.709021:0:6999:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789477435.709024:0:6999:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d0d41647800, rc 0) 00000100:00100000:2.0:1789477435.709401:0:6999:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d7c60dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9bc33f26-0aab-4a14-832f-c58d566de1b0+62:11602:x1876402783743232:12345-192.168.201.23@tcp:101:lhsmtool_posix.0 Request processed in 2677us (2946us total) trans 4294967505 rc 0/0 00000100:00100000:2.0:1789477435.709411:0:6999:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 219 00000100:00100000:0.0:1789477435.722040:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:1.0:1789477435.722484:0:12091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783743488 00000100:00100000:1.0:1789477435.722509:0:12091:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783743488 00000100:00100000:1.0:1789477435.722611:0:12091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 220 00000100:00100000:1.0:1789477435.722625:0:12091:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d75286a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9bc33f26-0aab-4a14-832f-c58d566de1b0+62:11602:x1876402783743488:12345-192.168.201.23@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1789477435.722706:0:12091:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789477435.722753:0:12091:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d41647800/0xafddb3c8f928257d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2e0f expref: 62 pid: 6999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477435.722777:0:12091:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9d0d50919b00) 00010000:00010000:1.0:1789477435.722799:0:12091:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789477435.722827:0:12091:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f518800/0xafddb3c8f928258b lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477435.722861:0:12091:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f518800/0xafddb3c8f928258b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477435.722871:0:12091:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f518800/0xafddb3c8f928258b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477435.722889:0:12091:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f518000/0xafddb3c8f9282592 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x48ae457 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477435.722896:0:12091:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f518000/0xafddb3c8f9282592 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x48ae457 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477435.722902:0:12091:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f518000/0xafddb3c8f9282592 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x48ae457 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477435.723011:0:12091:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f518800/0xafddb3c8f928258b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477435.723018:0:12091:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f518800/0xafddb3c8f928258b lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 12091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477435.723025:0:12091:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f518800/0xafddb3c8f928258b lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477435.723031:0:12091:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d0d7f518800 already unused, calling callback (ffffffffc1fd54f0) 00010000:00010000:1.0:1789477435.723036:0:12091:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f518800/0xafddb3c8f928258b lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477435.723054:0:12091:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f518800/0xafddb3c8f928258b lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 12091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477435.723062:0:12091:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9d0d44568d00) 00010000:00010000:1.0:1789477435.723070:0:12091:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789477435.723075:0:12091:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f518800/0xafddb3c8f928258b lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477435.723080:0:12091:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f518800/0xafddb3c8f928258b lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477435.723091:0:12091:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f518000/0xafddb3c8f9282592 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x48ae457 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477435.723096:0:12091:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f518000/0xafddb3c8f9282592 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x48ae457 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477435.723103:0:12091:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f518000/0xafddb3c8f9282592 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x48ae457 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477435.723109:0:12091:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d0d7f518000 already unused, calling callback (ffffffffc1fd54f0) 00010000:00010000:1.0:1789477435.723111:0:12091:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f518000/0xafddb3c8f9282592 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x48ae457 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477435.723118:0:12091:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f518000/0xafddb3c8f9282592 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x48ae457 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477435.723125:0:12091:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x48ae457 (ffff9d0d44f4e800) 00010000:00010000:1.0:1789477435.723128:0:12091:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789477435.723130:0:12091:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f518000/0xafddb3c8f9282592 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x48ae457 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477435.723135:0:12091:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f518000/0xafddb3c8f9282592 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x48ae457 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12091 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789477435.723246:0:12091:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d75286a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9bc33f26-0aab-4a14-832f-c58d566de1b0+61:11602:x1876402783743488:12345-192.168.201.23@tcp:36:lhsmtool_posix.0 Request processed in 624us (1221us total) trans 0 rc -2/-2 00000100:00100000:1.0:1789477435.726193:0:12091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 220 00000100:00100000:3.0:1789477435.727229:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:0.0:1789477435.734071:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783743616 00000100:00100000:0.0:1789477435.734116:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783743616 00000100:00100000:0.0:1789477435.734249:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 221 00000100:00100000:0.0:1789477435.734263:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d7c60ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9bc33f26-0aab-4a14-832f-c58d566de1b0+61:11602:x1876402783743616:12345-192.168.201.23@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789477435.734294:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789477435.734345:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be4c00/0xafddb3c8f9282599 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa90d500d7b8f2e16 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477435.734394:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be5200/0xafddb3c8f92825a0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477435.734413:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be5200/0xafddb3c8f92825a0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477435.734427:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be5200/0xafddb3c8f92825a0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477435.734567:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be4c00/0xafddb3c8f9282599 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2e16 expref: 63 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477435.734625:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be5200/0xafddb3c8f92825a0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2e16 expref: 62 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477435.734637:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9d0d596ae500) 00010000:00010000:0.0:1789477435.734640:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1789477435.734644:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d0d50be5200, rc 0) 00000100:00100000:0.0:1789477435.734742:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d7c60ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9bc33f26-0aab-4a14-832f-c58d566de1b0+62:11602:x1876402783743616:12345-192.168.201.23@tcp:101:lhsmtool_posix.0 Request processed in 482us (7520us total) trans 0 rc 0/0 00000100:00100000:0.0:1789477435.734752:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 221 00000100:00100000:3.0:1789477435.738690:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:2.0:1789477435.750459:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783743872 00000100:00100000:2.0:1789477435.750484:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783743872 00000100:00100000:2.0:1789477435.750609:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 222 00000100:00100000:2.0:1789477435.750621:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d7c60c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9bc33f26-0aab-4a14-832f-c58d566de1b0+62:11602:x1876402783743872:12345-192.168.201.23@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1789477435.750752:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d41647a00/0xafddb3c8f92825a7 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477435.750772:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d41647a00/0xafddb3c8f92825a7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477435.750795:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d41647a00/0xafddb3c8f92825a7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1789477435.751694:0:5844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].8, 88 off8800 00000004:00010000:2.0:1789477435.752600:0:5844:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000c22760f0 reply state 00000000e38e3432 transno 4294967506 ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d41647a00/0xafddb3c8f92825a7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789477435.752620:0:5844:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789477435.752806:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d7c60c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9bc33f26-0aab-4a14-832f-c58d566de1b0+64:11602:x1876402783743872:12345-192.168.201.23@tcp:36:lhsmtool_posix.0 Request processed in 2182us (14126us total) trans 4294967506 rc 0/0 00000100:00100000:2.0:1789477435.752817:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 222 00000100:00100000:2.0:1789477435.760569:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00010000:00010000:3.0:1789477435.761080:0:3296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d41647a00/0xafddb3c8f92825a7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477435.761097:0:3296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d41647a00/0xafddb3c8f92825a7 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477435.761106:0:3296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d41647a00/0xafddb3c8f92825a7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477435.761113:0:3296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d0d41647a00 already unused, calling callback (ffffffffc1fd54f0) 00010000:00010000:3.0:1789477435.761119:0:3296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d41647a00/0xafddb3c8f92825a7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477435.761128:0:3296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d41647a00/0xafddb3c8f92825a7 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477435.761154:0:3296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9d0d596ae500) 00010000:00010000:3.0:1789477435.761157:0:3296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1789477435.761164:0:3296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d41647a00/0xafddb3c8f92825a7 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477435.761171:0:3296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d41647a00/0xafddb3c8f92825a7 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789477435.761187:0:12091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783744000 00000100:00100000:1.0:1789477435.761203:0:12091:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783744000 00000100:00100000:1.0:1789477435.761419:0:12091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 223 00000100:00100000:1.0:1789477435.761433:0:12091:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d7c1fb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9bc33f26-0aab-4a14-832f-c58d566de1b0+63:11602:x1876402783744000:12345-192.168.201.23@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789477435.761465:0:12091:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789477435.761488:0:12091:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f518000/0xafddb3c8f92825ae lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa90d500d7b8f2e1d expref: -99 pid: 12091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477435.761571:0:12091:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f518000/0xafddb3c8f92825ae lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2e1d expref: 64 pid: 12091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477435.761627:0:12091:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f518000/0xafddb3c8f92825ae lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2e1d expref: 64 pid: 12091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477435.761652:0:12091:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9d0d596ae500) 00010000:00010000:1.0:1789477435.761656:0:12091:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789477435.761658:0:12091:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d0d7f518000, rc 0) 00000100:00100000:1.0:1789477435.761757:0:12091:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d7c1fb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9bc33f26-0aab-4a14-832f-c58d566de1b0+64:11602:x1876402783744000:12345-192.168.201.23@tcp:101:lhsmtool_posix.0 Request processed in 326us (1203us total) trans 0 rc 0/0 00000100:00100000:1.0:1789477435.761766:0:12091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 223 00000100:00100000:2.0:1789477435.764360:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:3.0:1789477435.764550:0:8241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783744128 00000100:00100000:3.0:1789477435.764566:0:8241:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783744128 00000100:00100000:3.0:1789477435.764707:0:8241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 63 00000100:00100000:3.0:1789477435.764719:0:8241:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d7c1f9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9bc33f26-0aab-4a14-832f-c58d566de1b0+9:2354:x1876402783744128:12345-192.168.201.23@tcp:2:lhsmtool_posix.0 00000100:00100000:3.0:1789477435.765159:0:8241:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d7c1f9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9bc33f26-0aab-4a14-832f-c58d566de1b0+10:2354:x1876402783744128:12345-192.168.201.23@tcp:2:lhsmtool_posix.0 Request processed in 441us (815us total) trans 4294967319 rc 0/0 00000100:00100000:3.0:1789477435.765169:0:8241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 63 00000100:00080000:2.0:1789477435.765419:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789477435.769776:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:3.0:1789477435.769965:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783744384 00000100:00100000:3.0:1789477435.769979:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783744384 00000100:00100000:3.0:1789477435.770049:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 60 00000100:00100000:3.0:1789477435.770060:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d7c1faa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9bc33f26-0aab-4a14-832f-c58d566de1b0+64:11602:x1876402783744384:12345-192.168.201.23@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1789477435.770404:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d7c1faa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9bc33f26-0aab-4a14-832f-c58d566de1b0+65:11602:x1876402783744384:12345-192.168.201.23@tcp:35:lhsmtool_posix.0 Request processed in 344us (643us total) trans 4294967507 rc 0/0 00000100:00100000:3.0:1789477435.770413:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 60 00000100:00100000:2.0:1789477435.782002:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:0.0:1789477435.783184:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783744640 00000100:00100000:0.0:1789477435.783224:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783744640 00000100:00100000:0.0:1789477435.783329:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 224 00000100:00100000:0.0:1789477435.783343:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d7c1f8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9bc33f26-0aab-4a14-832f-c58d566de1b0+65:11602:x1876402783744640:12345-192.168.201.23@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1789477435.783537:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d7c1f8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9bc33f26-0aab-4a14-832f-c58d566de1b0+65:11602:x1876402783744640:12345-192.168.201.23@tcp:57:lhsmtool_posix.0 Request processed in 197us (1550us total) trans 0 rc 0/0 00000100:00100000:0.0:1789477435.783546:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 224 00000100:00100000:0.0:1789477435.789694:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:2.0:1789477435.790212:0:6999:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783744768 00000100:00100000:2.0:1789477435.790227:0:6999:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783744768 00000100:00100000:2.0:1789477435.790307:0:6999:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 225 00000100:00100000:2.0:1789477435.790319:0:6999:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d75287480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9bc33f26-0aab-4a14-832f-c58d566de1b0+65:11602:x1876402783744768:12345-192.168.201.23@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789477435.790346:0:6999:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789477435.790376:0:6999:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d41647a00/0xafddb3c8f92825b5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa90d500d7b8f2e24 expref: -99 pid: 6999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477435.790971:0:6999:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d41646a00/0xafddb3c8f92825bc lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477435.790992:0:6999:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d41646a00/0xafddb3c8f92825bc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477435.791008:0:6999:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d41646a00/0xafddb3c8f92825bc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789477435.791059:0:6999:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1789477435.791082:0:6999:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d41646a00/0xafddb3c8f92825bc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477435.791115:0:6999:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d41647a00/0xafddb3c8f92825b5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2e24 expref: 67 pid: 6999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477435.791136:0:6999:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d41646a00/0xafddb3c8f92825bc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2e24 expref: 66 pid: 6999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477435.791165:0:6999:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9d0d596ae500) 00010000:00010000:2.0:1789477435.791168:0:6999:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1789477435.791173:0:6999:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d0d41646a00, rc 0) 00000100:00100000:2.0:1789477435.791303:0:6999:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d75287480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9bc33f26-0aab-4a14-832f-c58d566de1b0+66:11602:x1876402783744768:12345-192.168.201.23@tcp:101:lhsmtool_posix.0 Request processed in 985us (1624us total) trans 0 rc 0/0 00000100:00100000:2.0:1789477435.791311:0:6999:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 225 00000100:00100000:3.0:1789477435.797775:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:1.0:1789477435.801335:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783744896 00000100:00100000:1.0:1789477435.801359:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783744896 00000100:00100000:1.0:1789477435.801470:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 64 00000100:00100000:1.0:1789477435.801484:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d7c60f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9bc33f26-0aab-4a14-832f-c58d566de1b0+10:2355:x1876402783744896:12345-192.168.201.23@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789477435.801510:0:6697:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789477435.801559:0:6697:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000069b4af8a/0xafddb3c8f92825c3 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa90d500d7b8f2e2b expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789477435.801632:0:6697:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6aa9423b, blocks: 0x1 00010000:00010000:1.0:1789477435.801662:0:6697:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=380s v=(0 0) 00010000:00010000:1.0:1789477435.801667:0:6697:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789477435.801694:0:6697:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000069b4af8a/0xafddb3c8f92825c3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2e2b expref: 11 pid: 6697 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477435.801718:0:6697:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000069b4af8a/0xafddb3c8f92825c3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2e2b expref: 11 pid: 6697 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477435.801745:0:6697:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d0d7f518800, rc 0) 00000100:00100000:0.0:1789477435.801880:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d7c60f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9bc33f26-0aab-4a14-832f-c58d566de1b0+11:2355:x1876402783744896:12345-192.168.201.23@tcp:101:lhsmtool_posix.0 Request processed in 396us (7304us total) trans 0 rc 0/0 00000100:00100000:0.0:1789477435.801889:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 64 00000100:00100000:0.0:1789477435.807457:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:1.0:1789477435.807753:0:12091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783745152 00000100:00100000:1.0:1789477435.807766:0:12091:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783745152 00000100:00100000:1.0:1789477435.807866:0:12091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 226 00000100:00100000:1.0:1789477435.807878:0:12091:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d75287800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9bc33f26-0aab-4a14-832f-c58d566de1b0+66:11602:x1876402783745152:12345-192.168.201.23@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1789477435.808014:0:12091:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d75287800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9bc33f26-0aab-4a14-832f-c58d566de1b0+66:11602:x1876402783745152:12345-192.168.201.23@tcp:57:lhsmtool_posix.0 Request processed in 139us (576us total) trans 0 rc 0/0 00000100:00100000:1.0:1789477435.808022:0:12091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 226 00000100:00100000:2.0:1789477435.832281:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:0.0:1789477435.833635:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783745280 00000100:00100000:0.0:1789477435.833660:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783745280 00000100:00100000:0.0:1789477435.833784:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 65 00000100:00100000:0.0:1789477435.833798:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d7c1fa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9bc33f26-0aab-4a14-832f-c58d566de1b0+11:11602:x1876402783745280:12345-192.168.201.23@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789477435.833822:0:6696:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789477435.833848:0:6696:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d05cf15f/0xafddb3c8f92825ca lrc: 2/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa90d500d7b8f2e32 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477435.833888:0:6696:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000069b4af8a/0xafddb3c8f92825c3 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2e2b expref: 12 pid: 6697 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477435.833897:0:6696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789477435.833902:0:6696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789477435.833908:0:6696:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d05cf15f/0xafddb3c8f92825ca lrc: 4/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2e32 expref: 12 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477435.833972:0:6696:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000069b4af8a/0xafddb3c8f92825c3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2e2b expref: 12 pid: 6697 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477435.833988:0:6696:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000069b4af8a/0xafddb3c8f92825c3 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2e2b expref: 12 pid: 6697 timeout: 480 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789477435.834006:0:6696:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d75285f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6696:1876402802602752:192.168.201.23@tcp:104: 00000100:00100000:0.0:1789477435.834168:0:6696:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d0d7fb8d300 going to sleep for 11 seconds 00000100:00100000:3.0:1789477435.839095:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:1.0:1789477435.839200:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783745408 00000100:00100000:1.0:1789477435.839212:0:6711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783745408 00010000:00010000:1.0:1789477435.839269:0:6711:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000069b4af8a/0xafddb3c8f92825c3 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2e2b expref: 13 pid: 6697 timeout: 480 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789477435.839326:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 80 00000100:00100000:1.0:1789477435.839339:0:6711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d7c60c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9bc33f26-0aab-4a14-832f-c58d566de1b0+13:2355:x1876402783745408:12345-192.168.201.23@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789477435.839379:0:6711:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789477435.839410:0:6711:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000069b4af8a/0xafddb3c8f92825c3 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2e2b expref: 13 pid: 6697 timeout: 480 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477435.839428:0:6711:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000069b4af8a/0xafddb3c8f92825c3 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2e2b expref: 13 pid: 6697 timeout: 480 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477435.839460:0:6711:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789477435.839466:0:6711:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789477435.839475:0:6711:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000d05cf15f/0xafddb3c8f92825ca lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2e32 expref: 13 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477435.839487:0:6711:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d05cf15f/0xafddb3c8f92825ca lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2e32 expref: 13 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477435.839534:0:6711:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000d05cf15f/0xafddb3c8f92825ca lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2e32 expref: 13 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789477435.839550:0:6711:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d74a89180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:6711:1876402802602880:192.168.201.23@tcp:105: 00000100:00100000:1.0:1789477435.839697:0:6711:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d0d47741a80 going to sleep for 11 seconds 00010000:00010000:0.0:1789477435.839973:0:6696:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000069b4af8a/0xafddb3c8f92825c3 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2e2b expref: 13 pid: 6697 timeout: 480 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789477435.839991:0:6696:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d75285f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6696:1876402802602752:192.168.201.23@tcp:104: 00010000:00010000:0.0:1789477435.840113:0:6696:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000d05cf15f/0xafddb3c8f92825ca lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2e32 expref: 12 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477435.840129:0:6696:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d0d50be4600, rc 0) 00000100:00100000:0.0:1789477435.840183:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d7c1fa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9bc33f26-0aab-4a14-832f-c58d566de1b0+12:11602:x1876402783745280:12345-192.168.201.23@tcp:101:lhsmtool_posix.0 Request processed in 6388us (7918us total) trans 0 rc 0/0 00000100:00100000:0.0:1789477435.840191:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 65 00000100:00100000:1.0:1789477435.843476:0:6711:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d74a89180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:6711:1876402802602880:192.168.201.23@tcp:105: 00010000:00010000:1.0:1789477435.843535:0:6711:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789477435.844084:0:6711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d7c60c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9bc33f26-0aab-4a14-832f-c58d566de1b0+11:2355:x1876402783745408:12345-192.168.201.23@tcp:103:ldlm_bl.0 Request processed in 4742us (5000us total) trans 0 rc 0/0 00000100:00100000:1.0:1789477435.844098:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 80 00000100:00100000:1.0:1789477435.860140:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:0.0:1789477435.860338:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783745536 00000100:00100000:0.0:1789477435.860353:0:6702:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783745536 00002000:00100000:0.0:1789477435.860426:0:6702:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x6:0x0] (0->12) req@ffff9d0d74a89180 x1876402783745536/t0(0) o4->9bc33f26-0aab-4a14-832f-c58d566de1b0@192.168.201.23@tcp:606/0 lens 504/0 e 0 to 0 dl 1789477446 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789477435.860465:0:6702:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9d0d74a89180 with x1876402783745536 ext(0->12) 00002000:00010000:0.0:1789477435.860473:0:6702:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9d0d74a89180 00000100:00100000:2.0:1789477435.860685:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 6 00000100:00100000:2.0:1789477435.860702:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d74a89180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:9bc33f26-0aab-4a14-832f-c58d566de1b0+11:2354:x1876402783745536:12345-192.168.201.23@tcp:4:lhsmtool_posix.0 00000100:00100000:2.0:1789477435.861329:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d74a89180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:9bc33f26-0aab-4a14-832f-c58d566de1b0+13:2354:x1876402783745536:12345-192.168.201.23@tcp:4:lhsmtool_posix.0 Request processed in 629us (1200us total) trans 4294967320 rc 0/0 00000100:00100000:2.0:1789477435.861340:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 6 00002000:00100000:2.0:1789477435.861351:0:6700:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x6:0x0] (0->12) req@ffff9d0d74a89180 x1876402783745536/t4294967320(0) o4->9bc33f26-0aab-4a14-832f-c58d566de1b0@192.168.201.23@tcp:606/0 lens 504/448 e 0 to 0 dl 1789477446 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789477435.861360:0:6700:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9d0d74a89180 with x1876402783745536 ext(0->12) 00002000:00010000:2.0:1789477435.861364:0:6700:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9d0d74a89180 00000100:00100000:1.0:1789477435.873173:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:2.0:1789477435.873355:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783745664 00000100:00100000:2.0:1789477435.873368:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783745664 00000100:00100000:2.0:1789477435.873485:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 227 00000100:00100000:2.0:1789477435.873497:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d74a8bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9bc33f26-0aab-4a14-832f-c58d566de1b0+66:11602:x1876402783745664:12345-192.168.201.23@tcp:44:lhsmtool_posix.0 00000001:00080000:3.0:1789477435.968056:0:5868:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967503 is committed 00000004:00080000:3.0:1789477435.968078:0:5868:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 6 committed 00000020:00080000:3.0:1789477435.968102:0:5868:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9d0d7fb8dd80 refcount 2 committed 0 result 0 batchid 7 00000020:00080000:3.0:1789477435.968109:0:5868:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9d0d7f5ed900 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9d0d7fb8d540 00000020:00080000:3.0:1789477435.968112:0:5868:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9d0d7f5edc00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9d0d74d27c00 00000004:00080000:3.0:1789477435.968126:0:5868:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 8 committed 00000020:00080000:3.0:1789477435.968304:0:5879:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000100:00100000:3.0:1789477435.968391:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d7c60c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1876402802603008:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1789477435.968482:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789477435.969482:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d7c60d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1876402802603136:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1789477435.969539:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789477435.969822:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802603008 00000100:00100000:0.0:1789477435.969833:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802603008 00000100:00100000:0.0:1789477435.969896:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802603136 00000100:00100000:0.0:1789477435.969900:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802603136 00000100:00100000:0.0:1789477435.969934:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1789477435.969946:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d7c60f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3313:x1876402802603008:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1789477435.969993:0:6697:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:5 count 1 00002000:00010000:0.0:1789477435.970036:0:6697:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 9, mtime: 0x6aa94239, atime: 0x6aa94239, ctime: 0x6aa94239, blocks: 0x1 00010000:00010000:0.0:1789477435.970054:0:6697:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ef01e22b/0xafddb3c8f92825d1 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477435.970074:0:6697:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=381s v=(0 0) 00010000:00010000:0.0:1789477435.970080:0:6697:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789477435.970088:0:6697:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ef01e22b/0xafddb3c8f92825d1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477435.970109:0:6697:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ef01e22b/0xafddb3c8f92825d1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477435.970122:0:6697:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ef01e22b/0xafddb3c8f92825d1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477435.970130:0:6697:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ef01e22b/0xafddb3c8f92825d1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477435.970161:0:6697:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789477435.970655:0:5832:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789477435.970664:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ef01e22b/0xafddb3c8f92825d1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477435.970685:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d0d50be5e00 already unused, calling callback (ffffffffc15972a0) 00010000:00010000:2.0:1789477435.970691:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ef01e22b/0xafddb3c8f92825d1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477435.970701:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ef01e22b/0xafddb3c8f92825d1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477435.970732:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ef01e22b/0xafddb3c8f92825d1 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477435.970741:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ef01e22b/0xafddb3c8f92825d1 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477435.970765:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789477435.970767:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789477435.970769:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789477435.970789:0:8241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1789477435.970798:0:8241:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d7c60ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3310:x1876402802603136:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1789477435.970829:0:8241:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:5 count 1 00010000:00010000:2.0:1789477435.970848:0:8241:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002c59c798/0xafddb3c8f92825d8 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477435.970865:0:8241:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000062480330/0xafddb3c8f9282393 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2d91 expref: 12 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477435.970886:0:8241:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x5:0x0].0x0 since=3s v=(0 0) 00010000:00010000:2.0:1789477435.970889:0:8241:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789477435.970894:0:8241:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002c59c798/0xafddb3c8f92825d8 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477435.970931:0:8241:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000062480330/0xafddb3c8f9282393 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2d91 expref: 12 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477435.970949:0:8241:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000062480330/0xafddb3c8f9282393 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2d91 expref: 12 pid: 6696 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789477435.970965:0:8241:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d7c1fbb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8241:1876402802603264:192.168.201.23@tcp:104: 00000004:00080000:1.0:1789477435.971937:0:3313:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9d0d7c60c000/2, rc 0, transno 4294967310 00000100:00100000:1.0:1789477435.971947:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d7c60c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1876402802603008:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1789477435.972046:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d7c60f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+8:3313:x1876402802603008:12345-0@lo:6:osp-syn-0-0.0 Request processed in 1862us (3324us total) trans 4294967310 rc 0/0 00000100:00100000:0.0:1789477435.972058:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000001:00080000:1.0:1789477435.972416:0:5868:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967504 is committed 00000100:00100000:2.0:1789477435.972564:0:8241:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d0d58508780 going to sleep for 11 seconds 00000001:00080000:1.0:1789477435.973674:0:5868:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967506 is committed 00000004:00080000:1.0:1789477435.973692:0:5868:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 9 committed 00000100:00100000:3.0:1789477435.973959:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d74a8bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9bc33f26-0aab-4a14-832f-c58d566de1b0+46:11602:x1876402783745664:12345-192.168.201.23@tcp:44:lhsmtool_posix.0 Request processed in 100457us (100792us total) trans 0 rc 0/0 00000100:00100000:3.0:1789477435.973971:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 227 00000001:00080000:2.0:1789477435.974288:0:12456:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967507 is committed 00000020:00080000:1.0:1789477435.974962:0:5868:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9d0d50a1ecc0 refcount 2 committed 0 result 0 batchid 6 00000020:00080000:1.0:1789477435.974968:0:5868:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9d0d72b1c000 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9d0d50a1e240 00000020:00080000:1.0:1789477435.974972:0:5868:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9d0d72b1c100 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9d0d50598400 00000020:00080000:1.0:1789477435.975001:0:5868:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 5 batchid updated 00000020:00080000:3.0:1789477435.975127:0:5879:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 7 committed batchid 5 00000020:00080000:3.0:1789477435.975356:0:5879:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000100:00100000:2.0:1789477435.977948:0:8241:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d7c1fbb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8241:1876402802603264:192.168.201.23@tcp:104: 00000100:00100000:0.0:1789477435.977960:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00010000:00010000:2.0:1789477435.978002:0:8241:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000002c59c798/0xafddb3c8f92825d8 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789477435.979309:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:0.0:1789477435.979421:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783745920 00000100:00100000:0.0:1789477435.979434:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783745920 00000100:00100000:0.0:1789477435.979511:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 68 00000100:00100000:0.0:1789477435.979524:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d7c1fbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9bc33f26-0aab-4a14-832f-c58d566de1b0+13:2355:x1876402783745920:12345-192.168.201.23@tcp:16:lhsmtool_posix.0 00000100:00100000:1.0:1789477435.979691:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783745792 00000100:00100000:1.0:1789477435.979697:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783745792 00010000:00010000:1.0:1789477435.979740:0:5831:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000062480330/0xafddb3c8f9282393 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2d91 expref: 14 pid: 6696 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789477435.979783:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 81 00000100:00100000:1.0:1789477435.979791:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d75285f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9bc33f26-0aab-4a14-832f-c58d566de1b0+14:2354:x1876402783745792:12345-192.168.201.23@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789477435.979804:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789477435.979811:0:5831:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000062480330/0xafddb3c8f9282393 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2d91 expref: 14 pid: 6696 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477435.979826:0:5831:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000062480330/0xafddb3c8f9282393 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2d91 expref: 14 pid: 6696 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477435.979853:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000062480330/0xafddb3c8f9282393 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2d91 expref: 14 pid: 6696 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477435.979890:0:5831:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789477435.979895:0:5831:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789477435.979901:0:5831:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000002c59c798/0xafddb3c8f92825d8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477435.979911:0:5831:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002c59c798/0xafddb3c8f92825d8 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477435.979941:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789477435.980000:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d75285f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9bc33f26-0aab-4a14-832f-c58d566de1b0+13:2354:x1876402783745792:12345-192.168.201.23@tcp:103:ldlm_bl.0 Request processed in 210us (2040us total) trans 0 rc 0/0 00000100:00100000:1.0:1789477435.980008:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 81 00010000:00010000:1.0:1789477435.980040:0:8241:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000002c59c798/0xafddb3c8f92825d8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477435.980050:0:8241:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002c59c798/0xafddb3c8f92825d8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477435.980062:0:8241:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002c59c798/0xafddb3c8f92825d8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477435.980071:0:8241:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002c59c798/0xafddb3c8f92825d8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477435.980091:0:8241:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789477435.980140:0:6710:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789477435.980150:0:6710:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002c59c798/0xafddb3c8f92825d8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477435.980158:0:6710:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d0d41647a00 already unused, calling callback (ffffffffc15972a0) 00010000:00010000:3.0:1789477435.980164:0:6710:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002c59c798/0xafddb3c8f92825d8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477435.980173:0:6710:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002c59c798/0xafddb3c8f92825d8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477435.980186:0:6710:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002c59c798/0xafddb3c8f92825d8 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477435.980193:0:6710:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002c59c798/0xafddb3c8f92825d8 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477435.980213:0:6710:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789477435.980215:0:6710:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789477435.980216:0:6710:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789477435.980695:0:8241:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d7c60ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3310:x1876402802603136:12345-0@lo:6:osp-syn-1-0.0 Request processed in 9897us (11154us total) trans 4294967321 rc 0/0 00000100:00100000:1.0:1789477435.980704:0:8241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000004:00080000:3.0:1789477435.981909:0:3310:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9d0d7c60d880/2, rc 0, transno 4294967321 00000100:00100000:3.0:1789477435.981932:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d7c60d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1876402802603136:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1789477436.033023:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d7c1fbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9bc33f26-0aab-4a14-832f-c58d566de1b0+12:2355:x1876402783745920:12345-192.168.201.23@tcp:16:lhsmtool_posix.0 Request processed in 53484us (53708us total) trans 0 rc 0/0 00000100:00100000:2.0:1789477436.033051:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 68 00000001:00080000:3.0:1789477436.033400:0:7678:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967318 is committed 00000001:00080000:3.0:1789477436.033419:0:7678:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967320 is committed 00000001:00080000:3.0:1789477436.033432:0:7678:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967317 is committed 00000100:00100000:2.0:1789477436.036992:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:0.0:1789477436.037165:0:6999:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783746176 00000100:00100000:0.0:1789477436.037179:0:6999:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783746176 00000100:00100000:0.0:1789477436.037290:0:6999:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 228 00000100:00100000:0.0:1789477436.037301:0:6999:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d7c1f8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9bc33f26-0aab-4a14-832f-c58d566de1b0+20:11602:x1876402783746176:12345-192.168.201.23@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1789477436.037371:0:6999:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789477436.037411:0:6999:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d41646a00/0xafddb3c8f92825bc lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2e24 expref: 20 pid: 6999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477436.037438:0:6999:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9d0d596ae500) 00010000:00010000:0.0:1789477436.037443:0:6999:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789477436.037483:0:6999:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be5e00/0xafddb3c8f92825df lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477436.037499:0:6999:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be5e00/0xafddb3c8f92825df lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477436.037510:0:6999:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be5e00/0xafddb3c8f92825df lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789477436.037989:0:6999:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000804b1c1f reply state 00000000ed4b9fb2 transno 4294967508 ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be5e00/0xafddb3c8f92825df lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789477436.037999:0:6999:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789477436.038234:0:6999:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d7c1f8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9bc33f26-0aab-4a14-832f-c58d566de1b0+21:11602:x1876402783746176:12345-192.168.201.23@tcp:36:lhsmtool_posix.0 Request processed in 932us (1254us total) trans 4294967508 rc 0/0 00000100:00100000:0.0:1789477436.038242:0:6999:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 228 00010000:00010000:3.0:1789477436.040563:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be5e00/0xafddb3c8f92825df lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477436.040618:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be5e00/0xafddb3c8f92825df lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477436.040627:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be5e00/0xafddb3c8f92825df lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477436.040634:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d0d50be5e00 already unused, calling callback (ffffffffc1fd54f0) 00010000:00010000:3.0:1789477436.040640:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be5e00/0xafddb3c8f92825df lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477436.040649:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be5e00/0xafddb3c8f92825df lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477436.040671:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9d0d596ae500) 00010000:00010000:3.0:1789477436.040675:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789477436.040680:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be5e00/0xafddb3c8f92825df lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477436.040686:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be5e00/0xafddb3c8f92825df lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789477436.042819:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:2.0:1789477436.043131:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783746304 00000100:00100000:2.0:1789477436.043163:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783746304 00000100:00100000:2.0:1789477436.043235:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 69 00000100:00100000:2.0:1789477436.043259:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d74a88e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9bc33f26-0aab-4a14-832f-c58d566de1b0+7:2352:x1876402783746304:12345-192.168.201.23@tcp:2:lhsmtool_posix.0 00002000:00010000:2.0:1789477436.044178:0:6694:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:2.0:1789477436.044184:0:6694:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb mtime from disk: 0 -> 1789477434 00002000:00010000:2.0:1789477436.044186:0:6694:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb atime from disk: 0 -> 1789477433 00002000:00010000:2.0:1789477436.044188:0:6694:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb ctime from disk: 1789477435 -> 1789477434 00002000:00010000:2.0:1789477436.044190:0:6694:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:2.0:1789477436.044281:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d74a88e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9bc33f26-0aab-4a14-832f-c58d566de1b0+8:2352:x1876402783746304:12345-192.168.201.23@tcp:2:lhsmtool_posix.0 Request processed in 1033us (1483us total) trans 4294967322 rc 0/0 00000100:00100000:2.0:1789477436.044290:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 69 00000100:00100000:1.0:1789477436.046789:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:3.0:1789477436.046941:0:12091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783746560 00000100:00100000:3.0:1789477436.046954:0:12091:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783746560 00000100:00100000:3.0:1789477436.047030:0:12091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 229 00000100:00100000:3.0:1789477436.047041:0:12091:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d74a8b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9bc33f26-0aab-4a14-832f-c58d566de1b0+20:11602:x1876402783746560:12345-192.168.201.23@tcp:55:lhsmtool_posix.0 00010000:00010000:3.0:1789477436.047168:0:12091:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49ecba00/0xafddb3c8f92825e6 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477436.047188:0:12091:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be5200/0xafddb3c8f92825a0 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2e16 expref: 20 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477436.047198:0:12091:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49ecba00/0xafddb3c8f92825e6 lrc: 4/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477436.047252:0:12091:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be5200/0xafddb3c8f92825a0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2e16 expref: 20 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477436.047271:0:12091:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be5200/0xafddb3c8f92825a0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2e16 expref: 20 pid: 5846 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789477436.047287:0:12091:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d7c60df80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12091:1876402802603392:192.168.201.23@tcp:104: 00000100:00100000:3.0:1789477436.047416:0:12091:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d0d585b2180 going to sleep for 11 seconds 00000100:00100000:1.0:1789477436.050010:0:12091:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d7c60df80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12091:1876402802603392:192.168.201.23@tcp:104: 00010000:00010000:1.0:1789477436.050063:0:12091:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49ecba00/0xafddb3c8f92825e6 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12091 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789477436.052047:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:3.0:1789477436.052341:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783746688 00000100:00100000:3.0:1789477436.052355:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783746688 00010000:00010000:3.0:1789477436.052410:0:5830:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be5200/0xafddb3c8f92825a0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2e16 expref: 21 pid: 5846 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789477436.052455:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 82 00000100:00100000:3.0:1789477436.052468:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d74a88000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9bc33f26-0aab-4a14-832f-c58d566de1b0+21:2354:x1876402783746688:12345-192.168.201.23@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789477436.052486:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789477436.052493:0:5830:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be5200/0xafddb3c8f92825a0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2e16 expref: 21 pid: 5846 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477436.052532:0:5830:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be5200/0xafddb3c8f92825a0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2e16 expref: 21 pid: 5846 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477436.052563:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be5200/0xafddb3c8f92825a0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2e16 expref: 21 pid: 5846 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477436.052610:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9d0d596ae500) 00010000:00010000:3.0:1789477436.052617:0:5830:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49ecba00/0xafddb3c8f92825e6 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477436.052628:0:5830:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49ecba00/0xafddb3c8f92825e6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 12091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477436.052637:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49ecba00/0xafddb3c8f92825e6 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 12091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477436.052678:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789477436.052756:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d74a88000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9bc33f26-0aab-4a14-832f-c58d566de1b0+20:2354:x1876402783746688:12345-192.168.201.23@tcp:103:ldlm_bl.0 Request processed in 289us (724us total) trans 0 rc 0/0 00000100:00100000:3.0:1789477436.052765:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 82 00010000:00010000:0.0:1789477436.053523:0:12091:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49ecba00/0xafddb3c8f92825e6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477436.053536:0:12091:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49ecba00/0xafddb3c8f92825e6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477436.053611:0:12091:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49ecba00/0xafddb3c8f92825e6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477436.053620:0:12091:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49ecba00/0xafddb3c8f92825e6 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477436.053628:0:12091:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49ecba00/0xafddb3c8f92825e6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477436.053634:0:12091:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d0d49ecba00 already unused, calling callback (ffffffffc1fd54f0) 00010000:00010000:0.0:1789477436.053639:0:12091:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49ecba00/0xafddb3c8f92825e6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477436.053647:0:12091:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49ecba00/0xafddb3c8f92825e6 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477436.053660:0:12091:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9d0d596ae500) 00010000:00010000:0.0:1789477436.053675:0:12091:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:0.0:1789477436.053680:0:12091:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49ecba00/0xafddb3c8f92825e6 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477436.053686:0:12091:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49ecba00/0xafddb3c8f92825e6 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12091 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789477436.053777:0:12091:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d74a8b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9bc33f26-0aab-4a14-832f-c58d566de1b0+19:11602:x1876402783746560:12345-192.168.201.23@tcp:55:lhsmtool_posix.0 Request processed in 6735us (7004us total) trans 0 rc -22/-22 00000100:00100000:0.0:1789477436.053787:0:12091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 229 00000100:00100000:2.0:1789477436.057933:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:1.0:1789477436.058144:0:8241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783746816 00000100:00100000:1.0:1789477436.058158:0:8241:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783746816 00000100:00100000:1.0:1789477436.058242:0:8241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 70 00000100:00100000:1.0:1789477436.058256:0:8241:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d74f0ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9bc33f26-0aab-4a14-832f-c58d566de1b0+8:2354:x1876402783746816:12345-192.168.201.23@tcp:1:lhsmtool_posix.0 00010000:00010000:1.0:1789477436.058321:0:8241:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 000000006b2f4150/0xafddb3c8f92825ed lrc: 3/1,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477436.058348:0:8241:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000d05cf15f/0xafddb3c8f92825ca lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2e32 expref: 8 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477436.058357:0:8241:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x6:0x0].0x0 since=1s v=(0 0) 00010000:00010000:1.0:1789477436.058362:0:8241:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789477436.058367:0:8241:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006b2f4150/0xafddb3c8f92825ed lrc: 4/1,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477436.058413:0:8241:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000d05cf15f/0xafddb3c8f92825ca lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2e32 expref: 8 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477436.058453:0:8241:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000d05cf15f/0xafddb3c8f92825ca lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2e32 expref: 8 pid: 6696 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789477436.058472:0:8241:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d4e640000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8241:1876402802603520:192.168.201.23@tcp:104: 00000100:00100000:1.0:1789477436.058609:0:8241:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d0d477410c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789477436.065170:0:8241:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d4e640000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8241:1876402802603520:192.168.201.23@tcp:104: 00010000:00010000:1.0:1789477436.065277:0:8241:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000006b2f4150/0xafddb3c8f92825ed lrc: 3/1,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789477436.074123:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:1.0:1789477436.074780:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783746944 00000100:00100000:1.0:1789477436.074800:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783746944 00010000:00010000:1.0:1789477436.074928:0:5831:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000d05cf15f/0xafddb3c8f92825ca lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2e32 expref: 9 pid: 6696 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789477436.074987:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 83 00000100:00100000:1.0:1789477436.075000:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d4766b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9bc33f26-0aab-4a14-832f-c58d566de1b0+9:2355:x1876402783746944:12345-192.168.201.23@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789477436.075022:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789477436.075054:0:5831:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000d05cf15f/0xafddb3c8f92825ca lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2e32 expref: 9 pid: 6696 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477436.075077:0:5831:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000d05cf15f/0xafddb3c8f92825ca lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2e32 expref: 9 pid: 6696 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477436.075106:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d05cf15f/0xafddb3c8f92825ca lrc: 0/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2e32 expref: 9 pid: 6696 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477436.075150:0:5831:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789477436.075155:0:5831:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789477436.075162:0:5831:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000006b2f4150/0xafddb3c8f92825ed lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477436.075172:0:5831:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006b2f4150/0xafddb3c8f92825ed lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477436.075283:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789477436.075361:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d4766b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9bc33f26-0aab-4a14-832f-c58d566de1b0+8:2355:x1876402783746944:12345-192.168.201.23@tcp:103:ldlm_bl.0 Request processed in 363us (1254us total) trans 0 rc 0/0 00000100:00100000:1.0:1789477436.075371:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 83 00010000:00010000:0.0:1789477436.076247:0:8241:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000006b2f4150/0xafddb3c8f92825ed lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477436.076266:0:8241:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006b2f4150/0xafddb3c8f92825ed lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477436.076405:0:8241:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 000000006b2f4150/0xafddb3c8f92825ed lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477436.076416:0:8241:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006b2f4150/0xafddb3c8f92825ed lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477436.076426:0:8241:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006b2f4150/0xafddb3c8f92825ed lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477436.076435:0:8241:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d0d7f518c00 already unused, calling callback (ffffffffc15972a0) 00010000:00010000:2.0:1789477436.076440:0:8241:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006b2f4150/0xafddb3c8f92825ed lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477436.076450:0:8241:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006b2f4150/0xafddb3c8f92825ed lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477436.076485:0:8241:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006b2f4150/0xafddb3c8f92825ed lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477436.076546:0:8241:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006b2f4150/0xafddb3c8f92825ed lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789477436.082370:0:8241:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d74f0ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9bc33f26-0aab-4a14-832f-c58d566de1b0+7:2354:x1876402783746816:12345-192.168.201.23@tcp:1:lhsmtool_posix.0 Request processed in 24097us (24434us total) trans 0 rc 0/0 00000100:00100000:2.0:1789477436.082390:0:8241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 70 00010000:00010000:1.0:1789477436.092079:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789477436.094069:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:3.0:1789477436.094174:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783747200 00000100:00100000:3.0:1789477436.094188:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783747200 00000100:00100000:3.0:1789477436.094267:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 230 00000100:00100000:3.0:1789477436.094281:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d4766aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9bc33f26-0aab-4a14-832f-c58d566de1b0+19:11602:x1876402783747200:12345-192.168.201.23@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1789477436.094403:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49ecba00/0xafddb3c8f92825f4 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477436.094427:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49ecba00/0xafddb3c8f92825f4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477436.094464:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49ecba00/0xafddb3c8f92825f4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477436.094822:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49ecbc00/0xafddb3c8f92825fb lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477436.094836:0:5846:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f518000/0xafddb3c8f92825ae lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2e1d expref: 20 pid: 12091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477436.094846:0:5846:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49ecbc00/0xafddb3c8f92825fb lrc: 4/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477436.094894:0:5846:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f518000/0xafddb3c8f92825ae lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2e1d expref: 20 pid: 12091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477436.094911:0:5846:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f518000/0xafddb3c8f92825ae lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2e1d expref: 20 pid: 12091 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789477436.094928:0:5846:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d7c60fb80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5846:1876402802603648:192.168.201.23@tcp:104: 00000100:00100000:3.0:1789477436.095045:0:5846:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d0d585b2180 going to sleep for 11 seconds 00000100:00100000:3.0:1789477436.098899:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:0.0:1789477436.099070:0:5846:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d7c60fb80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5846:1876402802603648:192.168.201.23@tcp:104: 00010000:00010000:0.0:1789477436.099106:0:5846:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49ecbc00/0xafddb3c8f92825fb lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789477436.100927:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783747328 00000100:00100000:2.0:1789477436.100948:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783747328 00010000:00010000:3.0:1789477436.110771:0:5830:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f518000/0xafddb3c8f92825ae lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2e1d expref: 21 pid: 12091 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789477436.110856:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 84 00000100:00100000:3.0:1789477436.110871:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d7c60e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9bc33f26-0aab-4a14-832f-c58d566de1b0+21:2354:x1876402783747328:12345-192.168.201.23@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789477436.110893:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789477436.110922:0:5830:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f518000/0xafddb3c8f92825ae lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2e1d expref: 21 pid: 12091 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477436.110937:0:5830:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f518000/0xafddb3c8f92825ae lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2e1d expref: 21 pid: 12091 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477436.110967:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f518000/0xafddb3c8f92825ae lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2e1d expref: 21 pid: 12091 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477436.110989:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9d0d596ae500) 00010000:00010000:3.0:1789477436.110995:0:5830:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49ecbc00/0xafddb3c8f92825fb lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477436.111007:0:5830:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49ecbc00/0xafddb3c8f92825fb lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477436.111015:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49ecbc00/0xafddb3c8f92825fb lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477436.111044:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789477436.111207:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d7c60e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9bc33f26-0aab-4a14-832f-c58d566de1b0+20:2354:x1876402783747328:12345-192.168.201.23@tcp:103:ldlm_bl.0 Request processed in 340us (12325us total) trans 0 rc 0/0 00000100:00100000:3.0:1789477436.111215:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 84 00010000:00010000:0.0:1789477436.112922:0:5846:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49ecbc00/0xafddb3c8f92825fb lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477436.112944:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49ecbc00/0xafddb3c8f92825fb lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789477436.113210:0:5846:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967509 00000001:00080000:0.0:1789477436.113371:0:5846:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967510 00000001:00080000:0.0:1789477436.113408:0:5846:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967511 00000100:00100000:0.0:1789477436.113558:0:5846:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d75287b80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5846:1876402802603776:0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1789477436.113935:0:5846:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789477436.113980:0:5846:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d0d4840cc00 going to sleep for 11 seconds 00000100:00100000:1.0:1789477436.115273:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802603776 00000100:00100000:1.0:1789477436.115289:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802603776 00000100:00100000:1.0:1789477436.115373:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1789477436.115387:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d75284380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5846:x1876402802603776:12345-0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1789477436.115541:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d75284380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5846:x1876402802603776:12345-0@lo:1000:mdt00_002.0 Request processed in 158us (1606us total) trans 0 rc 0/0 00000100:00100000:1.0:1789477436.115549:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1789477436.115626:0:5846:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967317 gen 2 00000004:00080000:3.0:1789477436.115634:0:5846:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967317 committed transno 4294967317 00000100:00100000:3.0:1789477436.115667:0:5846:0:(client.c:3169:ptlrpc_free_committed()) @@@ stopping search req@ffff9d0d7c60d880 x1876402802603136/t4294967321(4294967321) o6->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1789477451 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789477436.115693:0:5846:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d75287b80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5846:1876402802603776:0@lo:1000:mdt00_002.0 00000001:00080000:3.0:1789477436.116285:0:5846:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967512 00000100:00100000:3.0:1789477436.116408:0:5846:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d7c60d500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5846:1876402802603904:0@lo:1000:mdt00_002.0 00000100:00100000:3.0:1789477436.118850:0:5846:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789477436.118894:0:5846:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d0d585b2180 going to sleep for 11 seconds 00000100:00100000:1.0:1789477436.119407:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802603904 00000100:00100000:1.0:1789477436.119422:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802603904 00000100:00100000:1.0:1789477436.119513:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1789477436.119525:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d7c60ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5846:x1876402802603904:12345-0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1789477436.121710:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d7c60ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:5846:x1876402802603904:12345-0@lo:1000:mdt00_002.0 Request processed in 2174us (2858us total) trans 4294967323 rc 0/0 00000100:00100000:2.0:1789477436.121738:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1789477436.122130:0:5846:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d7c60d500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5846:1876402802603904:0@lo:1000:mdt00_002.0 00010000:00010000:3.0:1789477436.122196:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49ecbc00/0xafddb3c8f92825fb lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477436.122208:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49ecbc00/0xafddb3c8f92825fb lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477436.122216:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49ecbc00/0xafddb3c8f92825fb lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477436.122223:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d0d49ecbc00 already unused, calling callback (ffffffffc1fd54f0) 00010000:00010000:3.0:1789477436.122229:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49ecbc00/0xafddb3c8f92825fb lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477436.122238:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49ecbc00/0xafddb3c8f92825fb lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477436.122258:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9d0d596ae500) 00010000:00010000:3.0:1789477436.122261:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789477436.122267:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49ecbc00/0xafddb3c8f92825fb lrc: 2/0,0 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477436.122273:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49ecbc00/0xafddb3c8f92825fb lrc: 0/0,0 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477436.122317:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be5800/0xafddb3c8f928253e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477436.122325:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be5800/0xafddb3c8f928253e lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477436.122350:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be5800/0xafddb3c8f928253e lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477436.122356:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d0d50be5800 already unused, calling callback (ffffffffc1fd54f0) 00010000:00010000:3.0:1789477436.122359:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be5800/0xafddb3c8f928253e lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477436.122366:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be5800/0xafddb3c8f928253e lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477436.122375:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9d0d44f4e500) 00010000:00010000:3.0:1789477436.122378:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789477436.122387:0:5846:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d41647000/0xafddb3c8f9282545 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2e01 expref: 23 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477436.122401:0:5846:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d41647000/0xafddb3c8f9282545 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2e01 expref: 23 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477436.122411:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d41647000/0xafddb3c8f9282545 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2e01 expref: 23 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477436.122472:0:5846:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d41647000/0xafddb3c8f9282545 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2e01 expref: 23 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789477436.122488:0:5846:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d7c60ce00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5846:1876402802604032:192.168.201.23@tcp:105: 00000100:00100000:3.0:1789477436.122614:0:5846:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d0d7fb8d300 going to sleep for 11 seconds 00000100:00100000:2.0:1789477436.128342:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:3.0:1789477436.128646:0:5846:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d7c60ce00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5846:1876402802604032:192.168.201.23@tcp:105: 00010000:00010000:3.0:1789477436.128729:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be5800/0xafddb3c8f928253e lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477436.128742:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be5800/0xafddb3c8f928253e lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477436.128787:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49eca000/0xafddb3c8f9282602 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477436.128804:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49eca000/0xafddb3c8f9282602 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477436.128819:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49eca000/0xafddb3c8f9282602 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477436.128830:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49eca000/0xafddb3c8f9282602 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477436.128838:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49eca000/0xafddb3c8f9282602 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477436.128844:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49eca000/0xafddb3c8f9282602 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477436.128851:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d0d49eca000 already unused, calling callback (ffffffffc1fd54f0) 00010000:00010000:3.0:1789477436.128855:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49eca000/0xafddb3c8f9282602 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477436.128863:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49eca000/0xafddb3c8f9282602 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477436.128876:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9d0d44f4e500) 00010000:00010000:3.0:1789477436.128879:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789477436.128891:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49eca000/0xafddb3c8f9282602 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477436.128898:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49eca000/0xafddb3c8f9282602 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477436.128915:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49ecba00/0xafddb3c8f92825f4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477436.128921:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49ecba00/0xafddb3c8f92825f4 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477436.128927:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49ecba00/0xafddb3c8f92825f4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477436.128932:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d0d49ecba00 already unused, calling callback (ffffffffc1fd54f0) 00010000:00010000:3.0:1789477436.128934:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49ecba00/0xafddb3c8f92825f4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477436.128940:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49ecba00/0xafddb3c8f92825f4 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477436.128948:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9d0d44f4e500) 00010000:00010000:3.0:1789477436.129073:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1789477436.129078:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49ecba00/0xafddb3c8f92825f4 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477436.129085:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49ecba00/0xafddb3c8f92825f4 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1789477436.129698:0:11717:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1789477436.129705:0:11717:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1789477436.130317:0:11717:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:2.0:1789477436.130329:0:11717:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1789477436.130591:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d4766aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9bc33f26-0aab-4a14-832f-c58d566de1b0+23:11602:x1876402783747200:12345-192.168.201.23@tcp:57:lhsmtool_posix.0 Request processed in 36290us (36512us total) trans 4294967513 rc 0/0 00000100:00100000:3.0:1789477436.130606:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 230 00000020:00080000:3.0:1789477436.130629:0:5846:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000100:00100000:1.0:1789477436.131612:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783747456 00000100:00100000:1.0:1789477436.131641:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783747456 00000100:00100000:1.0:1789477436.131704:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 61 00000100:00100000:1.0:1789477436.131726:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d47668700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9bc33f26-0aab-4a14-832f-c58d566de1b0+23:11601:x1876402783747456:12345-192.168.201.23@tcp:49:lfs.0 00000100:00100000:1.0:1789477436.131908:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d47668700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9bc33f26-0aab-4a14-832f-c58d566de1b0+23:11601:x1876402783747456:12345-192.168.201.23@tcp:49:lfs.0 Request processed in 194us (3589us total) trans 0 rc 0/0 00000100:00100000:1.0:1789477436.131917:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 61 00000100:00100000:2.0:1789477436.138941:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:3.0:1789477436.139105:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783747712 00000100:00100000:3.0:1789477436.139120:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783747712 00000100:00100000:3.0:1789477436.139193:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 62 00000100:00100000:3.0:1789477436.139205:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d5845c050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9bc33f26-0aab-4a14-832f-c58d566de1b0+23:11602:x1876402783747712:12345-192.168.201.23@tcp:35:lhsmtool_posix.0 00000004:00080000:2.0:1789477436.140381:0:5847:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x10:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:2.0:1789477436.140513:0:5847:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967514 00010000:00010000:2.0:1789477436.140613:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d41647800/0xafddb3c8f9282609 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477436.140636:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d41647800/0xafddb3c8f9282609 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477436.140665:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d41647800/0xafddb3c8f9282609 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477436.140676:0:5847:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d41647800/0xafddb3c8f9282609 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477436.140683:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d41647800/0xafddb3c8f9282609 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477436.140691:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d41647800/0xafddb3c8f9282609 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477436.140746:0:5847:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1789477436.140869:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d5845c050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9bc33f26-0aab-4a14-832f-c58d566de1b0+25:11602:x1876402783747712:12345-192.168.201.23@tcp:35:lhsmtool_posix.0 Request processed in 1661us (1941us total) trans 4294967515 rc 0/0 00000100:00100000:2.0:1789477436.140880:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 62 00000020:00080000:2.0:1789477436.140887:0:5847:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1789477436.141559:0:5832:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789477436.141570:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d41647800/0xafddb3c8f9282609 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477436.141596:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d0d41647800 already unused, calling callback (ffffffffc15972a0) 00010000:00010000:3.0:1789477436.141601:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d41647800/0xafddb3c8f9282609 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477436.141612:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d41647800/0xafddb3c8f9282609 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477436.141629:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9d0d50919700) 00010000:00010000:3.0:1789477436.141632:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1789477436.141638:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d41647800/0xafddb3c8f9282609 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477436.141644:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d41647800/0xafddb3c8f9282609 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477436.141684:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789477436.141686:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789477436.141688:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789477436.146894:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:0.0:1789477436.147033:0:6999:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783747968 00000100:00100000:0.0:1789477436.147059:0:6999:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783747968 00000100:00100000:0.0:1789477436.147139:0:6999:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 231 00000100:00100000:0.0:1789477436.147152:0:6999:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d47668700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9bc33f26-0aab-4a14-832f-c58d566de1b0+25:11601:x1876402783747968:12345-192.168.201.23@tcp:58:lfs.0 00000040:00080000:0.0:1789477436.147526:0:6999:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].6, 136 off9008 00000100:00100000:0.0:1789477436.147674:0:6999:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d47668700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9bc33f26-0aab-4a14-832f-c58d566de1b0+25:11601:x1876402783747968:12345-192.168.201.23@tcp:58:lfs.0 Request processed in 524us (797us total) trans 0 rc 0/0 00000100:00100000:0.0:1789477436.147684:0:6999:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 231 00000100:00100000:2.0:1789477436.218973:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:0.0:1789477436.219712:0:12091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783748096 00000100:00100000:0.0:1789477436.219736:0:12091:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783748096 00000100:00100000:2.0:1789477436.220191:0:12091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 232 00000100:00100000:2.0:1789477436.220208:0:12091:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d47668a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9bc33f26-0aab-4a14-832f-c58d566de1b0+25:11605:x1876402783748096:12345-192.168.201.23@tcp:101:lfs.0 00010000:00010000:2.0:1789477436.220254:0:12091:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789477436.220281:0:12091:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d41646a00/0xafddb3c8f9282610 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa90d500d7b8f2e39 expref: -99 pid: 12091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477436.220366:0:12091:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d41647800/0xafddb3c8f9282617 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 12091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477436.220385:0:12091:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d41647800/0xafddb3c8f9282617 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477436.220418:0:12091:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d41647800/0xafddb3c8f9282617 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477436.220436:0:12091:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d41647a00/0xafddb3c8f928261e lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477436.220444:0:12091:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d41647a00/0xafddb3c8f928261e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477436.220452:0:12091:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d41647a00/0xafddb3c8f928261e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477436.220875:0:12091:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50417a00/0xafddb3c8f9282625 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477436.220889:0:12091:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f518a00/0xafddb3c8f9282530 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2dfa expref: 26 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477436.220899:0:12091:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50417a00/0xafddb3c8f9282625 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477436.220941:0:12091:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f518a00/0xafddb3c8f9282530 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2dfa expref: 26 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477436.220971:0:12091:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f518a00/0xafddb3c8f9282530 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2dfa expref: 26 pid: 5844 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789477436.220988:0:12091:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d58072d80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12091:1876402802604160:192.168.201.23@tcp:104: 00000100:00100000:2.0:1789477436.221698:0:12091:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d0d44480f00 going to sleep for 11 seconds 00000100:00100000:1.0:1789477436.235799:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:3.0:1789477436.236146:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783748352 00000100:00100000:3.0:1789477436.236161:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783748352 00000100:00100000:3.0:1789477436.236240:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 63 00000100:00100000:3.0:1789477436.236253:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d4e640000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9bc33f26-0aab-4a14-832f-c58d566de1b0+27:9241:x1876402783748352:12345-192.168.201.23@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1789477436.236640:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d4e640000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9bc33f26-0aab-4a14-832f-c58d566de1b0+28:9241:x1876402783748352:12345-192.168.201.23@tcp:35:ldlm_bl.0 Request processed in 388us (856us total) trans 4294967516 rc 0/0 00000100:00100000:3.0:1789477436.236649:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 63 00000100:00100000:2.0:1789477436.238415:0:12091:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d58072d80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12091:1876402802604160:192.168.201.23@tcp:104: 00010000:00010000:2.0:1789477436.238465:0:12091:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50417a00/0xafddb3c8f9282625 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12091 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789477436.241923:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:1.0:1789477436.242104:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783748480 00000100:00100000:1.0:1789477436.242118:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783748480 00010000:00010000:1.0:1789477436.242170:0:5831:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f518a00/0xafddb3c8f9282530 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2dfa expref: 28 pid: 5844 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789477436.242220:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 85 00000100:00100000:1.0:1789477436.242232:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d58072d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9bc33f26-0aab-4a14-832f-c58d566de1b0+28:2354:x1876402783748480:12345-192.168.201.23@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789477436.242255:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789477436.242263:0:5831:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f518a00/0xafddb3c8f9282530 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2dfa expref: 28 pid: 5844 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477436.242278:0:5831:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f518a00/0xafddb3c8f9282530 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2dfa expref: 28 pid: 5844 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477436.242306:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f518a00/0xafddb3c8f9282530 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2dfa expref: 28 pid: 5844 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477436.242327:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9d0d44f4e500) 00010000:00010000:1.0:1789477436.242334:0:5831:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50417a00/0xafddb3c8f9282625 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477436.242370:0:5831:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50417a00/0xafddb3c8f9282625 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 12091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477436.242379:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50417a00/0xafddb3c8f9282625 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 12091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477436.242842:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789477436.242921:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d58072d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9bc33f26-0aab-4a14-832f-c58d566de1b0+27:2354:x1876402783748480:12345-192.168.201.23@tcp:103:ldlm_bl.0 Request processed in 690us (1012us total) trans 0 rc 0/0 00000100:00100000:1.0:1789477436.242931:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 85 00010000:00010000:3.0:1789477436.253185:0:12091:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50417a00/0xafddb3c8f9282625 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477436.253211:0:12091:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50417a00/0xafddb3c8f9282625 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12091 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789477436.253285:0:12091:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:3.0:1789477436.253291:0:12091:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1789477436.253318:0:12091:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50417a00/0xafddb3c8f9282625 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477436.253337:0:12091:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50417a00/0xafddb3c8f9282625 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477436.253350:0:12091:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d41647800/0xafddb3c8f9282617 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477436.253358:0:12091:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d41647800/0xafddb3c8f9282617 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 12091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477436.253366:0:12091:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d41647800/0xafddb3c8f9282617 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477436.253373:0:12091:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d0d41647800 already unused, calling callback (ffffffffc1fd54f0) 00010000:00010000:3.0:1789477436.253378:0:12091:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d41647800/0xafddb3c8f9282617 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477436.253386:0:12091:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d41647800/0xafddb3c8f9282617 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 12091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477436.253440:0:12091:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9d0d44568d00) 00010000:00010000:3.0:1789477436.253443:0:12091:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789477436.253449:0:12091:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d41647800/0xafddb3c8f9282617 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477436.253456:0:12091:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d41647800/0xafddb3c8f9282617 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477436.253477:0:12091:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d41647a00/0xafddb3c8f928261e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477436.253484:0:12091:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d41647a00/0xafddb3c8f928261e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477436.253490:0:12091:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d41647a00/0xafddb3c8f928261e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477436.253495:0:12091:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d0d41647a00 already unused, calling callback (ffffffffc1fd54f0) 00010000:00010000:3.0:1789477436.253498:0:12091:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d41647a00/0xafddb3c8f928261e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477436.253504:0:12091:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d41647a00/0xafddb3c8f928261e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477436.253512:0:12091:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9d0d50919400) 00010000:00010000:3.0:1789477436.253515:0:12091:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789477436.253518:0:12091:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d41647a00/0xafddb3c8f928261e lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477436.253524:0:12091:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d41647a00/0xafddb3c8f928261e lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477436.253846:0:12091:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d41646a00/0xafddb3c8f9282610 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2e39 expref: 27 pid: 12091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477436.253868:0:12091:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50417a00/0xafddb3c8f9282625 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2e39 expref: 26 pid: 12091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477436.253876:0:12091:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9d0d44f4e500) 00010000:00010000:3.0:1789477436.253877:0:12091:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789477436.253881:0:12091:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d0d50417a00, rc 0) 00000100:00100000:3.0:1789477436.254054:0:12091:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d47668a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9bc33f26-0aab-4a14-832f-c58d566de1b0+26:11605:x1876402783748096:12345-192.168.201.23@tcp:101:lfs.0 Request processed in 33849us (35109us total) trans 0 rc 0/0 00000100:00100000:3.0:1789477436.254064:0:12091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 232 00010000:00010000:3.0:1789477437.107475:0:6710:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1789477437.154964:0:12494:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1789477437.154982:0:12494:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1789477437.155041:0:12494:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:3.0:1789477437.155052:0:12494:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000040:00080000:3.0:1789477437.169968:0:11717:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1789477437.169984:0:11717:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1789477437.170033:0:11717:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:3.0:1789477437.170043:0:11717:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1789477437.170221:0:11717:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d7c60ce00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11717:1876402802604288:192.168.201.23@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1789477437.170360:0:11717:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d0d7fb8df00 going to sleep for 11 seconds 00000100:00100000:3.0:1789477437.175527:0:11717:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d7c60ce00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11717:1876402802604288:192.168.201.23@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1789477437.176471:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:3.0:1789477437.176875:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783748608 00000100:00100000:3.0:1789477437.176889:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783748608 00000100:00080000:2.0:1789477437.177052:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789477437.177951:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 233 00000100:00100000:3.0:1789477437.177974:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d6d3d5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9bc33f26-0aab-4a14-832f-c58d566de1b0+26:11616:x1876402783748608:12345-192.168.201.23@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1789477437.178027:0:5846:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1789477437.178177:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d6d3d5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9bc33f26-0aab-4a14-832f-c58d566de1b0+26:11616:x1876402783748608:12345-192.168.201.23@tcp:53:lhsmtool_posix.0 Request processed in 214us (1714us total) trans 0 rc 0/0 00000100:00100000:3.0:1789477437.178186:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 233 00000100:00100000:1.0:1789477437.194458:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:2.0:1789477437.197183:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783748864 00000100:00100000:2.0:1789477437.197206:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783748864 00000100:00100000:2.0:1789477437.197290:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 234 00000100:00100000:2.0:1789477437.197306:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d4e641180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9bc33f26-0aab-4a14-832f-c58d566de1b0+26:11616:x1876402783748864:12345-192.168.201.23@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789477437.197334:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789477437.197365:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50417600/0xafddb3c8f928262c lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa90d500d7b8f2e40 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477437.197516:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50417200/0xafddb3c8f9282633 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477437.197534:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50417200/0xafddb3c8f9282633 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477437.197548:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50417200/0xafddb3c8f9282633 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789477437.197563:0:5845:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:2.0:1789477437.197771:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50417600/0xafddb3c8f928262c lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2e40 expref: 29 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477437.197794:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50417200/0xafddb3c8f9282633 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2e40 expref: 28 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477437.197829:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9d0d44f4e500) 00010000:00010000:2.0:1789477437.197832:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789477437.197836:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d0d50417200, rc 0) 00000100:00100000:2.0:1789477437.197927:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d4e641180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9bc33f26-0aab-4a14-832f-c58d566de1b0+28:11616:x1876402783748864:12345-192.168.201.23@tcp:101:lhsmtool_posix.0 Request processed in 625us (3484us total) trans 4294967517 rc 0/0 00000100:00100000:2.0:1789477437.197936:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 234 00000100:00100000:1.0:1789477437.203048:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:3.0:1789477437.203173:0:12091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783749120 00000100:00100000:3.0:1789477437.203187:0:12091:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783749120 00000100:00100000:3.0:1789477437.203261:0:12091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 235 00000100:00100000:3.0:1789477437.203272:0:12091:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d74cdbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9bc33f26-0aab-4a14-832f-c58d566de1b0+28:11616:x1876402783749120:12345-192.168.201.23@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1789477437.203377:0:12091:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49ecba00/0xafddb3c8f9282641 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 12091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477437.203399:0:12091:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49ecba00/0xafddb3c8f9282641 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477437.203413:0:12091:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49ecba00/0xafddb3c8f9282641 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477437.203747:0:12091:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49ecba00/0xafddb3c8f9282641 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477437.203757:0:12091:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49ecba00/0xafddb3c8f9282641 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 12091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477437.203766:0:12091:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49ecba00/0xafddb3c8f9282641 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477437.203773:0:12091:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d0d49ecba00 already unused, calling callback (ffffffffc1fd54f0) 00010000:00010000:3.0:1789477437.203779:0:12091:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49ecba00/0xafddb3c8f9282641 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477437.203795:0:12091:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49ecba00/0xafddb3c8f9282641 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 12091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477437.203811:0:12091:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9d0d44f4e500) 00010000:00010000:3.0:1789477437.203815:0:12091:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1789477437.203821:0:12091:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49ecba00/0xafddb3c8f9282641 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477437.203828:0:12091:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49ecba00/0xafddb3c8f9282641 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12091 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789477437.204040:0:12091:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d74cdbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9bc33f26-0aab-4a14-832f-c58d566de1b0+29:11616:x1876402783749120:12345-192.168.201.23@tcp:57:lhsmtool_posix.0 Request processed in 767us (1002us total) trans 4294967518 rc 0/0 00000100:00100000:3.0:1789477437.204049:0:12091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 235 00000040:00080000:3.0:1789477437.204312:0:11717:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1789477437.204319:0:11717:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1789477437.204881:0:11717:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:3.0:1789477437.204893:0:11717:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1789477437.211461:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:3.0:1789477437.211834:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783749248 00000100:00100000:3.0:1789477437.211849:0:6711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783749248 00000100:00100000:3.0:1789477437.211944:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 18 00000100:00100000:3.0:1789477437.211956:0:6711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d50a82c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9bc33f26-0aab-4a14-832f-c58d566de1b0+29:2353:x1876402783749248:12345-192.168.201.23@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789477437.211975:0:6711:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789477437.212006:0:6711:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50417200/0xafddb3c8f9282633 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2e40 expref: 29 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477437.212041:0:6711:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9d0d44f4e500) 00010000:00010000:3.0:1789477437.212064:0:6711:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789477437.212139:0:6711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d50a82c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9bc33f26-0aab-4a14-832f-c58d566de1b0+28:2353:x1876402783749248:12345-192.168.201.23@tcp:103:ldlm_bl.0 Request processed in 185us (692us total) trans 0 rc 0/0 00000100:00100000:3.0:1789477437.212148:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 18 00000100:00100000:0.0:1789477437.214568:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:3.0:1789477437.214765:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783749504 00000100:00100000:3.0:1789477437.214780:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783749504 00000100:00100000:3.0:1789477437.214860:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 64 00000100:00100000:3.0:1789477437.214873:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d75285f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9bc33f26-0aab-4a14-832f-c58d566de1b0+28:11616:x1876402783749504:12345-192.168.201.23@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1789477437.215219:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d75285f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9bc33f26-0aab-4a14-832f-c58d566de1b0+29:11616:x1876402783749504:12345-192.168.201.23@tcp:35:lhsmtool_posix.0 Request processed in 347us (667us total) trans 4294967519 rc 0/0 00000100:00100000:3.0:1789477437.215229:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 64 00000100:00100000:1.0:1789477437.873778:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789477437.873813:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d75285180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1876402802604416:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789477437.873914:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789477437.874173:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802604416 00000100:00100000:0.0:1789477437.874255:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802604416 00000100:00100000:0.0:1789477437.874348:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1789477437.874363:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d74cd8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+8:3310:x1876402802604416:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789477437.874415:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 52756480 pending 1703936 free 3859808256 avail 3857711104 00000100:00080000:2.0:1789477437.874606:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789477437.875323:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d74cd8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+8:3310:x1876402802604416:12345-0@lo:13:osp-pre-0-0.0 Request processed in 956us (1401us total) trans 0 rc 0/0 00000100:00100000:0.0:1789477437.875335:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1789477437.877424:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d75285180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1876402802604416:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1789477438.128992:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1789477438.499977:0:6730:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967310 is committed 00000001:00080000:1.0:1789477438.500077:0:6730:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967308 is committed 00010000:00010000:3.0:1789477439.152880:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1789477439.276703:0:12547:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1789477439.276719:0:12547:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1789477439.276772:0:12547:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:0.0:1789477439.276778:0:12547:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1789477439.455814:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:3.0:1789477439.455867:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:3.0:1789477439.455893:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:3.0:1789477439.455914:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:3.0:1789477439.455938:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:3.0:1789477439.455972:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783750144 00000100:00100000:3.0:1789477439.455995:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783750144 00000100:00100000:3.0:1789477439.456070:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783749760 00000100:00100000:3.0:1789477439.456074:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783749760 00000100:00100000:3.0:1789477439.456101:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 161 00000100:00100000:3.0:1789477439.456112:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d7c60e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cf70c55a-e056-446b-8936-49e7cd31fc79+5:2353:x1876402783750144:12345-192.168.201.23@tcp:400:kworker.0 00000100:00100000:0.0:1789477439.456166:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783749888 00000100:00100000:0.0:1789477439.456171:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783749888 00000100:00100000:0.0:1789477439.456209:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783750016 00000100:00100000:0.0:1789477439.456213:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783750016 00000100:00100000:3.0:1789477439.456222:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d7c60e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cf70c55a-e056-446b-8936-49e7cd31fc79+5:2353:x1876402783750144:12345-192.168.201.23@tcp:400:kworker.0 Request processed in 111us (327us total) trans 0 rc 0/0 00000100:00100000:3.0:1789477439.456230:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 161 00000100:00100000:0.0:1789477439.456232:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 79 00000100:00100000:0.0:1789477439.456239:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d7c60c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9bc33f26-0aab-4a14-832f-c58d566de1b0+5:2353:x1876402783749888:12345-192.168.201.23@tcp:400:kworker.0 00000100:00100000:3.0:1789477439.456250:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 162 00000100:00100000:3.0:1789477439.456264:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d7c60ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9bc33f26-0aab-4a14-832f-c58d566de1b0+29:2353:x1876402783749760:12345-192.168.201.23@tcp:400:kworker.0 00000100:00100000:0.0:1789477439.456268:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d7c60c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9bc33f26-0aab-4a14-832f-c58d566de1b0+5:2353:x1876402783749888:12345-192.168.201.23@tcp:400:kworker.0 Request processed in 31us (401us total) trans 0 rc 0/0 00000100:00100000:0.0:1789477439.456273:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 79 00000100:00100000:0.0:1789477439.456286:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 80 00000100:00100000:0.0:1789477439.456292:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d7c60d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9bc33f26-0aab-4a14-832f-c58d566de1b0+7:2353:x1876402783750016:12345-192.168.201.23@tcp:400:kworker.0 00000100:00100000:3.0:1789477439.456294:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d7c60ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9bc33f26-0aab-4a14-832f-c58d566de1b0+29:2353:x1876402783749760:12345-192.168.201.23@tcp:400:kworker.0 Request processed in 32us (380us total) trans 0 rc 0/0 00000100:00100000:3.0:1789477439.456300:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 162 00000100:00100000:0.0:1789477439.456313:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d7c60d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9bc33f26-0aab-4a14-832f-c58d566de1b0+7:2353:x1876402783750016:12345-192.168.201.23@tcp:400:kworker.0 Request processed in 21us (374us total) trans 0 rc 0/0 00000100:00100000:0.0:1789477439.456319:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 80 00000100:00100000:2.0:1789477439.457814:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783749632 00000100:00100000:2.0:1789477439.457829:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783749632 00000100:00100000:2.0:1789477439.457877:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 299 00000100:00100000:2.0:1789477439.457887:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d4e677850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5c82dded-6a10-4ce8-abd1-52bd956b9523+13:2353:x1876402783749632:12345-192.168.201.23@tcp:400:kworker.0 00000100:00100000:2.0:1789477439.457957:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d4e677850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5c82dded-6a10-4ce8-abd1-52bd956b9523+13:2353:x1876402783749632:12345-192.168.201.23@tcp:400:kworker.0 Request processed in 72us (2157us total) trans 0 rc 0/0 00000100:00100000:2.0:1789477439.457964:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 299 00000100:00080000:2.0:1789477439.458027:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789477439.458033:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789477439.458037:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789477439.494961:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:0.0:1789477439.495754:0:6999:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783750400 00000100:00100000:0.0:1789477439.495770:0:6999:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783750400 00000100:00100000:3.0:1789477439.495887:0:6999:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 236 00000100:00100000:3.0:1789477439.495902:0:6999:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d7c60fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9bc33f26-0aab-4a14-832f-c58d566de1b0+29:11637:x1876402783750400:12345-192.168.201.23@tcp:101:lfs.0 00010000:00010000:3.0:1789477439.495931:0:6999:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789477439.495959:0:6999:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49ecba00/0xafddb3c8f9282648 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa90d500d7b8f2e47 expref: -99 pid: 6999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477439.496223:0:6999:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49eca000/0xafddb3c8f928264f lrc: 3/1,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477439.496242:0:6999:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49eca000/0xafddb3c8f928264f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477439.496256:0:6999:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49eca000/0xafddb3c8f928264f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6999 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789477439.496270:0:6999:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:3.0:1789477439.496445:0:6999:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49ecba00/0xafddb3c8f9282648 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2e47 expref: 32 pid: 6999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477439.496464:0:6999:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49eca000/0xafddb3c8f928264f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2e47 expref: 31 pid: 6999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477439.496475:0:6999:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9d0d44f4e500) 00010000:00010000:3.0:1789477439.496626:0:6999:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1789477439.496632:0:6999:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d0d49eca000, rc 0) 00000100:00100000:3.0:1789477439.496826:0:6999:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d7c60fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9bc33f26-0aab-4a14-832f-c58d566de1b0+31:11637:x1876402783750400:12345-192.168.201.23@tcp:101:lfs.0 Request processed in 926us (1884us total) trans 4294967520 rc 0/0 00000100:00100000:3.0:1789477439.496835:0:6999:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 236 00000100:00100000:0.0:1789477439.503800:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:3.0:1789477439.503921:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783750528 00000100:00100000:3.0:1789477439.503935:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783750528 00000100:00100000:3.0:1789477439.504028:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 237 00000100:00100000:3.0:1789477439.504042:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d75287b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9bc33f26-0aab-4a14-832f-c58d566de1b0+31:11637:x1876402783750528:12345-192.168.201.23@tcp:54:lfs.0 00010000:00010000:3.0:1789477439.504280:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49ecbc00/0xafddb3c8f928265d lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477439.504305:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49ecbc00/0xafddb3c8f928265d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477439.504319:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49ecbc00/0xafddb3c8f928265d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477439.504355:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49ecbc00/0xafddb3c8f928265d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477439.504362:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49ecbc00/0xafddb3c8f928265d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477439.504370:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49ecbc00/0xafddb3c8f928265d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477439.504376:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d0d49ecbc00 already unused, calling callback (ffffffffc1fd54f0) 00010000:00010000:3.0:1789477439.504382:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49ecbc00/0xafddb3c8f928265d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477439.504401:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49ecbc00/0xafddb3c8f928265d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477439.504490:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9d0d44f4e500) 00010000:00010000:3.0:1789477439.504494:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789477439.504500:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49ecbc00/0xafddb3c8f928265d lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477439.504507:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49ecbc00/0xafddb3c8f928265d lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789477439.504934:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d75287b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9bc33f26-0aab-4a14-832f-c58d566de1b0+31:11637:x1876402783750528:12345-192.168.201.23@tcp:54:lfs.0 Request processed in 893us (1149us total) trans 0 rc 0/0 00000100:00100000:3.0:1789477439.504944:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 237 00000100:00100000:1.0:1789477439.599172:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:0.0:1789477439.599903:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783750656 00000100:00100000:0.0:1789477439.599918:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783750656 00000100:00100000:0.0:1789477439.600121:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 71 00000100:00100000:0.0:1789477439.600134:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d74cd8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9bc33f26-0aab-4a14-832f-c58d566de1b0+7:2355:x1876402783750656:12345-192.168.201.23@tcp:101:cat.0 00010000:00010000:0.0:1789477439.600164:0:6697:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789477439.600193:0:6697:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000bc5573ae/0xafddb3c8f9282664 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa90d500d7b8f2e4e expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789477439.600232:0:6697:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x6:0x0] initial LVB size: 13, mtime: 0x6aa9423a, atime: 0x6aa94239, ctime: 0x6aa9423a, blocks: 0xb 00010000:00010000:0.0:1789477439.600260:0:6697:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=384s v=(0 0) 00010000:00010000:0.0:1789477439.600266:0:6697:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789477439.600295:0:6697:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bc5573ae/0xafddb3c8f9282664 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2e4e expref: 8 pid: 6697 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477439.600319:0:6697:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000bc5573ae/0xafddb3c8f9282664 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2e4e expref: 8 pid: 6697 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477439.600336:0:6697:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d0d50be5800, rc 0) 00000100:00100000:0.0:1789477439.600430:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d74cd8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9bc33f26-0aab-4a14-832f-c58d566de1b0+8:2355:x1876402783750656:12345-192.168.201.23@tcp:101:cat.0 Request processed in 298us (1274us total) trans 0 rc 0/0 00000100:00100000:0.0:1789477439.600438:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 71 00000100:00100000:1.0:1789477439.605400:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:0.0:1789477439.605567:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783750784 00000100:00100000:0.0:1789477439.605609:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783750784 00002000:00100000:0.0:1789477439.605691:0:6701:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x6:0x0] (0->4095) req@ffff9d0d74cd8000 x1876402783750784/t0(0) o3->9bc33f26-0aab-4a14-832f-c58d566de1b0@192.168.201.23@tcp:610/0 lens 488/0 e 0 to 0 dl 1789477450 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789477439.605704:0:6701:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9d0d74cd8000 with x1876402783750784 ext(0->4095) 00002000:00010000:0.0:1789477439.605711:0:6701:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9d0d74cd8000 00000100:00100000:0.0:1789477439.605747:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 7 00000100:00100000:0.0:1789477439.605759:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d74cd8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:9bc33f26-0aab-4a14-832f-c58d566de1b0+8:2354:x1876402783750784:12345-192.168.201.23@tcp:3:cat.0 00000100:00100000:0.0:1789477439.606254:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d74cd8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:9bc33f26-0aab-4a14-832f-c58d566de1b0+8:2354:x1876402783750784:12345-192.168.201.23@tcp:3:cat.0 Request processed in 494us (867us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1789477439.606263:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 7 00002000:00100000:0.0:1789477439.606271:0:6701:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x6:0x0] (0->4095) req@ffff9d0d74cd8000 x1876402783750784/t0(0) o3->9bc33f26-0aab-4a14-832f-c58d566de1b0@192.168.201.23@tcp:610/0 lens 488/4536 e 0 to 0 dl 1789477450 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789477439.606279:0:6701:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9d0d74cd8000 with x1876402783750784 ext(0->4095) 00002000:00010000:0.0:1789477439.606283:0:6701:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9d0d74cd8000 00010000:00010000:3.0:1789477440.178837:0:6710:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1789477440.308165:0:11717:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1789477440.308178:0:11717:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1789477440.308219:0:11717:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:0.0:1789477440.308226:0:11717:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1789477440.432937:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d623ca680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:07d5e05c-913f-419f-adbc-d3cf15e9cd51:3312:1876402802604544:0@lo:400:kworker.0 00000100:00100000:3.0:1789477440.433009:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789477440.433059:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d6d48b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3312:1876402802605056:0@lo:400:kworker.0 00000100:00100000:3.0:1789477440.433087:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789477440.433116:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1789477440.433122:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d74aaad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3312:1876402802604672:0@lo:400:kworker.0 00000100:00100000:3.0:1789477440.433143:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789477440.433161:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d6d489880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1876402802605184:0@lo:400:kworker.0 00000100:00100000:3.0:1789477440.433184:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789477440.433210:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d6d488700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3311:1876402802604928:0@lo:400:kworker.0 00000100:00100000:3.0:1789477440.433234:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789477440.433262:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789477440.433268:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d74aaa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1876402802604800:0@lo:400:kworker.0 00000100:00100000:3.0:1789477440.433289:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789477440.433317:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802604544 00000100:00100000:3.0:1789477440.433324:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802604544 00000100:00100000:3.0:1789477440.433367:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 300 00000100:00100000:3.0:1789477440.433376:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d4e676450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:07d5e05c-913f-419f-adbc-d3cf15e9cd51+19:3312:x1876402802604544:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789477440.433419:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d4e676450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:07d5e05c-913f-419f-adbc-d3cf15e9cd51+19:3312:x1876402802604544:12345-0@lo:400:kworker.0 Request processed in 44us (411us total) trans 0 rc 0/0 00000100:00100000:3.0:1789477440.433427:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 300 00000100:00100000:3.0:1789477440.433460:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802605056 00000100:00100000:3.0:1789477440.433463:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802605056 00000100:00100000:3.0:1789477440.433495:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802604672 00000100:00100000:3.0:1789477440.433499:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802604672 00000100:00100000:3.0:1789477440.433514:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802604928 00000100:00100000:3.0:1789477440.433517:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802604928 00000100:00100000:3.0:1789477440.433530:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:3.0:1789477440.433537:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d7c60f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1876402802605056:12345-0@lo:400:kworker.0 00000004:00080000:2.0:1789477440.433939:0:8044:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 385505359854ns, next at 386505357594ns, rc = 0 00000100:00100000:3.0:1789477440.434031:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d7c60f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1876402802605056:12345-0@lo:400:kworker.0 Request processed in 495us (942us total) trans 0 rc 0/0 00000100:00100000:3.0:1789477440.434039:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:3.0:1789477440.434055:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:3.0:1789477440.434061:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d7c60f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1876402802604672:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789477440.434184:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d7c60f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1876402802604672:12345-0@lo:400:kworker.0 Request processed in 122us (1039us total) trans 0 rc 0/0 00000100:00100000:3.0:1789477440.434191:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:3.0:1789477440.434206:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:3.0:1789477440.434212:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d7c60df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1876402802604928:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789477440.434248:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d7c60df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1876402802604928:12345-0@lo:400:kworker.0 Request processed in 36us (1013us total) trans 0 rc 0/0 00000100:00100000:3.0:1789477440.434254:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:3.0:1789477440.434320:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802605184 00000100:00100000:3.0:1789477440.434326:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802605184 00000100:00100000:3.0:1789477440.434356:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802604800 00000100:00100000:3.0:1789477440.434359:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802604800 00000100:00100000:3.0:1789477440.434377:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1789477440.434383:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d7c60ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3312:x1876402802605184:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789477440.434412:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d7c60ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3312:x1876402802605184:12345-0@lo:400:kworker.0 Request processed in 30us (1227us total) trans 0 rc 0/0 00000100:00100000:3.0:1789477440.434419:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1789477440.434430:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1789477440.434436:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d4766b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3311:x1876402802604800:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789477440.434462:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d4766b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3311:x1876402802604800:12345-0@lo:400:kworker.0 Request processed in 26us (1171us total) trans 0 rc 0/0 00000100:00100000:3.0:1789477440.434468:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00080000:3.0:1789477440.434488:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789477440.434491:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789477440.434494:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789477440.434530:0:3311:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967310 gen 2 00000004:00080000:3.0:1789477440.434535:0:3311:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9d0d7f73b100, transno 4294967307 00000004:00080000:3.0:1789477440.434544:0:3311:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967309 committed transno 4294967310 00000004:00080000:3.0:1789477440.434560:0:3311:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9d0d7c60c000, transno 4294967310 00000100:00100000:3.0:1789477440.434566:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d74aaa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1876402802604800:0@lo:400:kworker.0 00000100:00100000:3.0:1789477440.434604:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d6d488700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3311:1876402802604928:0@lo:400:kworker.0 00000100:00100000:3.0:1789477440.434621:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789477440.434634:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d6d483100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1876402802605312:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789477440.434675:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789477440.438712:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d74aaad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3312:1876402802604672:0@lo:400:kworker.0 00000100:00100000:2.0:1789477440.438733:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d6d489880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1876402802605184:0@lo:400:kworker.0 00000100:00100000:2.0:1789477440.438745:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d623ca680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:07d5e05c-913f-419f-adbc-d3cf15e9cd51:3312:1876402802604544:0@lo:400:kworker.0 00000100:00100000:2.0:1789477440.438757:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d6d48b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3312:1876402802605056:0@lo:400:kworker.0 00000100:00100000:3.0:1789477440.439105:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802605312 00000100:00100000:3.0:1789477440.439113:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802605312 00000100:00100000:3.0:1789477440.442726:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1789477440.442746:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d6d488700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3311:x1876402802605312:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789477440.442785:0:6698:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789477440.442873:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d6d488700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3311:x1876402802605312:12345-0@lo:13:osp-pre-1-0.0 Request processed in 133us (8195us total) trans 0 rc 0/0 00000100:00100000:3.0:1789477440.442880:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1789477440.444805:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d6d483100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1876402802605312:0@lo:13:osp-pre-1-0.0 00000001:00080000:1.0:1789477441.002790:0:5868:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967512 is committed 00000004:00080000:1.0:1789477441.002818:0:5868:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 10 committed 00000001:00080000:1.0:1789477441.002844:0:5868:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967517 is committed 00000001:00080000:1.0:1789477441.002866:0:5868:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967520 is committed 00000020:00080000:1.0:1789477441.002905:0:5868:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9d0d585b2cc0 refcount 2 committed 0 result 0 batchid 8 00000020:00080000:1.0:1789477441.002913:0:5868:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9d0d74cc5900 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9d0d585b2000 00000020:00080000:1.0:1789477441.002927:0:5868:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9d0d74cc5000 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9d0d7c405400 00000020:00080000:1.0:1789477441.002954:0:5868:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 7 batchid updated 00000100:00100000:1.0:1789477441.002976:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789477441.003008:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d6d48b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1876402802605440:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1789477441.006283:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789477441.006354:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802605440 00000100:00100000:3.0:1789477441.006370:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802605440 00000020:00080000:1.0:1789477441.006412:0:5879:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 8 committed batchid 7 00000100:00100000:3.0:1789477441.006445:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1789477441.006461:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d74cd9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3310:x1876402802605440:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1789477441.006753:0:6696:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:3.0:1789477441.006758:0:6696:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb mtime from disk: 1789477434 -> 1789477434 00002000:00010000:3.0:1789477441.006761:0:6696:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb atime from disk: 1789477433 -> 1789477433 00002000:00010000:3.0:1789477441.006765:0:6696:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb ctime from disk: 1789477434 -> 1789477434 00002000:00010000:3.0:1789477441.006769:0:6696:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb blocks from disk: 11 -> 11 00000020:00080000:1.0:1789477441.006800:0:5879:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 7 00000100:00100000:3.0:1789477441.006860:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d74cd9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+8:3310:x1876402802605440:12345-0@lo:2:osp-syn-1-0.0 Request processed in 404us (591us total) trans 4294967324 rc 0/0 00000100:00100000:3.0:1789477441.006868:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000004:00080000:1.0:1789477441.007391:0:3310:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9d0d6d48b480/2, rc 0, transno 4294967324 00000100:00100000:1.0:1789477441.007404:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d6d48b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1876402802605440:0@lo:2:osp-syn-1-0.0 00010000:00010000:1.0:1789477441.202327:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1789477441.513201:0:7678:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967321 is committed 00000001:00080000:3.0:1789477441.513229:0:7678:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967323 is committed 00000001:00080000:3.0:1789477441.513234:0:7678:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967322 is committed 00000001:00080000:3.0:1789477441.513239:0:7678:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967324 is committed 00010000:00010000:0.0:1789477442.223741:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789477442.991920:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d75286300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1876402802605568:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789477442.991992:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789477442.992124:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802605568 00000100:00100000:0.0:1789477442.992133:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802605568 00000100:00100000:0.0:1789477442.992202:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1789477442.992213:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d6d483100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1876402802605568:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789477442.992252:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789477442.992307:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d6d483100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1876402802605568:12345-0@lo:13:osp-pre-0-0.0 Request processed in 94us (314us total) trans 0 rc 0/0 00000100:00100000:0.0:1789477442.992314:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00080000:3.0:1789477442.992499:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789477442.992541:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d75286300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1876402802605568:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1789477443.250416:0:6710:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789477444.055663:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:2.0:1789477444.056288:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783750912 00000100:00100000:2.0:1789477444.056299:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783750912 00000100:00100000:2.0:1789477444.056381:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 238 00000100:00100000:2.0:1789477444.056394:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d6d489880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9bc33f26-0aab-4a14-832f-c58d566de1b0+18:11290:x1876402783750912:12345-192.168.201.23@tcp:60:lhsmtool_posix.0 00000100:00100000:2.0:1789477444.056511:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d6d489880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9bc33f26-0aab-4a14-832f-c58d566de1b0+18:11290:x1876402783750912:12345-192.168.201.23@tcp:60:lhsmtool_posix.0 Request processed in 120us (857us total) trans 0 rc 0/0 00000100:00100000:2.0:1789477444.056519:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 238 00000100:00080000:3.0:1789477444.059654:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789477444.063203:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:3.0:1789477444.063277:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783751168 00000100:00100000:3.0:1789477444.063286:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783751168 00000100:00100000:3.0:1789477444.063367:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 65 00000100:00100000:3.0:1789477444.063379:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d7bddea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9bc33f26-0aab-4a14-832f-c58d566de1b0+18:11290:x1876402783751168:12345-192.168.201.23@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1789477444.063952:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d7bddea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9bc33f26-0aab-4a14-832f-c58d566de1b0+19:11290:x1876402783751168:12345-192.168.201.23@tcp:35:lhsmtool_posix.0 Request processed in 573us (755us total) trans 4294967521 rc 0/0 00000100:00100000:3.0:1789477444.063961:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 65 00010000:00010000:1.0:1789477444.272539:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789477444.299316:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:3.0:1789477444.299617:0:12091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783751296 00000100:00100000:3.0:1789477444.299627:0:12091:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783751296 00000100:00100000:0.0:1789477444.299738:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 239 00000100:00080000:2.0:1789477444.299791:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789477444.299822:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d7bddd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cf70c55a-e056-446b-8936-49e7cd31fc79+5:12089:x1876402783751296:12345-192.168.201.23@tcp:101:lsof.0 00010000:00010000:0.0:1789477444.299906:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789477444.299929:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be5e00/0xafddb3c8f928266b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa90d500d7b8f2e55 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477444.299990:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be5200/0xafddb3c8f9282672 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477444.300003:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be5200/0xafddb3c8f9282672 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477444.300014:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be5200/0xafddb3c8f9282672 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789477444.300221:0:5844:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:0.0:1789477444.300225:0:5844:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 3 stripe count 1 MDT count 1 00000004:00010000:0.0:1789477444.300301:0:5844:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be5200/0xafddb3c8f9282672 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477444.300328:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be5e00/0xafddb3c8f928266b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2e55 expref: 7 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477444.300346:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be5200/0xafddb3c8f9282672 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2e55 expref: 6 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477444.300355:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9d0d5b9f4700) 00010000:00010000:0.0:1789477444.300358:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789477444.300361:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d0d50be5200, rc 0) 00000100:00100000:0.0:1789477444.301671:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d7bddd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cf70c55a-e056-446b-8936-49e7cd31fc79+6:12089:x1876402783751296:12345-192.168.201.23@tcp:101:lsof.0 Request processed in 1915us (2358us total) trans 0 rc 0/0 00000100:00100000:0.0:1789477444.301682:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 239 00000100:00100000:0.0:1789477444.583026:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:0.0:1789477444.583075:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:0.0:1789477444.583149:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:1.0:1789477444.583150:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783751424 00000100:00100000:1.0:1789477444.583162:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783751424 00000100:00100000:1.0:1789477444.583224:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 301 00000100:00100000:1.0:1789477444.583234:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d4e674050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5c82dded-6a10-4ce8-abd1-52bd956b9523+13:2355:x1876402783751424:12345-192.168.201.23@tcp:400:kworker.0 00000100:00100000:1.0:1789477444.583436:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d4e674050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5c82dded-6a10-4ce8-abd1-52bd956b9523+13:2355:x1876402783751424:12345-192.168.201.23@tcp:400:kworker.0 Request processed in 201us (419us total) trans 0 rc 0/0 00000100:00100000:1.0:1789477444.583445:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 301 00000100:00100000:3.0:1789477444.583459:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783751680 00000100:00100000:3.0:1789477444.583467:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783751680 00000100:00100000:3.0:1789477444.583796:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783751552 00000100:00100000:3.0:1789477444.583800:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783751552 00000100:00100000:3.0:1789477444.583830:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 83 00000100:00100000:3.0:1789477444.583837:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d75286300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9bc33f26-0aab-4a14-832f-c58d566de1b0+7:2355:x1876402783751680:12345-192.168.201.23@tcp:400:kworker.0 00000100:00080000:0.0:1789477444.583944:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789477444.584123:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 84 00000100:00100000:2.0:1789477444.584134:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d75285180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9bc33f26-0aab-4a14-832f-c58d566de1b0+5:2355:x1876402783751552:12345-192.168.201.23@tcp:400:kworker.0 00000100:00100000:2.0:1789477444.584169:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d75285180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9bc33f26-0aab-4a14-832f-c58d566de1b0+5:2355:x1876402783751552:12345-192.168.201.23@tcp:400:kworker.0 Request processed in 38us (1020us total) trans 0 rc 0/0 00000100:00100000:2.0:1789477444.584175:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 84 00000100:00080000:0.0:1789477444.584275:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789477444.586765:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d75286300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9bc33f26-0aab-4a14-832f-c58d566de1b0+7:2355:x1876402783751680:12345-192.168.201.23@tcp:400:kworker.0 Request processed in 2915us (3676us total) trans 0 rc 0/0 00000100:00100000:3.0:1789477444.586780:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 83 00010000:00010000:0.0:1789477445.295916:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789477445.551841:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789477445.551878:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d6d480000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1876402802605696:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789477445.551953:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789477445.552031:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802605696 00000100:00100000:2.0:1789477445.552041:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802605696 00000100:00100000:2.0:1789477445.552100:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1789477445.552111:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d6d480700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1876402802605696:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789477445.552150:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789477445.552198:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d6d480700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1876402802605696:12345-0@lo:13:osp-pre-1-0.0 Request processed in 89us (244us total) trans 0 rc 0/0 00000100:00100000:2.0:1789477445.552223:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00080000:2.0:1789477445.552251:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789477445.552274:0:3312:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967324 gen 2 00000004:00080000:2.0:1789477445.552281:0:3312:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9d0d7c60d880, transno 4294967321 00000004:00080000:2.0:1789477445.552293:0:3312:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967323 committed transno 4294967324 00000004:00080000:2.0:1789477445.552313:0:3312:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9d0d6d48b480, transno 4294967324 00000100:00100000:2.0:1789477445.552324:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d6d480000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1876402802605696:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789477445.553277:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d6d48b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:07d5e05c-913f-419f-adbc-d3cf15e9cd51:3310:1876402802605824:0@lo:400:kworker.0 00000100:00100000:1.0:1789477445.553329:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789477445.553367:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d7c60c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3310:1876402802606336:0@lo:400:kworker.0 00000100:00100000:1.0:1789477445.553398:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789477445.553419:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789477445.553425:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d7f73b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3310:1876402802605952:0@lo:400:kworker.0 00000100:00100000:1.0:1789477445.553455:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789477445.553482:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d7c60d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3313:1876402802606208:0@lo:400:kworker.0 00000100:00100000:1.0:1789477445.553508:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789477445.553527:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789477445.553531:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d7c60d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1876402802606080:0@lo:400:kworker.0 00000100:00100000:1.0:1789477445.553569:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789477445.553625:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802606336 00000100:00100000:1.0:1789477445.553632:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802606336 00000100:00100000:1.0:1789477445.553676:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802605952 00000100:00100000:1.0:1789477445.553680:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802605952 00000100:00100000:1.0:1789477445.553698:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802606208 00000100:00100000:1.0:1789477445.553701:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802606208 00000100:00100000:1.0:1789477445.553731:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:1.0:1789477445.553739:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d50410700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1876402802606336:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789477445.553787:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d50410700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1876402802606336:12345-0@lo:400:kworker.0 Request processed in 49us (388us total) trans 0 rc 0/0 00000100:00100000:1.0:1789477445.553794:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:1.0:1789477445.553811:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:1.0:1789477445.553817:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d753e3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1876402802605952:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789477445.553844:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d753e3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1876402802605952:12345-0@lo:400:kworker.0 Request processed in 28us (387us total) trans 0 rc 0/0 00000100:00100000:1.0:1789477445.553850:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:1.0:1789477445.553862:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:1.0:1789477445.553992:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d753e1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1876402802606208:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789477445.554031:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d753e1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1876402802606208:12345-0@lo:400:kworker.0 Request processed in 162us (523us total) trans 0 rc 0/0 00000100:00100000:1.0:1789477445.554047:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00080000:1.0:1789477445.554066:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789477445.554099:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d7c60d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3313:1876402802606208:0@lo:400:kworker.0 00000100:00100000:1.0:1789477445.554126:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d7f73b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3310:1876402802605952:0@lo:400:kworker.0 00000100:00100000:1.0:1789477445.554135:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d7c60c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3310:1876402802606336:0@lo:400:kworker.0 00000100:00100000:1.0:1789477445.554160:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802606080 00000100:00100000:1.0:1789477445.554164:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802606080 00000100:00100000:1.0:1789477445.554195:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1789477445.554201:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d753e3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3313:x1876402802606080:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789477445.554237:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d753e3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3313:x1876402802606080:12345-0@lo:400:kworker.0 Request processed in 36us (667us total) trans 0 rc 0/0 00000100:00100000:1.0:1789477445.554244:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00080000:1.0:1789477445.554261:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789477445.554277:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d7c60d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1876402802606080:0@lo:400:kworker.0 00000100:00100000:3.0:1789477445.554502:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802605824 00000100:00100000:3.0:1789477445.554508:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802605824 00000100:00100000:3.0:1789477445.554544:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 302 00000100:00100000:3.0:1789477445.554561:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d4e677050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07d5e05c-913f-419f-adbc-d3cf15e9cd51+19:3310:x1876402802605824:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789477445.554619:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d4e677050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07d5e05c-913f-419f-adbc-d3cf15e9cd51+19:3310:x1876402802605824:12345-0@lo:400:kworker.0 Request processed in 59us (1289us total) trans 0 rc 0/0 00000100:00100000:3.0:1789477445.554626:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 302 00000100:00100000:1.0:1789477445.555253:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d6d48b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:07d5e05c-913f-419f-adbc-d3cf15e9cd51:3310:1876402802605824:0@lo:400:kworker.0 00000020:00080000:3.0:1789477446.107848:0:5868:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 8 batchid updated 00000001:00080000:3.0:1789477446.107936:0:5868:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967521 is committed 00000020:00080000:1.0:1789477446.107988:0:5879:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000020:00080000:1.0:1789477446.107998:0:5879:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00010000:00010000:0.0:1789477446.319928:0:6710:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1789477447.210908:0:12750:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1c: Test automated attach using Project ID with manual HSM restore ========================================================== 09:04:05 (1789477445) 00010000:00010000:2.0:1789477447.351810:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789477448.112126:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d7c64e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1876402802606464:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789477448.112199:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789477448.112272:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802606464 00000100:00100000:2.0:1789477448.112279:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802606464 00000100:00100000:2.0:1789477448.112337:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1789477448.112348:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d6d480000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1876402802606464:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789477448.112475:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789477448.112535:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d6d480000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1876402802606464:12345-0@lo:13:osp-pre-0-0.0 Request processed in 188us (336us total) trans 0 rc 0/0 00000100:00100000:2.0:1789477448.112542:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00080000:2.0:1789477448.112564:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789477448.112629:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d7c64e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1876402802606464:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1789477448.370224:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789477449.391981:0:6710:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789477449.699953:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:1.0:1789477449.700133:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:1.0:1789477449.700181:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:1.0:1789477449.700217:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:1.0:1789477449.700244:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:2.0:1789477449.700337:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783752192 00000100:00100000:2.0:1789477449.700363:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783752192 00000100:00100000:2.0:1789477449.700439:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783752064 00000100:00100000:2.0:1789477449.700442:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783752064 00000100:00100000:2.0:1789477449.700466:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 86 00000100:00100000:2.0:1789477449.700514:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d6d48b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9bc33f26-0aab-4a14-832f-c58d566de1b0+7:2353:x1876402783752192:12345-192.168.201.23@tcp:400:kworker.0 00000100:00100000:2.0:1789477449.700657:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d6d48b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9bc33f26-0aab-4a14-832f-c58d566de1b0+7:2353:x1876402783752192:12345-192.168.201.23@tcp:400:kworker.0 Request processed in 146us (524us total) trans 0 rc 0/0 00000100:00100000:2.0:1789477449.700666:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 86 00000100:00100000:2.0:1789477449.700685:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 87 00000100:00100000:2.0:1789477449.700693:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d7f73b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9bc33f26-0aab-4a14-832f-c58d566de1b0+5:2353:x1876402783752064:12345-192.168.201.23@tcp:400:kworker.0 00000100:00100000:2.0:1789477449.700720:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d7f73b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9bc33f26-0aab-4a14-832f-c58d566de1b0+5:2353:x1876402783752064:12345-192.168.201.23@tcp:400:kworker.0 Request processed in 28us (502us total) trans 0 rc 0/0 00000100:00100000:2.0:1789477449.700727:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 87 00000100:00080000:2.0:1789477449.700748:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789477449.700752:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789477449.700895:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783751808 00000100:00100000:3.0:1789477449.700900:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783751808 00000100:00100000:3.0:1789477449.700935:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 303 00000100:00100000:3.0:1789477449.700942:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d4e676c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5c82dded-6a10-4ce8-abd1-52bd956b9523+13:2353:x1876402783751808:12345-192.168.201.23@tcp:400:kworker.0 00000100:00100000:3.0:1789477449.700983:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d4e676c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5c82dded-6a10-4ce8-abd1-52bd956b9523+13:2353:x1876402783751808:12345-192.168.201.23@tcp:400:kworker.0 Request processed in 31us (791us total) trans 0 rc 0/0 00000100:00100000:3.0:1789477449.700990:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 303 00000100:00100000:0.0:1789477449.705461:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783751936 00000100:00100000:0.0:1789477449.705490:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783751936 00000100:00100000:3.0:1789477449.705507:0:12091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783752320 00000100:00100000:3.0:1789477449.705513:0:12091:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783752320 00000100:00100000:3.0:1789477449.705632:0:12091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 169 00000100:00100000:3.0:1789477449.705647:0:12091:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d7f544a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:cf70c55a-e056-446b-8936-49e7cd31fc79+6:2353:x1876402783752320:12345-192.168.201.23@tcp:400:kworker.0 00000100:00100000:3.0:1789477449.705757:0:12091:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d7f544a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:cf70c55a-e056-446b-8936-49e7cd31fc79+6:2353:x1876402783752320:12345-192.168.201.23@tcp:400:kworker.0 Request processed in 114us (5511us total) trans 0 rc 0/0 00000100:00100000:0.0:1789477449.705760:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 170 00000100:00100000:3.0:1789477449.705766:0:12091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 169 00000100:00100000:0.0:1789477449.705768:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d753e3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9bc33f26-0aab-4a14-832f-c58d566de1b0+18:2353:x1876402783751936:12345-192.168.201.23@tcp:400:kworker.0 00000100:00100000:0.0:1789477449.705807:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d753e3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9bc33f26-0aab-4a14-832f-c58d566de1b0+18:2353:x1876402783751936:12345-192.168.201.23@tcp:400:kworker.0 Request processed in 40us (5869us total) trans 0 rc 0/0 00000100:00100000:0.0:1789477449.705813:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 170 00000100:00080000:2.0:1789477449.706113:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1789477450.415927:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1789477450.543959:0:11717:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1789477450.543974:0:11717:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1789477450.544647:0:11717:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 1 00000040:00080000:0.0:1789477450.544656:0:11717:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1789477450.672128:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d6d482300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3313:1876402802606720:0@lo:400:kworker.0 00000100:00100000:2.0:1789477450.672225:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789477450.672299:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d50b05c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1876402802607232:0@lo:400:kworker.0 00000100:00100000:2.0:1789477450.672327:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789477450.672380:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1789477450.672387:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d6d480a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:07d5e05c-913f-419f-adbc-d3cf15e9cd51:3313:1876402802606592:0@lo:400:kworker.0 00000100:00100000:2.0:1789477450.672419:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789477450.672441:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d58247100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3313:1876402802607104:0@lo:400:kworker.0 00000100:00100000:2.0:1789477450.672475:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789477450.672504:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d6d482d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1876402802606848:0@lo:400:kworker.0 00000100:00100000:2.0:1789477450.672529:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789477450.672547:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789477450.672552:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d623ca680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3310:1876402802606976:0@lo:400:kworker.0 00000100:00100000:2.0:1789477450.672622:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789477450.672661:0:6999:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802606720 00000100:00100000:2.0:1789477450.672670:0:6999:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802606720 00000100:00100000:2.0:1789477450.672723:0:6999:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:2.0:1789477450.672734:0:6999:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d50b05500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1876402802606720:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789477450.673319:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802607104 00000100:00100000:0.0:1789477450.673327:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802607104 00000100:00100000:0.0:1789477450.673385:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802606976 00000100:00100000:0.0:1789477450.673389:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802606976 00000100:00100000:0.0:1789477450.673407:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:0.0:1789477450.673415:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d7c1fad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1876402802607104:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789477450.673515:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:1.0:1789477450.673527:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d7c1fa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1876402802606976:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789477450.677197:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789477450.677230:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d7c60d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1876402802607360:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789477450.679933:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d7c1fad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1876402802607104:12345-0@lo:400:kworker.0 Request processed in 6503us (7442us total) trans 0 rc 0/0 00000100:00100000:0.0:1789477450.679952:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00000100:00100000:0.0:1789477450.680712:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d58247100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3313:1876402802607104:0@lo:400:kworker.0 00000100:00100000:0.0:1789477450.680836:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802606592 00000100:00100000:0.0:1789477450.680845:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802606592 00000100:00100000:0.0:1789477450.680912:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 304 00000100:00100000:0.0:1789477450.680923:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d4e675450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:07d5e05c-913f-419f-adbc-d3cf15e9cd51+19:3313:x1876402802606592:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789477450.681008:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d4e675450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:07d5e05c-913f-419f-adbc-d3cf15e9cd51+19:3313:x1876402802606592:12345-0@lo:400:kworker.0 Request processed in 86us (8588us total) trans 0 rc 0/0 00000100:00100000:0.0:1789477450.681017:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 304 00000100:00100000:0.0:1789477450.681059:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802607232 00000100:00100000:0.0:1789477450.681080:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802607232 00000100:00100000:0.0:1789477450.681205:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802606848 00000100:00100000:0.0:1789477450.681209:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802606848 00000100:00100000:0.0:1789477450.681233:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1789477450.681240:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d7c1faa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3313:x1876402802607232:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789477450.681280:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d7c1faa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3313:x1876402802607232:12345-0@lo:400:kworker.0 Request processed in 42us (8952us total) trans 0 rc 0/0 00000100:00100000:0.0:1789477450.681287:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1789477450.681299:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1789477450.681304:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d7c1f9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3310:x1876402802606848:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789477450.681572:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d7c1f9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3310:x1876402802606848:12345-0@lo:400:kworker.0 Request processed in 29us (8804us total) trans 0 rc 0/0 00000100:00100000:0.0:1789477450.681626:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00080000:0.0:1789477450.681659:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789477450.681664:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789477450.681668:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789477450.681697:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d6d480a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:07d5e05c-913f-419f-adbc-d3cf15e9cd51:3313:1876402802606592:0@lo:400:kworker.0 00000100:00100000:0.0:1789477450.681714:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d50b05c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1876402802607232:0@lo:400:kworker.0 00000100:00100000:0.0:1789477450.681766:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d6d482d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1876402802606848:0@lo:400:kworker.0 00000100:00100000:2.0:1789477450.683920:0:6999:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d50b05500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1876402802606720:12345-0@lo:400:kworker.0 Request processed in 11178us (11685us total) trans 0 rc 0/0 00000100:00100000:2.0:1789477450.683937:0:6999:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00100000:2.0:1789477450.684040:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d6d482300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3313:1876402802606720:0@lo:400:kworker.0 00000100:00100000:2.0:1789477450.684118:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d623ca680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3310:1876402802606976:0@lo:400:kworker.0 00000100:00100000:1.0:1789477450.684895:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d7c1fa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1876402802606976:12345-0@lo:400:kworker.0 Request processed in 10250us (11152us total) trans 0 rc 0/0 00000100:00100000:1.0:1789477450.684908:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00100000:3.0:1789477450.685965:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789477450.688524:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802607360 00000100:00100000:2.0:1789477450.688545:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802607360 00000100:00100000:2.0:1789477450.688875:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1789477450.688889:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d7c60c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1876402802607360:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789477450.688943:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789477450.689123:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d7c60c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1876402802607360:12345-0@lo:13:osp-pre-1-0.0 Request processed in 236us (3163us total) trans 0 rc 0/0 00000100:00100000:2.0:1789477450.689131:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1789477450.693043:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d7c60d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1876402802607360:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789477450.807950:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:3.0:1789477450.810938:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783752576 00000100:00100000:3.0:1789477450.810960:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783752576 00000100:00100000:3.0:1789477450.811063:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 66 00000100:00100000:3.0:1789477450.811076:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d7c1fbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9bc33f26-0aab-4a14-832f-c58d566de1b0+18:12310:x1876402783752576:12345-192.168.201.23@tcp:35:umount.0 00000100:00100000:3.0:1789477450.814494:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d7c1fbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9bc33f26-0aab-4a14-832f-c58d566de1b0+19:12310:x1876402783752576:12345-192.168.201.23@tcp:35:umount.0 Request processed in 3401us (6540us total) trans 4294967522 rc 0/0 00000100:00100000:3.0:1789477450.814531:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 66 00000100:00100000:3.0:1789477450.823147:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:2.0:1789477450.823232:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783752832 00000100:00100000:2.0:1789477450.823246:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783752832 00000100:00100000:2.0:1789477450.823324:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 67 00000100:00100000:2.0:1789477450.823338:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d7c60d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9bc33f26-0aab-4a14-832f-c58d566de1b0+19:12310:x1876402783752832:12345-192.168.201.23@tcp:35:umount.0 00000100:00100000:2.0:1789477450.823927:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d7c60d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9bc33f26-0aab-4a14-832f-c58d566de1b0+20:12310:x1876402783752832:12345-192.168.201.23@tcp:35:umount.0 Request processed in 589us (793us total) trans 4294967523 rc 0/0 00000100:00100000:2.0:1789477450.823959:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 67 00000100:00100000:1.0:1789477450.832546:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:3.0:1789477450.832783:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783753088 00000100:00100000:3.0:1789477450.832799:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783753088 00000100:00100000:3.0:1789477450.832876:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 68 00000100:00100000:3.0:1789477450.832888:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d5845f050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9bc33f26-0aab-4a14-832f-c58d566de1b0+20:12310:x1876402783753088:12345-192.168.201.23@tcp:35:umount.0 00000100:00100000:2.0:1789477450.834295:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d5845f050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9bc33f26-0aab-4a14-832f-c58d566de1b0+21:12310:x1876402783753088:12345-192.168.201.23@tcp:35:umount.0 Request processed in 1396us (1753us total) trans 4294967524 rc 0/0 00000100:00100000:2.0:1789477450.834308:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 68 00000100:00100000:0.0:1789477450.838381:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:2.0:1789477450.838816:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783753344 00000100:00100000:2.0:1789477450.838830:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783753344 00000100:00100000:2.0:1789477450.838907:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 69 00000100:00100000:2.0:1789477450.839191:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d7c64d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9bc33f26-0aab-4a14-832f-c58d566de1b0+21:12310:x1876402783753344:12345-192.168.201.23@tcp:35:umount.0 00000100:00100000:2.0:1789477450.841705:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d7c64d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9bc33f26-0aab-4a14-832f-c58d566de1b0+22:12310:x1876402783753344:12345-192.168.201.23@tcp:35:umount.0 Request processed in 2771us (3325us total) trans 4294967525 rc 0/0 00000100:00100000:2.0:1789477450.841722:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 69 00000100:00100000:3.0:1789477450.853752:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:3.0:1789477450.853861:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:0.0:1789477450.853986:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783753984 00000100:00100000:0.0:1789477450.853999:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783753984 00000100:00100000:0.0:1789477450.854076:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 73 00000100:00100000:0.0:1789477450.854097:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d7c60d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9bc33f26-0aab-4a14-832f-c58d566de1b0+7:2351:x1876402783753984:12345-192.168.201.23@tcp:9:umount.0 00000020:00000080:0.0:1789477450.854136:0:6697:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xafddb3c8f9281c23 00000020:00010000:0.0:1789477450.854145:0:6697:0:(genops.c:1921:obd_stale_export_put()) Put export ffff9d0d7c675000: total 0 00000100:00080000:0.0:1789477450.854169:0:6697:0:(import.c:65:import_set_state_nolock()) ffff9d0d7c672800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1789477450.854227:0:6697:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967324 00000100:00100000:3.0:1789477450.854442:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:0.0:1789477450.854768:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d7c60d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9bc33f26-0aab-4a14-832f-c58d566de1b0+5:2351:x1876402783753984:12345-192.168.201.23@tcp:9:umount.0 Request processed in 680us (1031us total) trans 0 rc 0/0 00000100:00100000:0.0:1789477450.854790:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 73 00000020:00010000:0.0:1789477450.854821:0:5832:0:(genops.c:1907:obd_stale_export_get()) Get export ffff9d0d7c675000: total 0 00010000:00010000:0.0:1789477450.854844:0:5832:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9d0d7c675000, canceled 0 locks, left on hash table 2. 00010000:00010000:0.0:1789477450.854916:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000085790ca8/0xafddb3c8f9281fc6 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2c80 expref: 4 pid: 8241 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477450.854956:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bc5573ae/0xafddb3c8f9282664 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2e4e expref: 3 pid: 6697 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477450.854974:0:5832:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9d0d7c675000, canceled 2 locks, left on hash table 0. 00010000:00010000:0.0:1789477450.854986:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789477450.854989:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789477450.854991:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789477450.856880:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783753472 00000100:00100000:1.0:1789477450.856900:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783753472 00000100:00100000:2.0:1789477450.857240:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783754112 00000100:00100000:2.0:1789477450.857246:0:6711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783754112 00000100:00100000:2.0:1789477450.857308:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 19 00000100:00100000:2.0:1789477450.857320:0:6711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d7c60d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5c82dded-6a10-4ce8-abd1-52bd956b9523+14:2354:x1876402783753472:12345-192.168.201.23@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789477450.857345:0:6711:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789477450.857368:0:6711:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d0d59d6a200/0xafddb3c8f9281688 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801000000000 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f29e0 expref: 14 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477450.857389:0:6711:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789477450.857471:0:6711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d7c60d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5c82dded-6a10-4ce8-abd1-52bd956b9523+13:2354:x1876402783753472:12345-192.168.201.23@tcp:103:ldlm_bl.0 Request processed in 153us (3609us total) trans 0 rc 0/0 00000100:00100000:2.0:1789477450.857480:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 19 00000100:00100000:2.0:1789477450.857508:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 20 00000100:00100000:2.0:1789477450.857516:0:6711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d74aaad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5c82dded-6a10-4ce8-abd1-52bd956b9523+12:2354:x1876402783754112:12345-192.168.201.23@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789477450.857543:0:6711:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789477450.857553:0:6711:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d0d49ecb400/0xafddb3c8f92818fe lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2aab expref: 12 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477450.857563:0:6711:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789477450.857603:0:6711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d74aaad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5c82dded-6a10-4ce8-abd1-52bd956b9523+11:2354:x1876402783754112:12345-192.168.201.23@tcp:103:ldlm_bl.0 Request processed in 88us (3162us total) trans 0 rc 0/0 00000100:00100000:2.0:1789477450.857610:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 20 00000100:00100000:2.0:1789477450.857694:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:3.0:1789477450.859641:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783753600 00000100:00100000:3.0:1789477450.859660:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783753600 00000100:00100000:3.0:1789477450.859736:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 21 00000100:00100000:3.0:1789477450.859747:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d7c1fbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5c82dded-6a10-4ce8-abd1-52bd956b9523+11:2354:x1876402783753600:12345-192.168.201.23@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789477450.859763:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789477450.860152:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d0d49ecae00/0xafddb3c8f9281650 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f29a8 expref: 11 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477450.860177:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789477450.860289:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d7c1fbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5c82dded-6a10-4ce8-abd1-52bd956b9523+10:2354:x1876402783753600:12345-192.168.201.23@tcp:103:ldlm_bl.0 Request processed in 544us (2595us total) trans 0 rc 0/0 00000100:00100000:3.0:1789477450.860298:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 21 00000100:00100000:0.0:1789477450.864235:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:3.0:1789477450.865604:0:8241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783754240 00000100:00100000:3.0:1789477450.865629:0:8241:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783754240 00000100:00100000:3.0:1789477450.865716:0:8241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 74 00000100:00100000:3.0:1789477450.865728:0:8241:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d7c64e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9bc33f26-0aab-4a14-832f-c58d566de1b0+5:2351:x1876402783754240:12345-192.168.201.23@tcp:9:umount.0 00000020:00000080:3.0:1789477450.865781:0:8241:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xafddb3c8f92819c2 00000100:00080000:3.0:1789477450.865813:0:8241:0:(import.c:65:import_set_state_nolock()) ffff9d0d7f558000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1789477450.865866:0:8241:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967310 00000100:00100000:3.0:1789477450.866445:0:8241:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d7c64e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9bc33f26-0aab-4a14-832f-c58d566de1b0+2:2351:x1876402783754240:12345-192.168.201.23@tcp:9:umount.0 Request processed in 717us (2223us total) trans 0 rc 0/0 00000100:00100000:3.0:1789477450.866464:0:8241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 74 00010000:00010000:3.0:1789477450.866494:0:6710:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789477450.879931:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:0.0:1789477450.880062:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783755264 00000100:00100000:0.0:1789477450.880076:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783755264 00000100:00100000:0.0:1789477450.880169:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 240 00000100:00100000:0.0:1789477450.880182:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d7f547480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9bc33f26-0aab-4a14-832f-c58d566de1b0+22:2351:x1876402783755264:12345-192.168.201.23@tcp:39:umount.0 00000020:00000080:0.0:1789477450.880232:0:5846:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xafddb3c8f928165e 00000020:00010000:0.0:1789477450.880252:0:5846:0:(genops.c:1921:obd_stale_export_put()) Put export ffff9d0d514cc000: total 0 00000100:00080000:0.0:1789477450.880258:0:5846:0:(import.c:65:import_set_state_nolock()) ffff9d0d514ca000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1789477450.880298:0:5846:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967525 00000100:00100000:0.0:1789477450.880859:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d7f547480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9bc33f26-0aab-4a14-832f-c58d566de1b0+21:2351:x1876402783755264:12345-192.168.201.23@tcp:39:umount.0 Request processed in 677us (945us total) trans 4294967526 rc 0/0 00000100:00100000:0.0:1789477450.880890:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 240 00000020:00010000:2.0:1789477450.881111:0:5833:0:(genops.c:1907:obd_stale_export_get()) Get export ffff9d0d514cc000: total 0 00010000:00010000:2.0:1789477450.881166:0:5833:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9d0d514cc000, canceled 0 locks, left on hash table 13. 00010000:00010000:2.0:1789477450.881209:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9d0d44f4e500) 00010000:00010000:2.0:1789477450.881214:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1789477450.881225:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49eca000/0xafddb3c8f928264f lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2e47 expref: 20 pid: 6999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477450.881246:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9d0d5b9f4000) 00010000:00010000:2.0:1789477450.881248:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1789477450.881252:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d49ecb200/0xafddb3c8f9281c85 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2ba7 expref: 19 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477450.881271:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9d0d596ae300) 00010000:00010000:2.0:1789477450.881274:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789477450.881279:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be5c00/0xafddb3c8f9281928 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2ab9 expref: 18 pid: 6999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477450.881299:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9d0d5b9f4e00) 00010000:00010000:2.0:1789477450.881302:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1789477450.881314:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d59d6a800/0xafddb3c8f9281fb1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2c79 expref: 17 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477450.881333:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9d0d44568d00) 00010000:00010000:2.0:1789477450.881335:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1789477450.881339:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be4200/0xafddb3c8f9282323 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2d75 expref: 16 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477450.881354:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9d0d5b9f4000) 00010000:00010000:2.0:1789477450.881356:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1789477450.881360:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f519c00/0xafddb3c8f9281998 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2ad5 expref: 15 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477450.881375:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9d0d44f4e500) 00010000:00010000:2.0:1789477450.881378:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789477450.881382:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d41647000/0xafddb3c8f9282545 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2e01 expref: 14 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477450.881394:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9d0d44568d00) 00010000:00010000:2.0:1789477450.881397:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1789477450.881401:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d59d6be00/0xafddb3c8f9282044 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2ca3 expref: 13 pid: 12091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477450.881419:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9d0d5b9f4e00) 00010000:00010000:2.0:1789477450.881423:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789477450.881427:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f518200/0xafddb3c8f9281ea7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2c33 expref: 12 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477450.881440:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9d0d5b9f4700) 00010000:00010000:2.0:1789477450.881448:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789477450.881463:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f518e00/0xafddb3c8f9282028 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2c9c expref: 11 pid: 6999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477450.881479:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9d0d48f9be00) 00010000:00010000:2.0:1789477450.881482:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789477450.881485:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f519a00/0xafddb3c8f9281944 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2ac0 expref: 10 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477450.881500:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9d0d5b9f4e00) 00010000:00010000:2.0:1789477450.881503:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789477450.881507:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f519000/0xafddb3c8f9281f87 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2c6b expref: 9 pid: 6999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477450.881521:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9d0d44f4e500) 00010000:00010000:2.0:1789477450.881524:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789477450.881527:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50417a00/0xafddb3c8f9282625 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2e39 expref: 8 pid: 12091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477450.881541:0:5833:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9d0d514cc000, canceled 13 locks, left on hash table 0. 00010000:00010000:2.0:1789477450.881554:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789477450.881556:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789477450.881558:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1789477451.242515:0:5868:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 9bc33f26-0aab-4a14-832f-c58d566de1b0 00000001:00080000:3.0:1789477451.242541:0:5868:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967526 is committed 00000020:00000080:3.0:1789477451.242568:0:5868:0:(genops.c:885:class_export_put()) final put ffff9d0d514cc000/9bc33f26-0aab-4a14-832f-c58d566de1b0 00000020:00000080:2.0:1789477451.242975:0:12773:0:(genops.c:844:class_export_destroy()) destroying export ffff9d0d514cc000/9bc33f26-0aab-4a14-832f-c58d566de1b0 for lustre-MDT0000 00000020:00000080:2.0:1789477451.243160:0:12773:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9d0d514ca000 for lustre-MDT0000 00010000:00010000:0.0:1789477451.440354:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1789477451.786122:0:7678:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 9bc33f26-0aab-4a14-832f-c58d566de1b0 00000020:00000080:1.0:1789477451.786138:0:7678:0:(genops.c:885:class_export_put()) final put ffff9d0d7c675000/9bc33f26-0aab-4a14-832f-c58d566de1b0 00000020:00000080:0.0:1789477451.786272:0:12773:0:(genops.c:844:class_export_destroy()) destroying export ffff9d0d7c675000/9bc33f26-0aab-4a14-832f-c58d566de1b0 for lustre-OST0001 00000020:00000080:0.0:1789477451.786342:0:12773:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9d0d7c672800 for lustre-OST0001 00010000:00010000:3.0:1789477452.465029:0:6710:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789477452.683943:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:2.0:1789477452.684044:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:2.0:1789477452.689871:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:3.0:1789477452.694215:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783755392 00000100:00100000:3.0:1789477452.694249:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783755392 00000100:00100000:3.0:1789477452.694369:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783755648 00000100:00100000:3.0:1789477452.694374:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783755648 00000100:00100000:3.0:1789477452.694435:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 22 00000100:00100000:3.0:1789477452.694448:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d4e640000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5c82dded-6a10-4ce8-abd1-52bd956b9523+11:2355:x1876402783755392:12345-192.168.201.23@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789477452.694472:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789477452.694500:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d0d49ecbe00/0xafddb3c8f9281730 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f29f5 expref: 11 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477452.694523:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789477452.694644:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d4e640000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5c82dded-6a10-4ce8-abd1-52bd956b9523+10:2355:x1876402783755392:12345-192.168.201.23@tcp:103:ldlm_bl.0 Request processed in 198us (10718us total) trans 0 rc 0/0 00000100:00100000:3.0:1789477452.694652:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 22 00000100:00100000:3.0:1789477452.694678:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 23 00000100:00100000:3.0:1789477452.694686:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d75285f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5c82dded-6a10-4ce8-abd1-52bd956b9523+9:2355:x1876402783755648:12345-192.168.201.23@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789477452.694697:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789477452.694727:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d0d7f519600/0xafddb3c8f92818f7 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2aa4 expref: 9 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477452.694738:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789477452.694760:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d75285f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5c82dded-6a10-4ce8-abd1-52bd956b9523+8:2355:x1876402783755648:12345-192.168.201.23@tcp:103:ldlm_bl.0 Request processed in 75us (10716us total) trans 0 rc 0/0 00000100:00100000:3.0:1789477452.694767:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 23 00000100:00100000:2.0:1789477452.696039:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783755520 00000100:00100000:2.0:1789477452.696071:0:6711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783755520 00000100:00100000:2.0:1789477452.696131:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 24 00000100:00100000:2.0:1789477452.696143:0:6711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d7bddea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5c82dded-6a10-4ce8-abd1-52bd956b9523+8:2355:x1876402783755520:12345-192.168.201.23@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789477452.696158:0:6711:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789477452.696179:0:6711:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d0d49ecac00/0xafddb3c8f9281737 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2a1f expref: 8 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477452.696197:0:6711:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789477452.696274:0:6711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d7bddea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5c82dded-6a10-4ce8-abd1-52bd956b9523+7:2355:x1876402783755520:12345-192.168.201.23@tcp:103:ldlm_bl.0 Request processed in 133us (6419us total) trans 0 rc 0/0 00000100:00100000:2.0:1789477452.696283:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 24 00000100:00100000:3.0:1789477452.702937:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:0.0:1789477452.703111:0:12091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783755904 00000100:00100000:0.0:1789477452.703127:0:12091:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783755904 00000100:00100000:0.0:1789477452.703242:0:12091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 241 00000100:00100000:0.0:1789477452.703256:0:12091:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d74aaa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:cf70c55a-e056-446b-8936-49e7cd31fc79+6:2351:x1876402783755904:12345-192.168.201.23@tcp:39:umount.0 00000100:00080000:2.0:1789477452.703392:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000020:00000080:0.0:1789477452.703455:0:12091:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xafddb3c8f9281745 00000020:00010000:0.0:1789477452.703466:0:12091:0:(genops.c:1921:obd_stale_export_put()) Put export ffff9d0d74a80800: total 0 00000100:00080000:0.0:1789477452.703473:0:12091:0:(import.c:65:import_set_state_nolock()) ffff9d0d74a81800 : changing import state from FULL to CLOSED 00000020:00010000:2.0:1789477452.703623:0:5833:0:(genops.c:1907:obd_stale_export_get()) Get export ffff9d0d74a80800: total 0 00010000:00010000:2.0:1789477452.703628:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789477452.703683:0:5833:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9d0d74a80800, canceled 0 locks, left on hash table 1. 00010000:00010000:2.0:1789477452.703726:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9d0d5b9f4700) 00010000:00010000:2.0:1789477452.703730:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789477452.703740:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be5200/0xafddb3c8f9282672 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2e55 expref: 5 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477452.703771:0:5833:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9d0d74a80800, canceled 1 locks, left on hash table 0. 00010000:00010000:2.0:1789477452.703780:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789477452.703782:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789477452.703784:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00000004:0.0:1789477452.703842:0:12091:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967526 00000100:00100000:0.0:1789477452.705137:0:12091:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d74aaa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:cf70c55a-e056-446b-8936-49e7cd31fc79+3:2351:x1876402783755904:12345-192.168.201.23@tcp:39:umount.0 Request processed in 1873us (2207us total) trans 4294967527 rc 0/0 00000100:00100000:0.0:1789477452.705154:0:12091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 241 00000100:00100000:3.0:1789477452.732430:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:0.0:1789477452.735195:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783756160 00000100:00100000:0.0:1789477452.735219:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783756160 00000100:00100000:0.0:1789477452.735319:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 305 00000100:00100000:0.0:1789477452.735333:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d4e676050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5c82dded-6a10-4ce8-abd1-52bd956b9523+7:2351:x1876402783756160:12345-192.168.201.23@tcp:251:umount.0 00000020:00000080:0.0:1789477452.735400:0:5838:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xafddb3c8f928163b 00000020:00010000:0.0:1789477452.735410:0:5838:0:(genops.c:1921:obd_stale_export_put()) Put export ffff9d0d7535f000: total 0 00000100:00080000:0.0:1789477452.735425:0:5838:0:(import.c:65:import_set_state_nolock()) ffff9d0d7535e800 : changing import state from FULL to CLOSED 00000100:00100000:0.0:1789477452.735558:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d4e676050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5c82dded-6a10-4ce8-abd1-52bd956b9523+3:2351:x1876402783756160:12345-192.168.201.23@tcp:251:umount.0 Request processed in 227us (3162us total) trans 0 rc 0/0 00000100:00100000:0.0:1789477452.735568:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 305 00000020:00010000:2.0:1789477452.735768:0:5832:0:(genops.c:1907:obd_stale_export_get()) Get export ffff9d0d7535f000: total 0 00010000:00010000:2.0:1789477452.735825:0:5832:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9d0d7535f000, canceled 0 locks, left on hash table 1. 00010000:00010000:2.0:1789477452.735870:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d0d49eca400/0xafddb3c8f928168f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f29e7 expref: 2 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477452.735913:0:5832:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9d0d7535f000, canceled 1 locks, left on hash table 0. 00000020:00000080:2.0:1789477452.735924:0:5832:0:(genops.c:885:class_export_put()) final put ffff9d0d7535f000/5c82dded-6a10-4ce8-abd1-52bd956b9523 00010000:00010000:2.0:1789477452.735955:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789477452.735958:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789477452.735960:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1789477452.737158:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9d0d7535f000/5c82dded-6a10-4ce8-abd1-52bd956b9523 for MGS 00000020:00000080:0.0:1789477452.737242:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9d0d7535e800 for MGS 00000100:00100000:1.0:1789477453.245547:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789477453.246047:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d50b05c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1876402802607488:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789477453.247086:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789477453.247343:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802607488 00000100:00100000:0.0:1789477453.247367:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802607488 00000100:00100000:0.0:1789477453.247533:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1789477453.247549:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d74e88380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1876402802607488:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789477453.247627:0:6698:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789477453.247705:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d74e88380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1876402802607488:12345-0@lo:13:osp-pre-0-0.0 Request processed in 160us (624us total) trans 0 rc 0/0 00000100:00100000:0.0:1789477453.247713:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1789477453.248786:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d50b05c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1876402802607488:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1789477453.249702:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1789477453.488476:0:6710:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1789477453.799217:0:6730:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 9bc33f26-0aab-4a14-832f-c58d566de1b0 00000020:00000080:1.0:1789477453.799232:0:6730:0:(genops.c:885:class_export_put()) final put ffff9d0d7f55f800/9bc33f26-0aab-4a14-832f-c58d566de1b0 00000020:00000080:2.0:1789477453.799302:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9d0d7f55f800/9bc33f26-0aab-4a14-832f-c58d566de1b0 for lustre-OST0000 00000020:00000080:2.0:1789477453.799376:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9d0d7f558000 for lustre-OST0000 00010000:00010000:2.0:1789477454.512640:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1789477454.530646:0:12951:0:(tgt_mount.c:2195:server_umount_begin()) umount -f 00000020:01000004:0.0:1789477454.556084:0:12951:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-MDT0000 00010000:00010000:0.0:1789477454.556150:0:12951:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.123@tcp lock: ffff9d0d82151800/0xafddb3c8f92816ce lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xafddb3c8f92816d5 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477454.556168:0:12951:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.123@tcp lock: ffff9d0d82151800/0xafddb3c8f92816ce lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xafddb3c8f92816d5 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477454.556177:0:12951:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.123@tcp lock: ffff9d0d82151800/0xafddb3c8f92816ce lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0xafddb3c8f92816d5 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477454.556186:0:12951:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.123@tcp lock: ffff9d0d82151800/0xafddb3c8f92816ce lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0xafddb3c8f92816d5 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477454.556213:0:12951:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1789477454.556220:0:12951:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:0.0:1789477454.556253:0:12951:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1789477454.556259:0:12951:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:0.0:1789477454.556267:0:12951:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1789477454.556302:0:12951:0:(import.c:65:import_set_state_nolock()) ffff9d0d750ff800 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00010000:00010000:2.0:1789477454.556373:0:5832:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789477454.556382:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.123@tcp lock: ffff9d0d82151800/0xafddb3c8f92816ce lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0xafddb3c8f92816d5 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477454.556401:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d0d82151800 already unused, calling callback (ffffffffc1bb3c20) 10000000:00010000:2.0:1789477454.556405:0:5832:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.123@tcp lock: ffff9d0d82151800/0xafddb3c8f92816ce lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0xafddb3c8f92816d5 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477454.556415:0:5832:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.123@tcp lock: ffff9d0d82151800/0xafddb3c8f92816ce lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1008400000000 nid: local remote: 0xafddb3c8f92816d5 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789477454.556423:0:5832:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.123@tcp lock: ffff9d0d82151800/0xafddb3c8f92816ce lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1009400000000 nid: local remote: 0xafddb3c8f92816d5 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789477454.556429:0:5832:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1789477454.556433:0:5832:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:2.0:1789477454.556436:0:5832:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:2.0:1789477454.556469:0:5832:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.123@tcp lock: ffff9d0d82151800/0xafddb3c8f92816ce lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0xafddb3c8f92816d5 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477454.556476:0:5832:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789477454.556528:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.123@tcp lock: ffff9d0d82151800/0xafddb3c8f92816ce lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0xafddb3c8f92816d5 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477454.556537:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.123@tcp lock: ffff9d0d82151800/0xafddb3c8f92816ce lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0xafddb3c8f92816d5 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477454.556552:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789477454.556554:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789477454.556556:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789477454.556566:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789477454.556613:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d623ca680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:07d5e05c-913f-419f-adbc-d3cf15e9cd51:3313:1876402802607744:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789477454.556702:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789477454.556818:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d50b05c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3309:1876402802607616:0@lo:39:umount.0 00000100:00100000:1.0:1789477454.556861:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789477454.557071:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802607616 00000100:00100000:1.0:1789477454.557081:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802607616 00000100:00100000:1.0:1789477454.557143:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 242 00000100:00100000:1.0:1789477454.557154:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d74a88000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1876402802607616:12345-0@lo:39:umount.0 00000020:00000080:1.0:1789477454.557187:0:5844:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xafddb3c8f928144a 00000100:00080000:1.0:1789477454.557197:0:5844:0:(import.c:65:import_set_state_nolock()) ffff9d0d5155f800 : changing import state from FULL to CLOSED 00000100:00100000:1.0:1789477454.557278:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d74a88000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+1:3309:x1876402802607616:12345-0@lo:39:umount.0 Request processed in 125us (416us total) trans 0 rc 0/0 00000100:00100000:1.0:1789477454.557296:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 242 00000020:00000080:1.0:1789477454.557309:0:5844:0:(genops.c:885:class_export_put()) final put ffff9d0d51558800/lustre-MDT0000-lwp-MDT0000_UUID 00000100:00080000:1.0:1789477454.557362:0:3309:0:(import.c:65:import_set_state_nolock()) ffff9d0d750ff800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:1.0:1789477454.557373:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d50b05c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3309:1876402802607616:0@lo:39:umount.0 00010000:00010000:3.0:1789477454.557480:0:6710:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1789477454.557856:0:12773:0:(genops.c:844:class_export_destroy()) destroying export ffff9d0d51558800/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000 00000020:00000080:2.0:1789477454.557994:0:12773:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9d0d5155f800 for lustre-MDT0000 00000100:00100000:2.0:1789477454.558016:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802607744 00000100:00100000:2.0:1789477454.558023:0:6711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802607744 00000100:00100000:2.0:1789477454.558079:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1789477454.558087:0:6711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d50a81450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:07d5e05c-913f-419f-adbc-d3cf15e9cd51+19:3313:x1876402802607744:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789477454.558102:0:6711:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789477454.558123:0:6711:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d0d41646e00/0xafddb3c8f92816d5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xafddb3c8f92816ce expref: 19 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477454.558141:0:6711:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789477454.558182:0:6711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d50a81450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:07d5e05c-913f-419f-adbc-d3cf15e9cd51+18:3313:x1876402802607744:12345-0@lo:103:ldlm_bl.0 Request processed in 96us (1481us total) trans 0 rc 0/0 00000100:00100000:2.0:1789477454.558190:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1789477454.558299:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d623ca680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:07d5e05c-913f-419f-adbc-d3cf15e9cd51:3313:1876402802607744:0@lo:103:ldlm_bl.0 00000100:00080000:2.0:1789477454.562079:0:12951:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1789477454.562109:0:12951:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:2.0:1789477454.562118:0:12951:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:2.0:1789477454.565453:0:12951:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.123@tcp lock: ffff9d0d49ecb800/0xafddb3c8f92816dc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xafddb3c8f92816e3 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477454.565479:0:12951:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.123@tcp lock: ffff9d0d49ecb800/0xafddb3c8f92816dc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xafddb3c8f92816e3 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477454.565487:0:12951:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.123@tcp lock: ffff9d0d49ecb800/0xafddb3c8f92816dc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0xafddb3c8f92816e3 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477454.565494:0:12951:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.123@tcp lock: ffff9d0d49ecb800/0xafddb3c8f92816dc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0xafddb3c8f92816e3 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477454.565525:0:12951:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789477454.565533:0:12951:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.123@tcp lock: ffff9d0d40031e00/0xafddb3c8f92815f5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xafddb3c8f92815fc expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477454.565540:0:12951:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.123@tcp lock: ffff9d0d40031e00/0xafddb3c8f92815f5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xafddb3c8f92815fc expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477454.565546:0:12951:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.123@tcp lock: ffff9d0d40031e00/0xafddb3c8f92815f5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xafddb3c8f92815fc expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477454.565553:0:12951:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.123@tcp lock: ffff9d0d40031e00/0xafddb3c8f92815f5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xafddb3c8f92815fc expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477454.565574:0:12951:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1789477454.565606:0:12951:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.123@tcp lock: ffff9d0d50be4000/0xafddb3c8f92818e9 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xafddb3c8f92818f0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477454.565636:0:12951:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.123@tcp lock: ffff9d0d50be4000/0xafddb3c8f92818e9 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xafddb3c8f92818f0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477454.565643:0:12951:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.123@tcp lock: ffff9d0d50be4000/0xafddb3c8f92818e9 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xafddb3c8f92818f0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477454.565649:0:12951:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.123@tcp lock: ffff9d0d50be4000/0xafddb3c8f92818e9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xafddb3c8f92818f0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477454.565670:0:12951:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:2.0:1789477454.565676:0:12951:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.123@tcp lock: ffff9d0d40030000/0xafddb3c8f92813a9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xafddb3c8f92813b0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477454.565684:0:12951:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.123@tcp lock: ffff9d0d40030000/0xafddb3c8f92813a9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xafddb3c8f92813b0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477454.565692:0:12951:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.123@tcp lock: ffff9d0d40030000/0xafddb3c8f92813a9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xafddb3c8f92813b0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477454.565698:0:12951:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.123@tcp lock: ffff9d0d40030000/0xafddb3c8f92813a9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xafddb3c8f92813b0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477454.565810:0:5833:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1789477454.565818:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.123@tcp lock: ffff9d0d49ecb800/0xafddb3c8f92816dc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0xafddb3c8f92816e3 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477454.565826:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d0d49ecb800 already unused, calling callback (ffffffffc1bb3c20) 10000000:00010000:1.0:1789477454.565831:0:5833:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.123@tcp lock: ffff9d0d49ecb800/0xafddb3c8f92816dc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0xafddb3c8f92816e3 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477454.565841:0:5833:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.123@tcp lock: ffff9d0d49ecb800/0xafddb3c8f92816dc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1008400000000 nid: local remote: 0xafddb3c8f92816e3 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789477454.565850:0:5833:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.123@tcp lock: ffff9d0d49ecb800/0xafddb3c8f92816dc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1009400000000 nid: local remote: 0xafddb3c8f92816e3 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789477454.565857:0:5833:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1789477454.565860:0:5833:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0000: stopping, won't requeue 00010000:00010000:1.0:1789477454.565972:0:5833:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.123@tcp lock: ffff9d0d49ecb800/0xafddb3c8f92816dc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0xafddb3c8f92816e3 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477454.565979:0:5833:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789477454.566009:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.123@tcp lock: ffff9d0d49ecb800/0xafddb3c8f92816dc lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0xafddb3c8f92816e3 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477454.566017:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.123@tcp lock: ffff9d0d49ecb800/0xafddb3c8f92816dc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0xafddb3c8f92816e3 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477454.566046:0:5833:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1789477454.566050:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.123@tcp lock: ffff9d0d40031e00/0xafddb3c8f92815f5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xafddb3c8f92815fc expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477454.566057:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d0d40031e00 already unused, calling callback (ffffffffc1bb3c20) 10000000:00010000:1.0:1789477454.566060:0:5833:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.123@tcp lock: ffff9d0d40031e00/0xafddb3c8f92815f5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xafddb3c8f92815fc expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477454.566068:0:5833:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.123@tcp lock: ffff9d0d40031e00/0xafddb3c8f92815f5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0xafddb3c8f92815fc expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789477454.566075:0:5833:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.123@tcp lock: ffff9d0d40031e00/0xafddb3c8f92815f5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0xafddb3c8f92815fc expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789477454.566080:0:5833:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:1.0:1789477454.566083:0:5833:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:1.0:1789477454.566085:0:5833:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:1.0:1789477454.566100:0:5833:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.123@tcp lock: ffff9d0d40031e00/0xafddb3c8f92815f5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xafddb3c8f92815fc expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477454.566106:0:5833:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789477454.566122:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.123@tcp lock: ffff9d0d40031e00/0xafddb3c8f92815f5 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xafddb3c8f92815fc expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477454.566130:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.123@tcp lock: ffff9d0d40031e00/0xafddb3c8f92815f5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xafddb3c8f92815fc expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477454.566145:0:5833:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789477454.566149:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.123@tcp lock: ffff9d0d50be4000/0xafddb3c8f92818e9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xafddb3c8f92818f0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477454.566161:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d0d50be4000 already unused, calling callback (ffffffffc1bb3c20) 10000000:00010000:1.0:1789477454.566165:0:5833:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.123@tcp lock: ffff9d0d50be4000/0xafddb3c8f92818e9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xafddb3c8f92818f0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477454.566172:0:5833:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.123@tcp lock: ffff9d0d50be4000/0xafddb3c8f92818e9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xafddb3c8f92818f0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789477454.566178:0:5833:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.123@tcp lock: ffff9d0d50be4000/0xafddb3c8f92818e9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xafddb3c8f92818f0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789477454.566183:0:5833:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:1.0:1789477454.566185:0:5833:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:1.0:1789477454.566187:0:5833:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:1.0:1789477454.566201:0:5833:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.123@tcp lock: ffff9d0d50be4000/0xafddb3c8f92818e9 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0xafddb3c8f92818f0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477454.566207:0:5833:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789477454.566213:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.123@tcp lock: ffff9d0d50be4000/0xafddb3c8f92818e9 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0xafddb3c8f92818f0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477454.566221:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.123@tcp lock: ffff9d0d50be4000/0xafddb3c8f92818e9 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0xafddb3c8f92818f0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477454.566230:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789477454.566232:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789477454.566234:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789477454.566258:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d74a88e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:07d5e05c-913f-419f-adbc-d3cf15e9cd51:3310:1876402802608000:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789477454.566351:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789477454.566423:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789477454.566438:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d7f700380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:07d5e05c-913f-419f-adbc-d3cf15e9cd51:3310:1876402802608128:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789477454.566463:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789477454.566498:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802608000 00000100:00100000:1.0:1789477454.566506:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802608000 00000100:00100000:1.0:1789477454.566564:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802608128 00000100:00100000:1.0:1789477454.566567:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802608128 00000100:00100000:1.0:1789477454.566633:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1789477454.566644:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d7f702a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:07d5e05c-913f-419f-adbc-d3cf15e9cd51+19:3310:x1876402802608000:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789477454.566662:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789477454.566679:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d0d41646c00/0xafddb3c8f92815fc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xafddb3c8f92815f5 expref: 19 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477454.566697:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789477454.566828:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789477454.566845:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789477454.566857:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d74a89f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:07d5e05c-913f-419f-adbc-d3cf15e9cd51:3312:1876402802607872:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789477454.566962:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789477454.567112:0:12951:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1789477454.567119:0:12951:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0000 10000000:01000000:2.0:1789477454.567123:0:12951:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0000 (0) 00000020:01000004:2.0:1789477454.567158:0:12951:0:(tgt_mount.c:2115:server_put_super()) stopping lustre-MDT0000 00000020:01000000:2.0:1789477454.567163:0:12951:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000 (flags='F') 00000020:00000080:2.0:1789477454.567168:0:12951:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1789477454.567175:0:12951:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000: forcing exports to disconnect: 2/7 00000020:00080000:2.0:1789477454.567188:0:12951:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff9d0d505a5800 lustre-MDT0000-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1789477454.567195:0:12951:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff9d0d6ecf0000 lustre-MDT0000-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1789477454.567204:0:12951:0:(genops.c:1819:print_export_data()) lustre-MDT0000: UNLINKED ffff9d0d74a80800 cf70c55a-e056-446b-8936-49e7cd31fc79 192.168.201.23@tcp 2 (0 2 0) 1 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1789477454.567210:0:12951:0:(genops.c:1553:class_disconnect_exports()) OBD device 5 (ffff9d0d4824cd28) has exports, disconnecting them 00000020:00080000:2.0:1789477454.567215:0:12951:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9d0d505a5800), last request at 1789477450 00000020:00000080:2.0:1789477454.567223:0:12951:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xafddb3c8f92815bd 00000100:00080000:2.0:1789477454.567242:0:12951:0:(import.c:65:import_set_state_nolock()) ffff9d0d6ec4c800 : changing import state from FULL to CLOSED 00000100:00100000:1.0:1789477454.567322:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d7f702a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:07d5e05c-913f-419f-adbc-d3cf15e9cd51+18:3310:x1876402802608000:12345-0@lo:103:ldlm_bl.0 Request processed in 678us (971us total) trans 0 rc 0/0 00000100:00100000:1.0:1789477454.567332:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1789477454.567354:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802607872 00000100:00100000:1.0:1789477454.567359:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802607872 00000100:00100000:1.0:1789477454.567381:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1789477454.567399:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d7f700000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:07d5e05c-913f-419f-adbc-d3cf15e9cd51+18:3310:x1876402802608128:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789477454.567409:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789477454.567420:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d0d50be4400/0xafddb3c8f92818f0 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xafddb3c8f92818e9 expref: 18 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477454.567431:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789477454.567455:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d7f700000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:07d5e05c-913f-419f-adbc-d3cf15e9cd51+17:3310:x1876402802608128:12345-0@lo:103:ldlm_bl.0 Request processed in 57us (991us total) trans 0 rc 0/0 00000100:00100000:1.0:1789477454.567461:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1789477454.567473:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1789477454.567487:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d50b05c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:07d5e05c-913f-419f-adbc-d3cf15e9cd51+16:3312:x1876402802607872:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789477454.567495:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789477454.567505:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d0d41647600/0xafddb3c8f92816e3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xafddb3c8f92816dc expref: 16 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477454.567514:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789477454.567541:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d50b05c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:07d5e05c-913f-419f-adbc-d3cf15e9cd51+15:3312:x1876402802607872:12345-0@lo:103:ldlm_bl.0 Request processed in 55us (580us total) trans 0 rc 0/0 00000100:00100000:1.0:1789477454.567548:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1789477454.567623:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d7f700380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:07d5e05c-913f-419f-adbc-d3cf15e9cd51:3310:1876402802608128:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789477454.567633:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d74a88e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:07d5e05c-913f-419f-adbc-d3cf15e9cd51:3310:1876402802608000:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789477454.567776:0:6710:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789477454.567787:0:6710:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.123@tcp lock: ffff9d0d40030000/0xafddb3c8f92813a9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xafddb3c8f92813b0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477454.567796:0:6710:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d0d40030000 already unused, calling callback (ffffffffc1bb3c20) 10000000:00010000:3.0:1789477454.567800:0:6710:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.123@tcp lock: ffff9d0d40030000/0xafddb3c8f92813a9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xafddb3c8f92813b0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477454.567810:0:6710:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.123@tcp lock: ffff9d0d40030000/0xafddb3c8f92813a9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0xafddb3c8f92813b0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789477454.567818:0:6710:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.123@tcp lock: ffff9d0d40030000/0xafddb3c8f92813a9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0xafddb3c8f92813b0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789477454.567824:0:6710:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:3.0:1789477454.567827:0:6710:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:3.0:1789477454.567829:0:6710:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:3.0:1789477454.567856:0:6710:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.123@tcp lock: ffff9d0d40030000/0xafddb3c8f92813a9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xafddb3c8f92813b0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477454.567870:0:6710:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1789477454.567966:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000020:00080000:2.0:1789477454.568058:0:12951:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9d0d505a5800): rc 0 00000020:00000080:2.0:1789477454.568062:0:12951:0:(genops.c:885:class_export_put()) final put ffff9d0d505a5800/lustre-MDT0000-lwp-OST0001_UUID 00000020:00080000:2.0:1789477454.568074:0:12951:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9d0d6ecf0000), last request at 1789477450 00000020:00000080:2.0:1789477454.568079:0:12951:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xafddb3c8f9281531 00000100:00080000:2.0:1789477454.568086:0:12951:0:(import.c:65:import_set_state_nolock()) ffff9d0d6ecf5800 : changing import state from FULL to CLOSED 00000020:00080000:2.0:1789477454.568092:0:12951:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9d0d6ecf0000): rc 0 00000020:00000080:2.0:1789477454.568095:0:12951:0:(genops.c:885:class_export_put()) final put ffff9d0d6ecf0000/lustre-MDT0000-lwp-OST0000_UUID 00000004:00000080:2.0:1789477454.568103:0:12951:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=400866e7 len=0 karg=ffffbc0b83b3bae0 00000100:00080000:2.0:1789477454.568126:0:12951:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1789477454.568132:0:12951:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967310 gen 3 00000004:00080000:2.0:1789477454.568147:0:12951:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:2.0:1789477454.568224:0:12951:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:2.0:1789477454.568237:0:12951:0:(import.c:65:import_set_state_nolock()) ffff9d0d7f78d000 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:2.0:1789477454.568251:0:12951:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1789477454.568253:0:12951:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967324 gen 3 00000004:00080000:2.0:1789477454.568264:0:12951:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1789477454.568338:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d623ca680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3309:1876402802608384:0@lo:9:umount.0 00000100:00100000:2.0:1789477454.568398:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1789477454.568438:0:12951:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:2.0:1789477454.568450:0:12951:0:(import.c:65:import_set_state_nolock()) ffff9d0d7c06f000 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:2.0:1789477454.568475:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d7c1fbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3309:1876402802608512:0@lo:9:umount.0 00000100:00100000:2.0:1789477454.568502:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789477454.568533:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802608384 00000100:00100000:2.0:1789477454.568540:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802608384 00000100:00100000:2.0:1789477454.568600:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802608512 00000100:00100000:2.0:1789477454.568604:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802608512 00000100:00100000:2.0:1789477454.568637:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1789477454.568644:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d7c60d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3309:x1876402802608384:12345-0@lo:9:umount.0 00000020:00000080:2.0:1789477454.568669:0:6696:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xafddb3c8f928153f 00000100:00080000:2.0:1789477454.568676:0:6696:0:(import.c:65:import_set_state_nolock()) ffff9d0d7c0c2000 : changing import state from FULL to CLOSED 00010000:00010000:3.0:1789477454.568804:0:6710:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.123@tcp lock: ffff9d0d40030000/0xafddb3c8f92813a9 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xafddb3c8f92813b0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477454.568815:0:6710:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.123@tcp lock: ffff9d0d40030000/0xafddb3c8f92813a9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xafddb3c8f92813b0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477454.568833:0:6710:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789477454.568835:0:6710:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789477454.568837:0:6710:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789477454.568869:0:8241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1789477454.568878:0:8241:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d4e640000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3309:x1876402802608512:12345-0@lo:9:umount.0 00000020:00000080:3.0:1789477454.568961:0:8241:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xafddb3c8f9281626 00000100:00080000:3.0:1789477454.568969:0:8241:0:(import.c:65:import_set_state_nolock()) ffff9d0d481a6000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1789477454.568996:0:8241:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967324 00000100:00100000:3.0:1789477454.569452:0:8241:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d4e640000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+2:3309:x1876402802608512:12345-0@lo:9:umount.0 Request processed in 573us (946us total) trans 0 rc 0/0 00000100:00100000:3.0:1789477454.569460:0:8241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00080000:3.0:1789477454.569487:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789477454.569525:0:3309:0:(import.c:65:import_set_state_nolock()) ffff9d0d7c06f000 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:3.0:1789477454.569537:0:3309:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:3.0:1789477454.569539:0:3309:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1789477454.569544:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d7c1fbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3309:1876402802608512:0@lo:9:umount.0 00010000:00010000:3.0:1789477454.569574:0:6710:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789477454.569686:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1789477454.569727:0:1381:0:(genops.c:844:class_export_destroy()) destroying export ffff9d0d505a5800/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000 00000020:00000080:0.0:1789477454.569789:0:1381:0:(genops.c:844:class_export_destroy()) destroying export ffff9d0d6ecf0000/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00000020:00000080:0.0:1789477454.569819:0:1381:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9d0d6ec4c800 for lustre-MDT0000 00000020:00000080:0.0:1789477454.569830:0:1381:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9d0d6ecf5800 for lustre-MDT0000 00010000:00010000:0.0:1789477454.569844:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789477454.569869:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d74a89f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:07d5e05c-913f-419f-adbc-d3cf15e9cd51:3312:1876402802607872:0@lo:103:ldlm_bl.0 00000001:00000004:2.0:1789477454.570124:0:6696:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967310 00000100:00100000:2.0:1789477454.570450:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d7c60d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+2:3309:x1876402802608384:12345-0@lo:9:umount.0 Request processed in 1804us (2048us total) trans 0 rc 0/0 00000100:00100000:2.0:1789477454.570460:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000020:00080000:2.0:1789477454.570524:0:12951:0:(genops.c:1558:class_disconnect_exports()) OBD device 5 (ffff9d0d4824cd28) has no exports 00000100:00100000:1.0:1789477454.570751:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d74aaad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:07d5e05c-913f-419f-adbc-d3cf15e9cd51:3313:1876402802608256:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789477454.570801:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1789477454.571031:0:3309:0:(import.c:65:import_set_state_nolock()) ffff9d0d7f78d000 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:3.0:1789477454.571055:0:3309:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:3.0:1789477454.571058:0:3309:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1789477454.571062:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d623ca680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3309:1876402802608384:0@lo:9:umount.0 00000100:00100000:2.0:1789477454.571138:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802608256 00000100:00100000:2.0:1789477454.571146:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802608256 00000100:00100000:2.0:1789477454.571209:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1789477454.571220:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d7f700380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:07d5e05c-913f-419f-adbc-d3cf15e9cd51+15:3313:x1876402802608256:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789477454.571236:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789477454.571260:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d0d41647c00/0xafddb3c8f92813b0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xafddb3c8f92813a9 expref: 15 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477454.571282:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789477454.571316:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d7f700380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:07d5e05c-913f-419f-adbc-d3cf15e9cd51+14:3313:x1876402802608256:12345-0@lo:103:ldlm_bl.0 Request processed in 98us (514us total) trans 0 rc 0/0 00000100:00100000:2.0:1789477454.571323:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1789477454.571422:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d74aaad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:07d5e05c-913f-419f-adbc-d3cf15e9cd51:3313:1876402802608256:0@lo:103:ldlm_bl.0 00000020:00080000:2.0:1789477454.581566:0:12951:0:(genops.c:1558:class_disconnect_exports()) OBD device 5 (ffff9d0d4824cd28) has no exports 00000020:00000080:2.0:1789477454.635715:0:12951:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xafddb3c8f9281404 00000020:00000080:2.0:1789477454.635732:0:12951:0:(genops.c:885:class_export_put()) final put ffff9d0d754b0000/lustre-QMT0000_UUID 00000020:01000000:2.0:1789477454.635752:0:12951:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-QMT0000 (flags='') 00000020:00000080:0.0:1789477454.635786:0:12773:0:(genops.c:844:class_export_destroy()) destroying export ffff9d0d754b0000/lustre-QMT0000_UUID for lustre-QMT0000 00000020:00000080:3.0:1789477454.635880:0:12951:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1789477454.635892:0:12951:0:(obd_config.c:956:class_cleanup()) lustre-QMT0000: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1789477454.635897:0:12951:0:(genops.c:1558:class_disconnect_exports()) OBD device 7 (ffff9d0d76160000) has no exports 00000020:00000080:3.0:1789477454.636190:0:12951:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xafddb3c8f92813fd 00000020:00000080:3.0:1789477454.636195:0:12951:0:(genops.c:885:class_export_put()) final put ffff9d0d7616c000/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1789477454.636242:0:12773:0:(genops.c:844:class_export_destroy()) destroying export ffff9d0d7616c000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1789477454.636246:0:12951:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1789477454.636255:0:12951:0:(obd_config.c:883:class_detach()) detach on obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:3.0:1789477454.636260:0:12951:0:(genops.c:885:class_export_put()) final put ffff9d0d7bdd5800/lustre-QMT0000_UUID 00000020:00000080:3.0:1789477454.636263:0:12951:0:(genops.c:844:class_export_destroy()) destroying export ffff9d0d7bdd5800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:01000000:3.0:1789477454.636272:0:12951:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-QMT0000 (lustre-QMT0000_UUID) 00010000:00010000:3.0:1789477455.536134:0:6710:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789477455.792324:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d7523e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3311:1876402802608896:0@lo:400:kworker.0 00000100:00100000:3.0:1789477455.792437:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789477455.792529:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789477455.792536:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d7bddea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3311:1876402802608768:0@lo:400:kworker.0 00000100:00100000:3.0:1789477455.792561:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789477455.792633:0:6999:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802608896 00000100:00100000:3.0:1789477455.792643:0:6999:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802608896 00000100:00100000:3.0:1789477455.792757:0:6999:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802608768 00000100:00100000:3.0:1789477455.792762:0:6999:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802608768 00000100:00100000:3.0:1789477455.792787:0:6999:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 243 00000100:00100000:3.0:1789477455.792796:0:6999:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d74aaad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3311:x1876402802608896:12345-0@lo:400:kworker.0 00000020:00080000:3.0:1789477455.792806:0:6999:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:3.0:1789477455.792856:0:6999:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d74aaad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3311:x1876402802608896:12345-0@lo:400:kworker.0 Request processed in 58us (419us total) trans 0 rc -107/-107 00000100:00100000:3.0:1789477455.792864:0:6999:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 243 00000100:00100000:3.0:1789477455.792882:0:6999:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 244 00000100:00100000:3.0:1789477455.792886:0:6999:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d623ca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3311:x1876402802608768:12345-0@lo:400:kworker.0 00000020:00080000:3.0:1789477455.792891:0:6999:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:3.0:1789477455.792927:0:6999:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d623ca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3311:x1876402802608768:12345-0@lo:400:kworker.0 Request processed in 39us (365us total) trans 0 rc -107/-107 00000100:00100000:3.0:1789477455.792933:0:6999:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 244 00000100:00100000:1.0:1789477455.792943:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d75285f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:07d5e05c-913f-419f-adbc-d3cf15e9cd51:3313:1876402802608640:0@lo:400:kworker.0 00000100:00080000:3.0:1789477455.792972:0:3311:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0000 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:3.0:1789477455.792978:0:3311:0:(import.c:65:import_set_state_nolock()) ffff9d0d7fafc000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:3.0:1789477455.792983:0:3311:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00100000:1.0:1789477455.792984:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789477455.793030:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802608640 00000100:00100000:1.0:1789477455.793034:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802608640 00000100:00100000:1.0:1789477455.793071:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 306 00000100:00100000:1.0:1789477455.793078:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d4e675c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07d5e05c-913f-419f-adbc-d3cf15e9cd51+14:3313:x1876402802608640:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789477455.793134:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d4e675c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07d5e05c-913f-419f-adbc-d3cf15e9cd51+14:3313:x1876402802608640:12345-0@lo:400:kworker.0 Request processed in 57us (149us total) trans 0 rc 0/0 00000100:00100000:1.0:1789477455.793141:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 306 00000100:00100000:1.0:1789477455.793185:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d75285f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:07d5e05c-913f-419f-adbc-d3cf15e9cd51:3313:1876402802608640:0@lo:400:kworker.0 00000100:00080000:3.0:1789477455.817474:0:3311:0:(import.c:65:import_set_state_nolock()) ffff9d0d7fafc000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1789477455.817496:0:3311:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 188 00000100:00080000:3.0:1789477455.817517:0:3311:0:(import.c:625:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9d0d7fafc000 using connection 192.168.201.123@tcp/0@lo 00000100:00100000:3.0:1789477455.818444:0:3311:0:(import.c:827:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9d0d7c1fbb80 x1876402802609024/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1789477455.818506:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d7bddea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3311:1876402802608768:0@lo:400:kworker.0 00000100:00080000:3.0:1789477455.818555:0:3311:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:3.0:1789477455.818561:0:3311:0:(import.c:65:import_set_state_nolock()) ffff9d0d75358800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:3.0:1789477455.818564:0:3311:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00100000:0.0:1789477455.818564:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d7c1fbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3309:1876402802609024:0@lo:38:ptlrpcd_00_01.0 00000100:00080000:3.0:1789477455.818568:0:3311:0:(import.c:65:import_set_state_nolock()) ffff9d0d75358800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1789477455.818572:0:3311:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 208 00000100:00080000:3.0:1789477455.818597:0:3311:0:(import.c:625:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9d0d75358800 using connection 192.168.201.123@tcp/0@lo 00000100:00100000:3.0:1789477455.818635:0:3311:0:(import.c:827:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9d0d58072d80 x1876402802609152/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1789477455.818646:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d7523e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3311:1876402802608896:0@lo:400:kworker.0 00000100:00100000:0.0:1789477455.818697:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789477455.818741:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d58072d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3309:1876402802609152:0@lo:38:ptlrpcd_00_01.0 00000100:00100000:0.0:1789477455.818765:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789477455.819430:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802609024 00000100:00100000:1.0:1789477455.819442:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802609024 00000100:00100000:1.0:1789477455.819508:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802609152 00000100:00100000:1.0:1789477455.819512:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802609152 00000100:00100000:1.0:1789477455.819547:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 245 00000100:00100000:1.0:1789477455.819557:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d6d482300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3309:x1876402802609024:12345-0@lo:38:ptlrpcd_00_01.0 00000100:00100000:0.0:1789477455.819796:0:12091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 246 00000100:00100000:0.0:1789477455.819802:0:12091:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d6d482d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3309:x1876402802609152:12345-0@lo:38:ptlrpcd_00_01.0 00010000:02000000:1.0:1789477455.819886:0:5846:0:(ldlm_lib.c:1203:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00010000:02000000:0.0:1789477455.821050:0:12091:0:(ldlm_lib.c:1203:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:0.0:1789477455.821354:0:12091:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d6d482d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3309:x1876402802609152:12345-0@lo:38:ptlrpcd_00_01.0 Request processed in 1547us (2584us total) trans 0 rc -19/-19 00000100:00100000:0.0:1789477455.821380:0:12091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 246 00000100:00080000:2.0:1789477455.821762:0:3309:0:(import.c:65:import_set_state_nolock()) ffff9d0d75358800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1789477455.821770:0:3309:0:(import.c:1512:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1789477455.821776:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d58072d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3309:1876402802609152:0@lo:38:ptlrpcd_00_01.0 00000100:00100000:1.0:1789477455.824816:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d6d482300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3309:x1876402802609024:12345-0@lo:38:ptlrpcd_00_01.0 Request processed in 5243us (6103us total) trans 0 rc -19/-19 00000100:00100000:1.0:1789477455.824836:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 245 00000100:00080000:0.0:1789477455.825137:0:3309:0:(import.c:65:import_set_state_nolock()) ffff9d0d7fafc000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1789477455.825145:0:3309:0:(import.c:1512:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1789477455.825150:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d7c1fbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3309:1876402802609024:0@lo:38:ptlrpcd_00_01.0 00000001:00100000:3.0:1789477456.378957:0:5868:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of cf70c55a-e056-446b-8936-49e7cd31fc79 00000001:00080000:3.0:1789477456.378985:0:5868:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967527 is committed 00000020:00000080:3.0:1789477456.379015:0:5868:0:(genops.c:885:class_export_put()) final put ffff9d0d74a80800/cf70c55a-e056-446b-8936-49e7cd31fc79 00000020:00000080:2.0:1789477456.379117:0:12773:0:(genops.c:844:class_export_destroy()) destroying export ffff9d0d74a80800/cf70c55a-e056-446b-8936-49e7cd31fc79 for lustre-MDT0000 00000020:00000080:2.0:1789477456.379204:0:12773:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9d0d74a81800 for lustre-MDT0000 00010000:00010000:0.0:1789477456.559812:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:3.0:1789477456.687841:0:12951:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9d0d74cd4cc0 - data ffff9d0d68421000/ffff9d0d7f771c00 00000020:01000000:3.0:1789477456.688040:0:12951:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9d0d44494ae0 - data ffff9d0d68448948/ffff9d0d6cd4d400 00000001:00000004:3.0:1789477456.697983:0:12951:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967527 00000100:00080000:3.0:1789477456.779045:0:12951:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1789477456.779057:0:12951:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967310 gen 4 00000004:00080000:3.0:1789477456.779084:0:12951:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1789477456.779088:0:12951:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:0.0:1789477456.783171:0:6716:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:0.0:1789477456.783183:0:6716:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x3:0x0] index 5 count 1 00000040:00080000:0.0:1789477456.783203:0:6716:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 1 count 2 00000100:00080000:0.0:1789477456.787186:0:12951:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:0.0:1789477456.787197:0:12951:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967324 gen 4 00000004:00080000:0.0:1789477456.787217:0:12951:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1789477456.787220:0:12951:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:2.0:1789477456.787948:0:8043:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:2.0:1789477456.787955:0:8043:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x6:0x0] index 8 count 1 00000040:00080000:2.0:1789477456.787969:0:8043:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 1 count 2 00000001:00100000:1.0:1789477456.860091:0:7678:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1789477456.860266:0:7678:0:(genops.c:885:class_export_put()) final put ffff9d0d481a3000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1789477456.860349:0:1381:0:(genops.c:844:class_export_destroy()) destroying export ffff9d0d481a3000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001 00000020:00000080:0.0:1789477456.860416:0:1381:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9d0d481a6000 for lustre-OST0001 00000020:00000080:0.0:1789477456.895304:0:12951:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xafddb3c8f92813cc 00000020:00000080:0.0:1789477456.895318:0:12951:0:(genops.c:885:class_export_put()) final put ffff9d0d7c0c5800/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1789477456.895393:0:12773:0:(genops.c:844:class_export_destroy()) destroying export ffff9d0d7c0c5800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1789477456.897325:0:12951:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xafddb3c8f92813e1 00000020:00000080:1.0:1789477456.897338:0:12951:0:(genops.c:885:class_export_put()) final put ffff9d0d754b1800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:1.0:1789477456.897416:0:12951:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-mdtlov (flags='') 00000020:00000080:1.0:1789477456.897423:0:12951:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1789477456.897434:0:12951:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1789477456.897439:0:12951:0:(genops.c:1558:class_disconnect_exports()) OBD device 4 (ffff9d0d48248000) has no exports 00000004:01000000:1.0:1789477456.897692:0:12951:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:1.0:1789477456.897701:0:12951:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xafddb3c8f928161f 00000020:00000080:1.0:1789477456.897706:0:12951:0:(genops.c:885:class_export_put()) final put ffff9d0d481a1000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1789477456.897864:0:12773:0:(genops.c:844:class_export_destroy()) destroying export ffff9d0d754b1800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:1.0:1789477456.897935:0:12951:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0000 (flags='') 00000020:00000080:1.0:1789477456.897939:0:12951:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1789477456.897948:0:12951:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1789477456.897950:0:12951:0:(genops.c:1558:class_disconnect_exports()) OBD device 17 (ffff9d0d76163370) has no exports 00000020:00000080:1.0:1789477456.897959:0:12951:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xafddb3c8f9281618 00000020:00000080:1.0:1789477456.897963:0:12951:0:(genops.c:885:class_export_put()) final put ffff9d0d7c06a000/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1789477456.897980:0:12773:0:(genops.c:844:class_export_destroy()) destroying export ffff9d0d481a1000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00010000:01000000:1.0:1789477456.898533:0:12951:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0000: client import never connected 00000100:00080000:1.0:1789477456.898539:0:12951:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:1.0:1789477456.898558:0:12951:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967324 gen 5 00000004:00080000:1.0:1789477456.898566:0:12951:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1789477456.898569:0:12951:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1789477456.898773:0:12773:0:(genops.c:844:class_export_destroy()) destroying export ffff9d0d7c06a000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1789477456.898974:0:12951:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789477456.898983:0:12951:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1789477456.898991:0:12951:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xafddb3c8f92814b3 00000020:00000080:0.0:1789477456.898996:0:12951:0:(genops.c:885:class_export_put()) final put ffff9d0d6ec48800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1789477456.899037:0:12773:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9d0d7c06f000 for lustre-OST0001-osc-MDT0000 00000020:00000080:3.0:1789477456.899043:0:12773:0:(genops.c:885:class_export_put()) final put ffff9d0d7c06b800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1789477456.899046:0:12773:0:(genops.c:844:class_export_destroy()) destroying export ffff9d0d7c06b800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:01000000:3.0:1789477456.899051:0:12773:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:01000000:0.0:1789477456.899198:0:12951:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0000 (flags='') 00000020:00000080:0.0:1789477456.899203:0:12951:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789477456.899209:0:12951:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:0.0:1789477456.899212:0:12951:0:(genops.c:1558:class_disconnect_exports()) OBD device 11 (ffff9d0d50b819b8) has no exports 00000020:00000080:0.0:1789477456.899219:0:12951:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xafddb3c8f92814a5 00000020:00000080:0.0:1789477456.899223:0:12951:0:(genops.c:885:class_export_put()) final put ffff9d0d7f78c800/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1789477456.899239:0:12773:0:(genops.c:844:class_export_destroy()) destroying export ffff9d0d6ec48800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:00000080:3.0:1789477456.899738:0:12773:0:(genops.c:844:class_export_destroy()) destroying export ffff9d0d7f78c800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:1.0:1789477456.899925:0:12951:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0000: client import never connected 00000100:00080000:1.0:1789477456.899930:0:12951:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:1.0:1789477456.899934:0:12951:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967310 gen 5 00000004:00080000:1.0:1789477456.899938:0:12951:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1789477456.899940:0:12951:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1789477456.899970:0:12951:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1789477456.899975:0:12951:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1789477456.900006:0:12951:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1789477456.900009:0:12951:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1789477456.900013:0:12951:0:(genops.c:885:class_export_put()) final put ffff9d0d7c0c2800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1789477456.900015:0:12951:0:(genops.c:844:class_export_destroy()) destroying export ffff9d0d7c0c2800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:1.0:1789477456.900020:0:12951:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-mdtlov (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1789477456.900181:0:12951:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xafddb3c8f92813e8 00000020:00000080:1.0:1789477456.900187:0:12951:0:(genops.c:885:class_export_put()) final put ffff9d0d754b0800/lustre-MDD0000_UUID 00000020:01000000:1.0:1789477456.900190:0:12951:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0000 (flags='') 00000020:00000080:1.0:1789477456.900194:0:12951:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1789477456.900198:0:12951:0:(obd_config.c:956:class_cleanup()) lustre-MDD0000: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1789477456.900201:0:12951:0:(genops.c:1558:class_disconnect_exports()) OBD device 6 (ffff9d0d4824b370) has no exports 00000020:00000080:1.0:1789477456.900220:0:12951:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1789477456.900223:0:12951:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000020:00000080:1.0:1789477456.900226:0:12951:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xafddb3c8f92813ef 00000020:00000080:1.0:1789477456.900230:0:12951:0:(genops.c:885:class_export_put()) final put ffff9d0d754b4000/lustre-MDT0000-osd_UUID 00000020:01000004:1.0:1789477456.900241:0:12951:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9d0d4444e800 from lustre-MDT0000, refs=3 00000020:01000004:1.0:1789477456.900245:0:12951:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9d0d4444e800 3 00000020:01000004:1.0:1789477456.900248:0:12951:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9d0d4444e800 from lustre-MDT0000 00000020:00000080:1.0:1789477456.900268:0:12951:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1789477456.900272:0:12951:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:00000080:1.0:1789477456.900275:0:12951:0:(genops.c:885:class_export_put()) final put ffff9d0d7c0c0000/lustre-MDT0000_UUID 00000020:00000080:1.0:1789477456.900277:0:12951:0:(genops.c:844:class_export_destroy()) destroying export ffff9d0d7c0c0000/lustre-MDT0000_UUID for lustre-MDT0000 00000020:01000000:1.0:1789477456.900300:0:12951:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000 (lustre-MDT0000_UUID) 00000020:01000004:1.0:1789477456.900330:0:12951:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 2 references. 00000020:01000004:1.0:1789477456.900335:0:12951:0:(tgt_mount.c:255:server_stop_mgs()) Stop MGS service MGS 00000020:01000000:1.0:1789477456.900338:0:12951:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGS (flags='F') 00000020:00000080:3.0:1789477456.900439:0:12773:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9d0d7f78d000 for lustre-OST0000-osc-MDT0000 00000020:00000080:3.0:1789477456.900446:0:12773:0:(genops.c:885:class_export_put()) final put ffff9d0d7f788000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1789477456.900448:0:12773:0:(genops.c:844:class_export_destroy()) destroying export ffff9d0d7f788000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:01000000:3.0:1789477456.900457:0:12773:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1789477456.900541:0:12773:0:(genops.c:844:class_export_destroy()) destroying export ffff9d0d754b0800/lustre-MDD0000_UUID for lustre-MDD0000 00000020:00000080:3.0:1789477456.900545:0:12773:0:(genops.c:885:class_export_put()) final put ffff9d0d7c0c7000/lustre-MDD0000_UUID 00000020:00000080:3.0:1789477456.900547:0:12773:0:(genops.c:844:class_export_destroy()) destroying export ffff9d0d7c0c7000/lustre-MDD0000_UUID for lustre-MDD0000 00000020:01000000:3.0:1789477456.900551:0:12773:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0000 (lustre-MDD0000_UUID) 00000020:00000080:3.0:1789477456.900856:0:12773:0:(genops.c:844:class_export_destroy()) destroying export ffff9d0d754b4000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1789477456.900913:0:12951:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1789477456.900919:0:12951:0:(obd_config.c:956:class_cleanup()) MGS: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1789477456.900926:0:12951:0:(genops.c:1819:print_export_data()) MGS: ACTIVE ffff9d0d4823b800 07d5e05c-913f-419f-adbc-d3cf15e9cd51 0@lo 13 (0 0 8) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1789477456.900931:0:12951:0:(genops.c:1553:class_disconnect_exports()) OBD device 1 (ffff9d0d58478000) has exports, disconnecting them 00000020:00080000:1.0:1789477456.900936:0:12951:0:(genops.c:1528:class_disconnect_export_list()) MGS: disconnecting export at 0@lo (ffff9d0d4823b800), last request at 1789477225 00000020:00000080:1.0:1789477456.900955:0:12951:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xafddb3c8f928138d 00000020:00010000:1.0:1789477456.900959:0:12951:0:(genops.c:1921:obd_stale_export_put()) Put export ffff9d0d4823b800: total 0 00000100:00080000:1.0:1789477456.900964:0:12951:0:(import.c:65:import_set_state_nolock()) ffff9d0d4823f800 : changing import state from FULL to CLOSED 00000020:00080000:1.0:1789477456.901016:0:12951:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9d0d4823b800): rc 0 00000020:00080000:1.0:1789477456.901020:0:12951:0:(genops.c:1558:class_disconnect_exports()) OBD device 1 (ffff9d0d58478000) has no exports 00000100:00100000:1.0:1789477456.901103:0:5837:0:(service.c:3183:ptlrpc_main()) ll_mgs_0000: service thread [ffff9d0d515ea800:5837] 0 exiting: rc = 1 00000100:00100000:1.0:1789477456.901205:0:5838:0:(service.c:3183:ptlrpc_main()) ll_mgs_0001: service thread [ffff9d0d4704d600:5838] 1 exiting: rc = 0 00000100:00100000:3.0:1789477456.901396:0:5839:0:(service.c:3183:ptlrpc_main()) ll_mgs_0002: service thread [ffff9d0d47789600:5839] 2 exiting: rc = 0 00000100:00100000:1.0:1789477456.901515:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789477456.901524:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789477456.901531:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789477456.901540:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789477456.901546:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789477456.901552:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789477456.901563:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789477456.901570:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789477456.901644:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789477456.901652:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789477456.901659:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789477456.901733:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789477456.901745:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789477456.901751:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789477456.901786:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789477456.901795:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789477456.901811:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789477456.901817:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789477456.901823:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789477456.901830:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789477456.901837:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789477456.901844:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789477456.901850:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789477456.901857:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789477456.901865:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789477456.901871:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789477456.901879:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789477456.901885:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789477456.901890:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789477456.901896:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789477456.901902:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789477456.901909:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789477456.901916:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789477456.901921:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789477456.901927:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789477456.901934:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789477456.901941:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789477456.901947:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789477456.901953:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789477456.901959:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789477456.901967:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789477456.901973:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789477456.901978:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789477456.901984:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789477456.901991:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789477456.901998:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789477456.902003:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789477456.902009:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789477456.902015:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789477456.902020:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789477456.902026:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789477456.902041:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789477456.902048:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789477456.902054:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789477456.902060:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789477456.902065:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789477456.902072:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789477456.902079:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789477456.902086:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789477456.902092:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789477456.902099:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789477456.902105:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789477456.902111:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789477456.902117:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 20000000:01000000:1.0:1789477456.902564:0:12951:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:1.0:1789477456.902569:0:12951:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 00000020:00010000:0.0:1789477456.904915:0:5832:0:(genops.c:1907:obd_stale_export_get()) Get export ffff9d0d4823b800: total 0 00010000:00010000:0.0:1789477456.904989:0:5832:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9d0d4823b800, canceled 0 locks, left on hash table 8. 00010000:00010000:0.0:1789477456.905113:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d0d49eca800/0xafddb3c8f92818e2 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xafddb3c8f92818db expref: 9 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477456.905142:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d0d82151600/0xafddb3c8f92816c7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xafddb3c8f92816c0 expref: 8 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477456.905154:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d0d59d6aa00/0xafddb3c8f92818d4 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xafddb3c8f92818cd expref: 7 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477456.905189:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d0d49ecaa00/0xafddb3c8f92814c8 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xafddb3c8f92814c1 expref: 6 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477456.905204:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d0d41647400/0xafddb3c8f92816f1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xafddb3c8f92816ea expref: 5 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477456.905214:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d0d59d6a000/0xafddb3c8f928169d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xafddb3c8f9281696 expref: 4 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477456.905226:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d0d59d6ae00/0xafddb3c8f92816ab lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xafddb3c8f92816a4 expref: 3 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477456.905236:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d0d41646800/0xafddb3c8f92816b9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xafddb3c8f92816b2 expref: 2 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477456.905247:0:5832:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9d0d4823b800, canceled 8 locks, left on hash table 0. 00000020:00000080:0.0:1789477456.905262:0:5832:0:(genops.c:885:class_export_put()) final put ffff9d0d4823b800/07d5e05c-913f-419f-adbc-d3cf15e9cd51 00010000:00010000:0.0:1789477456.905282:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789477456.905285:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789477456.905452:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1789477456.905515:0:12773:0:(genops.c:844:class_export_destroy()) destroying export ffff9d0d4823b800/07d5e05c-913f-419f-adbc-d3cf15e9cd51 for MGS 00000020:00000080:0.0:1789477456.905549:0:12773:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9d0d4823f800 for MGS 00000020:01000000:1.0:1789477456.906570:0:12951:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9d0d44495540 - data ffff9d0d6879b0d8/ffff9d0d74d07000 00000020:01000000:1.0:1789477456.906882:0:12951:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9d0d445248a0 - data ffff9d0d78fa4d80/ffff9d0d50a21c00 00000020:00000080:1.0:1789477456.907459:0:12951:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xafddb3c8f9281371 00000020:00000080:1.0:1789477456.907469:0:12951:0:(genops.c:885:class_export_put()) final put ffff9d0d44511000/lustre-MDT0000-osd_UUID 00000020:01000004:1.0:1789477456.907534:0:12951:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9d0d4444e800 from MGS, refs=2 00000020:01000004:1.0:1789477456.907540:0:12951:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9d0d4444e800 2 00000020:01000004:1.0:1789477456.907543:0:12951:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9d0d4444e800 from MGS 00000020:00000080:1.0:1789477456.907568:0:12951:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1789477456.907607:0:12951:0:(obd_config.c:883:class_detach()) detach on obd MGS (uuid MGS) 00000020:00000080:1.0:1789477456.907611:0:12951:0:(genops.c:885:class_export_put()) final put ffff9d0d44514800/MGS 00000020:00000080:1.0:1789477456.907615:0:12951:0:(genops.c:844:class_export_destroy()) destroying export ffff9d0d44514800/MGS for MGS 00000020:01000000:1.0:1789477456.907621:0:12951:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGS (MGS) 00000020:01000000:1.0:1789477456.907760:0:12951:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0000 (flags='F') 00000020:00000080:1.0:1789477456.907765:0:12951:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1789477456.907772:0:12951:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-MDT0000: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1789477456.907780:0:12951:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-MDT0000: ACTIVE ffff9d0d728f0000 lustre-MDT0000-lwp-MDT0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1789477456.907786:0:12951:0:(genops.c:1553:class_disconnect_exports()) OBD device 8 (ffff9d0d50b83370) has exports, disconnecting them 00000020:00080000:1.0:1789477456.907791:0:12951:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0000: disconnecting export at 0@lo (ffff9d0d728f0000), last request at 1789477226 00000020:00000080:1.0:1789477456.907810:0:12951:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xafddb3c8f928143c 00000020:00080000:1.0:1789477456.907822:0:12951:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9d0d728f0000): rc 0 00000020:00000080:1.0:1789477456.907826:0:12951:0:(genops.c:885:class_export_put()) final put ffff9d0d728f0000/lustre-MDT0000-lwp-MDT0000 00000020:00000080:0.0:1789477456.907897:0:1381:0:(genops.c:844:class_export_destroy()) destroying export ffff9d0d44511000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1789477456.908922:0:1381:0:(genops.c:844:class_export_destroy()) destroying export ffff9d0d728f0000/lustre-MDT0000-lwp-MDT0000 for lustre-MDT0000-lwp-MDT0000 00010000:01000000:0.0:1789477456.909757:0:12951:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0000: client import never connected 00000100:00080000:0.0:1789477456.909765:0:12951:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1789477456.909770:0:12951:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:0.0:1789477456.909780:0:12951:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1789477456.910054:0:12951:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789477456.910064:0:12951:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000004:0.0:1789477456.910071:0:12951:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9d0d4444e800 1 00000020:00000080:0.0:1789477456.910078:0:12951:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xafddb3c8f9281363 00000020:00000080:0.0:1789477456.910086:0:12951:0:(genops.c:885:class_export_put()) final put ffff9d0d44513800/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1789477456.910110:0:1381:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9d0d750ff800 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:3.0:1789477456.910119:0:1381:0:(genops.c:885:class_export_put()) final put ffff9d0d728f6000/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:3.0:1789477456.910121:0:1381:0:(genops.c:844:class_export_destroy()) destroying export ffff9d0d728f6000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000-lwp-MDT0000 00000020:01000000:3.0:1789477456.910131:0:1381:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0000 (lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000000:0.0:1789477456.910267:0:12951:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osd (flags='') 00000020:00000080:0.0:1789477456.910273:0:12951:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789477456.910278:0:12951:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1789477456.910282:0:12951:0:(genops.c:1558:class_disconnect_exports()) OBD device 0 (ffff9d0d50b84d28) has no exports 00000020:00000080:3.0:1789477456.910362:0:1381:0:(genops.c:844:class_export_destroy()) destroying export ffff9d0d44513800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1789477456.952929:0:12951:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1789477456.952956:0:12951:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00000020:00000080:3.0:1789477456.952963:0:12951:0:(genops.c:885:class_export_put()) final put ffff9d0d4444b000/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1789477456.952969:0:12951:0:(genops.c:844:class_export_destroy()) destroying export ffff9d0d4444b000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:3.0:1789477456.952978:0:12951:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osd (lustre-MDT0000-osd_UUID) 00000020:01000004:3.0:1789477456.953133:0:12951:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff9d0d4444a800 00000020:01000000:3.0:1789477456.953160:0:12951:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MDS (flags='F') 00000020:00000080:3.0:1789477456.953164:0:12951:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1789477456.953169:0:12951:0:(obd_config.c:956:class_cleanup()) MDS: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1789477456.953174:0:12951:0:(genops.c:1558:class_disconnect_exports()) OBD device 3 (ffff9d0d5847cd28) has no exports 00000100:00100000:2.0:1789477456.953291:0:5845:0:(service.c:3183:ptlrpc_main()) mdt00_001: service thread [ffff9d0d445f9200:5845] 1 exiting: rc = 0 00000100:00100000:2.0:1789477456.953434:0:6999:0:(service.c:3183:ptlrpc_main()) mdt00_003: service thread [ffff9d0d7f767600:6999] 3 exiting: rc = 0 00000100:00100000:0.0:1789477456.953732:0:12091:0:(service.c:3183:ptlrpc_main()) mdt00_004: service thread [ffff9d0d7f72da00:12091] 4 exiting: rc = 0 00000100:00100000:0.0:1789477456.954673:0:5846:0:(service.c:3183:ptlrpc_main()) mdt00_002: service thread [ffff9d0d445f9a00:5846] 2 exiting: rc = 0 00000100:00100000:3.0:1789477456.958463:0:5844:0:(service.c:3183:ptlrpc_main()) mdt00_000: service thread [ffff9d0d5152ae00:5844] 0 exiting: rc = 1 00000100:00100000:2.0:1789477456.959129:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789477456.959141:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789477456.959147:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789477456.959154:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789477456.959160:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789477456.959167:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789477456.959194:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789477456.959202:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789477456.959208:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789477456.959214:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789477456.959221:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789477456.959227:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789477456.959233:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789477456.959240:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789477456.959246:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789477456.959252:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789477456.959259:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789477456.959265:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789477456.959270:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789477456.959290:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789477456.959296:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789477456.959485:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789477456.959494:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789477456.959500:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789477456.959506:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789477456.959512:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789477456.959520:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789477456.959526:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789477456.959771:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789477456.959782:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789477456.959788:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789477456.959796:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789477456.959807:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789477456.959812:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789477456.959819:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789477456.959828:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789477456.959835:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789477456.959844:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789477456.959852:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789477456.959879:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789477456.959910:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789477456.959917:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789477456.959923:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789477456.959929:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789477456.959935:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789477456.959941:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789477456.959951:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789477456.960066:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789477456.960072:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789477456.960078:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789477456.960084:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789477456.960090:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789477456.960095:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789477456.960101:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789477456.960118:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789477456.960124:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789477456.960130:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789477456.960137:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789477456.960142:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789477456.960148:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789477456.960154:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789477456.960160:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789477456.960167:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789477456.960181:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789477456.965437:0:5848:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_001: service thread [ffff9d0d5152b000:5848] 1 exiting: rc = 0 00000100:00100000:3.0:1789477456.965905:0:5847:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_000: service thread [ffff9d0d445f9c00:5847] 0 exiting: rc = 1 00000100:00100000:0.0:1789477456.965966:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789477456.965980:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789477456.966017:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789477456.966027:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789477456.966034:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789477456.966041:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789477456.966046:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789477456.966052:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789477456.966060:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789477456.966066:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789477456.966071:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789477456.966078:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789477456.966085:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789477456.966090:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789477456.966095:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789477456.966100:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789477456.966106:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789477456.966111:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789477456.966116:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789477456.966122:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789477456.966127:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789477456.966132:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789477456.966138:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789477456.966156:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789477456.966162:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789477456.966167:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789477456.966172:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789477456.966177:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789477456.966182:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789477456.966187:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789477456.966192:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789477456.966197:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789477456.966204:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789477456.966208:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789477456.966214:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789477456.966219:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789477456.966232:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789477456.966267:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789477456.966274:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789477456.966279:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789477456.966284:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789477456.966290:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789477456.966299:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789477456.966305:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789477456.966311:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789477456.966318:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789477456.966324:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789477456.966330:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789477456.966336:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789477456.966350:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789477456.966358:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789477456.966365:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789477456.966370:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789477456.966376:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789477456.966384:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789477456.966390:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789477456.966395:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789477456.966400:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789477456.966413:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789477456.966420:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789477456.966427:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789477456.966433:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789477456.966438:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789477456.966445:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789477456.967179:0:5849:0:(service.c:3183:ptlrpc_main()) mdt_out00_000: service thread [ffff9d0d445f9e00:5849] 0 exiting: rc = 1 00000100:00100000:3.0:1789477456.967644:0:5850:0:(service.c:3183:ptlrpc_main()) mdt_out00_001: service thread [ffff9d0d585b5800:5850] 1 exiting: rc = 0 00000100:00100000:0.0:1789477456.967876:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789477456.967885:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789477456.967893:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789477456.967901:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789477456.967907:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789477456.967917:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789477456.967924:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789477456.967932:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789477456.967938:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789477456.967945:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789477456.967951:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789477456.967958:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789477456.967965:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789477456.967971:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789477456.967978:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789477456.968001:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789477456.968008:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789477456.968014:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789477456.968023:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789477456.968031:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789477456.968038:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789477456.968047:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789477456.968055:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789477456.968061:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789477456.968067:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789477456.968074:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789477456.968081:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789477456.968103:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789477456.968110:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789477456.968129:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789477456.968136:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789477456.968142:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789477456.968149:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789477456.968156:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789477456.968163:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789477456.968170:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789477456.968178:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789477456.968185:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789477456.968193:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789477456.968217:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789477456.968226:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789477456.968232:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789477456.968239:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789477456.968246:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789477456.968253:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789477456.968259:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789477456.968266:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789477456.968272:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789477456.968280:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789477456.968286:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789477456.968293:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789477456.968314:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789477456.968321:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789477456.968329:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789477456.968336:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789477456.968354:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789477456.968361:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789477456.968367:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789477456.968374:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789477456.968380:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789477456.968386:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789477456.968393:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789477456.968400:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789477456.968407:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789477456.990232:0:5852:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0001: service thread [ffff9d0d585b5000:5852] 1 exiting: rc = 0 00000100:00100000:0.0:1789477456.990418:0:5851:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0000: service thread [ffff9d0d585b5e00:5851] 0 exiting: rc = 1 00000100:00100000:3.0:1789477456.995402:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789477456.995420:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789477456.995427:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789477456.995432:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789477456.995439:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789477456.995444:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789477456.995450:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789477456.995455:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789477456.995461:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789477456.995467:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789477456.995472:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789477456.995478:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789477456.995483:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789477456.995489:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789477456.995518:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789477456.995524:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789477456.995530:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789477456.995536:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789477456.995541:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789477456.995547:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789477456.995552:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789477456.995558:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789477456.995563:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789477456.995568:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789477456.995573:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789477456.996206:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789477456.996217:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789477456.996223:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789477456.996229:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789477456.996235:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789477456.996241:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789477456.996247:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789477456.996253:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789477456.996259:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789477456.996266:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789477456.996271:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789477456.996276:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789477456.996282:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789477456.996288:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789477456.996293:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789477456.996298:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789477456.996303:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789477456.996311:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789477456.996316:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789477456.996321:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789477456.996327:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789477456.996333:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789477456.996370:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789477456.996377:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789477456.996396:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789477456.996403:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789477456.996408:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789477456.996413:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789477456.996418:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789477456.996424:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789477456.996430:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789477456.996435:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789477456.996440:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789477456.996445:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789477456.996450:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789477456.996455:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789477456.996461:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789477456.996465:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789477456.996471:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789477456.998687:0:5854:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0001: service thread [ffff9d0d58155e00:5854] 1 exiting: rc = 0 00000100:00100000:1.0:1789477456.999880:0:5853:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0000: service thread [ffff9d0d58154a00:5853] 0 exiting: rc = 1 00000100:00100000:3.0:1789477457.000034:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789477457.000043:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789477457.000049:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789477457.000054:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789477457.000059:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789477457.000066:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789477457.000071:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789477457.000077:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789477457.000082:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789477457.000088:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789477457.000094:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789477457.000099:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789477457.000105:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789477457.000110:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789477457.000115:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789477457.000130:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789477457.000136:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789477457.000141:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789477457.000147:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789477457.000152:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789477457.000180:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789477457.000186:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789477457.000192:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789477457.000198:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789477457.000203:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789477457.000208:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789477457.000214:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789477457.000220:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789477457.000225:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789477457.000230:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789477457.000236:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789477457.000242:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789477457.000248:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789477457.000254:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789477457.000259:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789477457.000266:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789477457.000271:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789477457.000277:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789477457.000282:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789477457.000289:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789477457.000294:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789477457.000300:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789477457.000305:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789477457.000311:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789477457.000316:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789477457.000321:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789477457.000326:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789477457.000332:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789477457.000338:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789477457.000354:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789477457.000359:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789477457.000364:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789477457.000370:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789477457.000375:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789477457.000380:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789477457.000394:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789477457.000400:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789477457.000405:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789477457.000411:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789477457.000416:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789477457.000422:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789477457.000427:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789477457.000433:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789477457.000438:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789477457.001398:0:5856:0:(service.c:3183:ptlrpc_main()) mdt_fld_0001: service thread [ffff9d0d585b4000:5856] 1 exiting: rc = 0 00000100:00100000:0.0:1789477457.002839:0:5855:0:(service.c:3183:ptlrpc_main()) mdt_fld_0000: service thread [ffff9d0d72bf8600:5855] 0 exiting: rc = 1 00000100:00100000:3.0:1789477457.003370:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789477457.003381:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789477457.003388:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789477457.003394:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789477457.003400:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789477457.003406:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789477457.003413:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789477457.003420:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789477457.003426:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789477457.003432:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789477457.003438:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789477457.003444:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789477457.003449:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789477457.003454:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789477457.003460:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789477457.003466:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789477457.003472:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789477457.003478:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789477457.003484:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789477457.003490:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789477457.003496:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789477457.003501:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789477457.003507:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789477457.003513:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789477457.003518:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789477457.003524:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789477457.003554:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789477457.003558:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789477457.003564:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789477457.003569:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789477457.003574:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789477457.003618:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789477457.003624:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789477457.003629:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789477457.003635:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789477457.003640:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789477457.003646:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789477457.003652:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789477457.003658:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789477457.003664:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789477457.003670:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789477457.003675:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789477457.003681:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789477457.003685:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789477457.003690:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789477457.003695:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789477457.003701:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789477457.003710:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789477457.003717:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789477457.003723:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789477457.003729:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789477457.003734:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789477457.003740:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789477457.003746:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789477457.003751:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789477457.003757:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789477457.003763:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789477457.003768:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789477457.003774:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789477457.003780:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789477457.003785:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789477457.003799:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789477457.003804:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789477457.003810:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789477457.004394:0:5859:0:(service.c:3183:ptlrpc_main()) mdt_io00_001: service thread [ffff9d0d585b4c00:5859] 1 exiting: rc = 0 00000100:00100000:0.0:1789477457.004515:0:5858:0:(service.c:3183:ptlrpc_main()) mdt_io00_000: service thread [ffff9d0d58561400:5858] 0 exiting: rc = 1 00000100:00100000:1.0:1789477457.004649:0:5860:0:(service.c:3183:ptlrpc_main()) mdt_io00_002: service thread [ffff9d0d585b4400:5860] 2 exiting: rc = 0 00000100:00100000:3.0:1789477457.005373:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789477457.005382:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789477457.005393:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789477457.005616:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789477457.005625:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789477457.005633:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789477457.005640:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789477457.005647:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789477457.005653:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789477457.005659:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789477457.005667:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789477457.005673:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789477457.005679:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789477457.005685:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789477457.005691:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789477457.005697:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789477457.005704:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789477457.005709:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789477457.005717:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789477457.005724:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789477457.005730:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789477457.005736:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789477457.005742:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789477457.005749:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789477457.005755:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789477457.005761:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789477457.005767:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789477457.005787:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789477457.005795:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789477457.005801:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789477457.005807:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789477457.005814:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789477457.005831:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789477457.005836:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789477457.005843:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789477457.005849:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789477457.005855:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789477457.005861:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789477457.005868:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789477457.005874:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789477457.005880:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789477457.005887:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789477457.005893:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789477457.005901:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789477457.005907:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789477457.005913:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789477457.005919:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789477457.005924:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789477457.005931:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789477457.005937:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789477457.005943:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789477457.005964:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789477457.005972:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789477457.005979:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789477457.005986:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789477457.005992:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789477457.005999:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789477457.006005:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789477457.006012:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789477457.006020:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789477457.006027:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789477457.006033:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789477457.006040:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789477457.006046:0:12951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:3.0:1789477457.017110:0:12951:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1789477457.017129:0:12951:0:(obd_config.c:883:class_detach()) detach on obd MDS (uuid MDS_uuid) 00000020:00000080:3.0:1789477457.017136:0:12951:0:(genops.c:885:class_export_put()) final put ffff9d0d47225800/MDS_uuid 00000020:00000080:3.0:1789477457.017157:0:12951:0:(genops.c:844:class_export_destroy()) destroying export ffff9d0d47225800/MDS_uuid for MDS 00000020:01000000:3.0:1789477457.017174:0:12951:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MDS (MDS_uuid) 00000020:02000400:3.0:1789477457.017856:0:12951:0:(tgt_mount.c:2184:server_put_super()) server umount lustre-MDT0000 complete 00010000:00010000:1.0:1789477457.584797:0:6710:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789477458.609245:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1789477458.919377:0:6730:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1789477458.919391:0:6730:0:(genops.c:885:class_export_put()) final put ffff9d0d7c0c7800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1789477458.919428:0:1381:0:(genops.c:844:class_export_destroy()) destroying export ffff9d0d7c0c7800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:3.0:1789477458.919474:0:1381:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9d0d7c0c2000 for lustre-OST0000 00010000:00010000:0.0:1789477459.632044:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1789477460.130325:0:13104:0:(tgt_mount.c:2195:server_umount_begin()) umount -f 00000020:01000004:2.0:1789477460.140771:0:13104:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-OST0000 00010000:00010000:2.0:1789477460.140894:0:13104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.123@tcp lock: ffff9d0d41646400/0xafddb3c8f92816b2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xafddb3c8f92816b9 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477460.140909:0:13104:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.123@tcp lock: ffff9d0d41646400/0xafddb3c8f92816b2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xafddb3c8f92816b9 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477460.140916:0:13104:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.123@tcp lock: ffff9d0d41646400/0xafddb3c8f92816b2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0xafddb3c8f92816b9 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477460.140924:0:13104:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.123@tcp lock: ffff9d0d41646400/0xafddb3c8f92816b2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0xafddb3c8f92816b9 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477460.140944:0:13104:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1789477460.140950:0:13104:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:2.0:1789477460.140975:0:13104:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1789477460.140979:0:13104:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:2.0:1789477460.140986:0:13104:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1789477460.140991:0:13104:0:(import.c:65:import_set_state_nolock()) ffff9d0d7fafc000 lustre-MDT0000_UUID: changing import state from DISCONN to CLOSED 00000100:00080000:2.0:1789477460.140996:0:13104:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1789477460.140997:0:13104:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:2.0:1789477460.141013:0:13104:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:1.0:1789477460.142278:0:6710:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789477460.142305:0:6710:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.123@tcp lock: ffff9d0d41646400/0xafddb3c8f92816b2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0xafddb3c8f92816b9 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477460.142316:0:6710:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d0d41646400 already unused, calling callback (ffffffffc1bb3c20) 10000000:00010000:1.0:1789477460.142321:0:6710:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.123@tcp lock: ffff9d0d41646400/0xafddb3c8f92816b2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0xafddb3c8f92816b9 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477460.142331:0:6710:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.123@tcp lock: ffff9d0d41646400/0xafddb3c8f92816b2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1008400000000 nid: local remote: 0xafddb3c8f92816b9 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789477460.142338:0:6710:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.123@tcp lock: ffff9d0d41646400/0xafddb3c8f92816b2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1009400000000 nid: local remote: 0xafddb3c8f92816b9 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789477460.142344:0:6710:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1789477460.142346:0:6710:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:1.0:1789477460.142349:0:6710:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:1.0:1789477460.142396:0:6710:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.123@tcp lock: ffff9d0d41646400/0xafddb3c8f92816b2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0xafddb3c8f92816b9 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477460.142413:0:6710:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789477460.142451:0:6710:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.123@tcp lock: ffff9d0d41646400/0xafddb3c8f92816b2 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0xafddb3c8f92816b9 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477460.142459:0:6710:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.123@tcp lock: ffff9d0d41646400/0xafddb3c8f92816b2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0xafddb3c8f92816b9 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477460.142472:0:6710:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789477460.142474:0:6710:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789477460.142476:0:6710:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789477460.142571:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789477460.142616:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d7f700700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:07d5e05c-913f-419f-adbc-d3cf15e9cd51:3313:1876402802609280:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789477460.142698:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789477460.142820:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802609280 00000100:00100000:1.0:1789477460.142829:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802609280 00000100:00100000:1.0:1789477460.142868:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1789477460.142876:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d58070a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0+-99:3313:x1876402802609280:12345-0@lo:103:ldlm_bl.0 00010000:00020000:1.0:1789477460.142882:0:5831:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1789477460 with bad export cookie 12672482602245428109 00010000:00010000:2.0:1789477460.142938:0:13104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.123@tcp lock: ffff9d0d59d6ba00/0xafddb3c8f92816c0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xafddb3c8f92816c7 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477460.142948:0:13104:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.123@tcp lock: ffff9d0d59d6ba00/0xafddb3c8f92816c0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xafddb3c8f92816c7 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477460.142954:0:13104:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.123@tcp lock: ffff9d0d59d6ba00/0xafddb3c8f92816c0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xafddb3c8f92816c7 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477460.142960:0:13104:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.123@tcp lock: ffff9d0d59d6ba00/0xafddb3c8f92816c0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xafddb3c8f92816c7 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477460.143013:0:13104:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789477460.143021:0:13104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.123@tcp lock: ffff9d0d50be4e00/0xafddb3c8f92818db lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xafddb3c8f92818e2 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477460.143028:0:13104:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.123@tcp lock: ffff9d0d50be4e00/0xafddb3c8f92818db lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xafddb3c8f92818e2 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477460.143034:0:13104:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.123@tcp lock: ffff9d0d50be4e00/0xafddb3c8f92818db lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xafddb3c8f92818e2 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477460.143040:0:13104:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.123@tcp lock: ffff9d0d50be4e00/0xafddb3c8f92818db lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xafddb3c8f92818e2 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477460.143068:0:5833:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789477460.143073:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.123@tcp lock: ffff9d0d59d6ba00/0xafddb3c8f92816c0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xafddb3c8f92816c7 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477460.143080:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d0d59d6ba00 already unused, calling callback (ffffffffc1bb3c20) 10000000:00010000:0.0:1789477460.143084:0:5833:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.123@tcp lock: ffff9d0d59d6ba00/0xafddb3c8f92816c0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xafddb3c8f92816c7 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477460.143092:0:5833:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.123@tcp lock: ffff9d0d59d6ba00/0xafddb3c8f92816c0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0xafddb3c8f92816c7 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789477460.143099:0:5833:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.123@tcp lock: ffff9d0d59d6ba00/0xafddb3c8f92816c0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0xafddb3c8f92816c7 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789477460.143106:0:5833:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1789477460.143108:0:5833:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0000: stopping, won't requeue 00010000:00010000:0.0:1789477460.143125:0:5833:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.123@tcp lock: ffff9d0d59d6ba00/0xafddb3c8f92816c0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0xafddb3c8f92816c7 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477460.143131:0:5833:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789477460.143152:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.123@tcp lock: ffff9d0d59d6ba00/0xafddb3c8f92816c0 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0xafddb3c8f92816c7 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477460.143158:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.123@tcp lock: ffff9d0d59d6ba00/0xafddb3c8f92816c0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0xafddb3c8f92816c7 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477460.143178:0:5833:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789477460.143182:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.123@tcp lock: ffff9d0d50be4e00/0xafddb3c8f92818db lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xafddb3c8f92818e2 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477460.143188:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d0d50be4e00 already unused, calling callback (ffffffffc1bb3c20) 10000000:00010000:0.0:1789477460.143191:0:5833:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.123@tcp lock: ffff9d0d50be4e00/0xafddb3c8f92818db lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xafddb3c8f92818e2 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477460.143197:0:5833:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.123@tcp lock: ffff9d0d50be4e00/0xafddb3c8f92818db lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xafddb3c8f92818e2 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789477460.143212:0:5833:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.123@tcp lock: ffff9d0d50be4e00/0xafddb3c8f92818db lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xafddb3c8f92818e2 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789477460.143218:0:5833:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:0.0:1789477460.143220:0:5833:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 00010000:00010000:0.0:1789477460.143232:0:5833:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.123@tcp lock: ffff9d0d50be4e00/0xafddb3c8f92818db lrc: 3/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xafddb3c8f92818e2 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477460.143237:0:5833:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789477460.143256:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.123@tcp lock: ffff9d0d50be4e00/0xafddb3c8f92818db lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xafddb3c8f92818e2 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477460.143262:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789477460.143264:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789477460.143266:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789477460.143273:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789477460.143292:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d6d480e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:07d5e05c-913f-419f-adbc-d3cf15e9cd51:3311:1876402802609536:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789477460.143326:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789477460.143362:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802609536 00000100:00100000:0.0:1789477460.143366:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802609536 00000100:00100000:3.0:1789477460.143374:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d6d480a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:07d5e05c-913f-419f-adbc-d3cf15e9cd51:3313:1876402802609408:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789477460.143389:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1789477460.143394:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d6d482680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0+-99:3311:x1876402802609536:12345-0@lo:103:ldlm_bl.0 00010000:00020000:0.0:1789477460.143398:0:5830:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1789477460 with bad export cookie 12672482602245428109 00000100:00100000:3.0:1789477460.143401:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789477460.143425:0:5829:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 4 min 3 max 56 00000100:00100000:3.0:1789477460.143433:0:5829:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_004' 00000100:00100000:0.0:1789477460.143765:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d6d482680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0+-99:3311:x1876402802609536:12345-0@lo:103:ldlm_bl.0 Request processed in 367us (436us total) trans 0 rc -107/-107 00000100:00100000:0.0:1789477460.143772:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1789477460.143798:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802609408 00000100:00100000:0.0:1789477460.143801:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802609408 00000100:00080000:3.0:1789477460.143802:0:3311:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.201.123@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:3.0:1789477460.143808:0:3311:0:(import.c:65:import_set_state_nolock()) ffff9d0d44512000 MGS: changing import state from FULL to DISCONN 00000100:02020000:3.0:1789477460.143812:0:3311:0:(import.c:186:ptlrpc_set_import_discon()) MGC192.168.201.123@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail 00000100:00100000:0.0:1789477460.143813:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1789477460.143818:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d50a82050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0+-99:3313:x1876402802609408:12345-0@lo:103:ldlm_bl.0 00010000:00020000:0.0:1789477460.143821:0:5830:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1789477460 with bad export cookie 12672482602245428109 00000100:00100000:0.0:1789477460.143858:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d50a82050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0+-99:3313:x1876402802609408:12345-0@lo:103:ldlm_bl.0 Request processed in 38us (454us total) trans 0 rc -107/-107 00000100:00100000:0.0:1789477460.143864:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00080000:0.0:1789477460.143892:0:3313:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.201.123@tcp of MGS@0@lo abruptly disconnected: reconnecting 00010000:00010000:2.0:1789477460.144070:0:13104:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1789477460.144076:0:13104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.123@tcp lock: ffff9d0d50be4e00/0xafddb3c8f92818db lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xafddb3c8f92818e2 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789477460.144089:0:13104:0:(mgc_request.c:130:config_log_put()) dropping config log params 10000000:01000000:2.0:1789477460.144100:0:13104:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0000 10000000:01000000:2.0:1789477460.144102:0:13104:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0000 (0) 00000020:01000004:2.0:1789477460.144127:0:13104:0:(tgt_mount.c:2115:server_put_super()) stopping lustre-OST0000 00000020:01000000:2.0:1789477460.144131:0:13104:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000 (flags='F') 00000020:00000080:2.0:1789477460.144188:0:13104:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1789477460.144195:0:13104:0:(obd_config.c:956:class_cleanup()) lustre-OST0000: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1789477460.144261:0:13104:0:(genops.c:1558:class_disconnect_exports()) OBD device 12 (ffff9d0d5847b370) has no exports 00000020:00080000:2.0:1789477460.144296:0:13104:0:(genops.c:1558:class_disconnect_exports()) OBD device 12 (ffff9d0d5847b370) has no exports 00000020:01000000:2.0:1789477460.146478:0:13104:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9d0d517f5ea0 - data ffff9d0d68731000/ffff9d0d7fab6400 00000020:01000000:2.0:1789477460.146664:0:13104:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9d0d4ef776c0 - data ffff9d0d6841f5e8/ffff9d0d7f7f9400 00000100:00100000:1.0:1789477460.162889:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d58070a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0+-99:3313:x1876402802609280:12345-0@lo:103:ldlm_bl.0 Request processed in 20004us (20183us total) trans 0 rc -107/-107 00000100:00100000:1.0:1789477460.162904:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00010000:00010000:1.0:1789477460.166167:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1789477460.184964:0:3311:0:(import.c:192:ptlrpc_set_import_discon()) import MGS@0@lo for MGC192.168.201.123@tcp not replayable, auto-deactivating 00000100:00080000:3.0:1789477460.184970:0:3311:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:3.0:1789477460.184979:0:3311:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9d0d7f700700 x1876402802609280/t0(0) o103->MGC192.168.201.123@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1789477476 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789477460.184994:0:3311:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9d0d6d480e00 x1876402802609536/t0(0) o103->MGC192.168.201.123@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1789477476 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789477460.185002:0:3311:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9d0d6d480a80 x1876402802609408/t0(0) o103->MGC192.168.201.123@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1789477476 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1789477460.185014:0:3313:0:(import.c:214:ptlrpc_set_import_discon()) mgc: import ffff9d0d44512000 already not connected (conn 1, was 1): DISCONN 10000000:01000000:3.0:1789477460.185015:0:3311:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:3.0:1789477460.185018:0:3311:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:3.0:1789477460.185019:0:3311:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:3.0:1789477460.185023:0:3311:0:(import.c:65:import_set_state_nolock()) ffff9d0d44512000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1789477460.185045:0:3311:0:(import.c:510:import_select_connection()) MGC192.168.201.123@tcp: connect to NID 0@lo last attempt 170 00000100:00080000:3.0:1789477460.185061:0:3311:0:(import.c:625:import_select_connection()) MGC192.168.201.123@tcp: import ffff9d0d44512000 using connection 192.168.201.123@tcp/0@lo 00000100:00100000:3.0:1789477460.185093:0:3311:0:(import.c:827:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9d0d58071f80 x1876402802609664/t0(0) o250->MGC192.168.201.123@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1789477460.185135:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d6d480e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:07d5e05c-913f-419f-adbc-d3cf15e9cd51:3311:1876402802609536:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789477460.185240:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d58071f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:07d5e05c-913f-419f-adbc-d3cf15e9cd51:3309:1876402802609664:0@lo:250:ptlrpcd_00_01.0 00000100:00100000:1.0:1789477460.185477:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d7f700700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:07d5e05c-913f-419f-adbc-d3cf15e9cd51:3313:1876402802609280:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789477460.185494:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d6d480a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:07d5e05c-913f-419f-adbc-d3cf15e9cd51:3313:1876402802609408:0@lo:103:ldlm_bl.0 00000400:00000100:2.0:1789477460.188955:0:3309:0:(lib-move.c:4383:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1876402802609664 offset 0 length 520: 4 00100000:10000000:2.0:1789477460.197771:0:13104:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0000-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:2.0:1789477460.233236:0:13104:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xafddb3c8f92814f2 00000020:00000080:2.0:1789477460.233247:0:13104:0:(genops.c:885:class_export_put()) final put ffff9d0d7f837800/lustre-OST0000-osd_UUID 00000020:01000004:2.0:1789477460.233267:0:13104:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9d0d585fc800 from lustre-OST0000, refs=2 00000020:01000004:2.0:1789477460.233269:0:13104:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9d0d585fc800 2 00000020:01000004:2.0:1789477460.233272:0:13104:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9d0d585fc800 from lustre-OST0000 00000020:00000080:2.0:1789477460.233308:0:13104:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1789477460.233320:0:13104:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:00000080:2.0:1789477460.233323:0:13104:0:(genops.c:885:class_export_put()) final put ffff9d0d6ec4d000/lustre-OST0000_UUID 00000020:00000080:2.0:1789477460.233326:0:13104:0:(genops.c:844:class_export_destroy()) destroying export ffff9d0d6ec4d000/lustre-OST0000_UUID for lustre-OST0000 00000020:01000000:2.0:1789477460.233333:0:13104:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000 (lustre-OST0000_UUID) 00000020:01000004:2.0:1789477460.233383:0:13104:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 1 references. 00000020:01000000:2.0:1789477460.233389:0:13104:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0000 (flags='F') 00000020:00000080:2.0:1789477460.233393:0:13104:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1789477460.233398:0:13104:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1789477460.233406:0:13104:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-OST0000: ACTIVE ffff9d0d7fafb800 lustre-MDT0000-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1789477460.233413:0:13104:0:(genops.c:1553:class_disconnect_exports()) OBD device 13 (ffff9d0d50b80000) has exports, disconnecting them 00000020:00080000:2.0:1789477460.233419:0:13104:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0000: disconnecting export at 0@lo (ffff9d0d7fafb800), last request at 1789477243 00000020:00000080:2.0:1789477460.233435:0:13104:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xafddb3c8f928152a 00000020:00080000:2.0:1789477460.233447:0:13104:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9d0d7fafb800): rc 0 00000020:00000080:2.0:1789477460.233451:0:13104:0:(genops.c:885:class_export_put()) final put ffff9d0d7fafb800/lustre-MDT0000-lwp-OST0000 00010000:01000000:2.0:1789477460.234030:0:13104:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0000: client import never connected 00000100:00080000:2.0:1789477460.234036:0:13104:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1789477460.234039:0:13104:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:2.0:1789477460.234045:0:13104:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1789477460.234161:0:13104:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1789477460.234166:0:13104:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000020:01000004:2.0:1789477460.234170:0:13104:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9d0d585fc800 1 00000020:00000080:2.0:1789477460.234175:0:13104:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xafddb3c8f928146d 00000020:00000080:2.0:1789477460.234179:0:13104:0:(genops.c:885:class_export_put()) final put ffff9d0d7b179800/lustre-OST0000-osd_UUID 00000020:01000000:2.0:1789477460.234183:0:13104:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osd (flags='') 00000020:00000080:2.0:1789477460.234187:0:13104:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1789477460.234189:0:13104:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osd: forcing exports to disconnect: 0/3 00000020:00080000:2.0:1789477460.234191:0:13104:0:(genops.c:1558:class_disconnect_exports()) OBD device 9 (ffff9d0d76164d28) has no exports 00000020:00000080:3.0:1789477460.234319:0:1381:0:(genops.c:844:class_export_destroy()) destroying export ffff9d0d7f837800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:3.0:1789477460.234334:0:1381:0:(genops.c:844:class_export_destroy()) destroying export ffff9d0d7fafb800/lustre-MDT0000-lwp-OST0000 for lustre-MDT0000-lwp-OST0000 00000020:00000080:3.0:1789477460.234347:0:1381:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9d0d7fafc000 for lustre-MDT0000-lwp-OST0000 00000020:00000080:3.0:1789477460.234353:0:1381:0:(genops.c:885:class_export_put()) final put ffff9d0d7f78f000/lustre-MDT0000-lwp-OST0000_UUID 00000020:00000080:3.0:1789477460.234355:0:1381:0:(genops.c:844:class_export_destroy()) destroying export ffff9d0d7f78f000/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000-lwp-OST0000 00000020:01000000:3.0:1789477460.234359:0:1381:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0000 (lustre-MDT0000-lwp-OST0000_UUID) 00000020:00000080:3.0:1789477460.234401:0:1381:0:(genops.c:844:class_export_destroy()) destroying export ffff9d0d7b179800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:3.0:1789477460.258049:0:13104:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1789477460.258066:0:13104:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00000020:00000080:3.0:1789477460.258073:0:13104:0:(genops.c:885:class_export_put()) final put ffff9d0d585fc000/lustre-OST0000-osd_UUID 00000020:00000080:3.0:1789477460.258079:0:13104:0:(genops.c:844:class_export_destroy()) destroying export ffff9d0d585fc000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:01000000:3.0:1789477460.258091:0:13104:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osd (lustre-OST0000-osd_UUID) 00000020:01000004:3.0:1789477460.258258:0:13104:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff9d0d585f9800 00000020:02000400:3.0:1789477460.258322:0:13104:0:(tgt_mount.c:2184:server_put_super()) server umount lustre-OST0000 complete 00010000:00010000:1.0:1789477460.656263:0:6710:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1789477460.911880:0:1381:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1789477460.911894:0:1381:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1789477460.911900:0:1381:0:(import.c:65:import_set_state_nolock()) ffff9d0d75358800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1789477460.911910:0:1381:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 400 00000100:00080000:3.0:1789477460.911918:0:1381:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1789477460.911934:0:1381:0:(import.c:625:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9d0d75358800 using connection 192.168.201.123@tcp/0@lo 00000100:00100000:3.0:1789477460.911985:0:1381:0:(import.c:827:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9d0d58072a00 x1876402802609792/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1789477460.912154:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d58072a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3309:1876402802609792:0@lo:38:kworker.0 00000400:00000100:2.0:1789477460.912219:0:3309:0:(lib-move.c:4383:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876402802609792 offset 0 length 520: 4 00010000:00010000:1.0:1789477461.679772:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789477462.703790:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1789477462.860545:0:13255:0:(tgt_mount.c:2195:server_umount_begin()) umount -f 00000020:01000004:1.0:1789477462.877995:0:13255:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-OST0001 00010000:00010000:1.0:1789477462.878072:0:13255:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.123@tcp lock: ffff9d0d82151000/0xafddb3c8f9281696 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xafddb3c8f928169d expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477462.878097:0:13255:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.123@tcp lock: ffff9d0d82151000/0xafddb3c8f9281696 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xafddb3c8f928169d expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477462.878105:0:13255:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.123@tcp lock: ffff9d0d82151000/0xafddb3c8f9281696 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xafddb3c8f928169d expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477462.878112:0:13255:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.123@tcp lock: ffff9d0d82151000/0xafddb3c8f9281696 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xafddb3c8f928169d expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477462.878134:0:13255:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1789477462.878140:0:13255:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:1.0:1789477462.878163:0:13255:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1789477462.878176:0:13255:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9d0d58072a00 x1876402802609792/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1789477475 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789477462.878251:0:13255:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00080000:1.0:1789477462.878258:0:13255:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1789477462.878264:0:13255:0:(import.c:65:import_set_state_nolock()) ffff9d0d75358800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00080000:1.0:1789477462.878269:0:13255:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1789477462.878273:0:13255:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9d0d58072a00 x1876402802609792/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1789477475 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00010000:00010000:3.0:1789477462.878352:0:6710:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789477462.878359:0:6710:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.123@tcp lock: ffff9d0d82151000/0xafddb3c8f9281696 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xafddb3c8f928169d expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477462.878367:0:6710:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d0d82151000 already unused, calling callback (ffffffffc1bb3c20) 10000000:00010000:3.0:1789477462.878371:0:6710:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.123@tcp lock: ffff9d0d82151000/0xafddb3c8f9281696 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xafddb3c8f928169d expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477462.878381:0:6710:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.123@tcp lock: ffff9d0d82151000/0xafddb3c8f9281696 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xafddb3c8f928169d expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789477462.878389:0:6710:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.123@tcp lock: ffff9d0d82151000/0xafddb3c8f9281696 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xafddb3c8f928169d expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789477462.878394:0:6710:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1789477462.878397:0:6710:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:3.0:1789477462.878399:0:6710:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:3.0:1789477462.878414:0:6710:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9d0d44512000 00010000:00010000:3.0:1789477462.878418:0:6710:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.123@tcp lock: ffff9d0d82151000/0xafddb3c8f9281696 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xafddb3c8f928169d expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477462.878425:0:6710:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.123@tcp lock: ffff9d0d82151000/0xafddb3c8f9281696 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xafddb3c8f928169d expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477462.878436:0:6710:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789477462.878438:0:6710:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789477462.878440:0:6710:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789477462.882186:0:13255:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:2.0:1789477462.885465:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d58072a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3309:1876402802609792:0@lo:38:kworker.0 00000100:00100000:1.0:1789477462.885645:0:13255:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:1.0:1789477462.887171:0:13255:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.123@tcp lock: ffff9d0d41646200/0xafddb3c8f92816a4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xafddb3c8f92816ab expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477462.887191:0:13255:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.123@tcp lock: ffff9d0d41646200/0xafddb3c8f92816a4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xafddb3c8f92816ab expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477462.887218:0:13255:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.123@tcp lock: ffff9d0d41646200/0xafddb3c8f92816a4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xafddb3c8f92816ab expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477462.887225:0:13255:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.123@tcp lock: ffff9d0d41646200/0xafddb3c8f92816a4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xafddb3c8f92816ab expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477462.887259:0:13255:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789477462.887268:0:13255:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.123@tcp lock: ffff9d0d50be5400/0xafddb3c8f92818cd lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xafddb3c8f92818d4 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477462.887276:0:13255:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.123@tcp lock: ffff9d0d50be5400/0xafddb3c8f92818cd lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xafddb3c8f92818d4 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477462.887282:0:13255:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.123@tcp lock: ffff9d0d50be5400/0xafddb3c8f92818cd lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xafddb3c8f92818d4 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477462.887288:0:13255:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.123@tcp lock: ffff9d0d50be5400/0xafddb3c8f92818cd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xafddb3c8f92818d4 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477462.887425:0:13255:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:1.0:1789477462.887431:0:13255:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0001 (0) 00000020:01000004:1.0:1789477462.887457:0:13255:0:(tgt_mount.c:2115:server_put_super()) stopping lustre-OST0001 00000020:01000000:1.0:1789477462.887462:0:13255:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001 (flags='F') 00000020:00000080:1.0:1789477462.887468:0:13255:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1789477462.887475:0:13255:0:(obd_config.c:956:class_cleanup()) lustre-OST0001: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1789477462.887486:0:13255:0:(genops.c:1558:class_disconnect_exports()) OBD device 15 (ffff9d0d584799b8) has no exports 00000020:00080000:1.0:1789477462.887511:0:13255:0:(genops.c:1558:class_disconnect_exports()) OBD device 15 (ffff9d0d584799b8) has no exports 00000020:01000000:1.0:1789477462.889521:0:13255:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9d0d58710780 - data ffff9d0d7fdcaaf8/ffff9d0d7f5b3800 00000020:01000000:1.0:1789477462.890199:0:13255:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9d0d517f5360 - data ffff9d0d68799798/ffff9d0d75351c00 00010000:00010000:2.0:1789477462.890450:0:5832:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789477462.890461:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.123@tcp lock: ffff9d0d41646200/0xafddb3c8f92816a4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xafddb3c8f92816ab expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477462.890473:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d0d41646200 already unused, calling callback (ffffffffc1bb3c20) 10000000:00010000:2.0:1789477462.890478:0:5832:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.123@tcp lock: ffff9d0d41646200/0xafddb3c8f92816a4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xafddb3c8f92816ab expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477462.890488:0:5832:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.123@tcp lock: ffff9d0d41646200/0xafddb3c8f92816a4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xafddb3c8f92816ab expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789477462.890506:0:5832:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.123@tcp lock: ffff9d0d41646200/0xafddb3c8f92816a4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xafddb3c8f92816ab expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789477462.890513:0:5832:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1789477462.890516:0:5832:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0001: stopping, won't requeue 10000000:01000000:2.0:1789477462.890518:0:5832:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0001 00010000:00010000:2.0:1789477462.890536:0:5832:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9d0d44512000 00010000:00010000:2.0:1789477462.890541:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.123@tcp lock: ffff9d0d41646200/0xafddb3c8f92816a4 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xafddb3c8f92816ab expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477462.890548:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.123@tcp lock: ffff9d0d41646200/0xafddb3c8f92816a4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xafddb3c8f92816ab expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477462.890560:0:5832:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789477462.890564:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.123@tcp lock: ffff9d0d50be5400/0xafddb3c8f92818cd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xafddb3c8f92818d4 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477462.890570:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d0d50be5400 already unused, calling callback (ffffffffc1bb3c20) 10000000:00010000:2.0:1789477462.890573:0:5832:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.123@tcp lock: ffff9d0d50be5400/0xafddb3c8f92818cd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xafddb3c8f92818d4 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477462.890594:0:5832:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.123@tcp lock: ffff9d0d50be5400/0xafddb3c8f92818cd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0xafddb3c8f92818d4 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789477462.890600:0:5832:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.123@tcp lock: ffff9d0d50be5400/0xafddb3c8f92818cd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0xafddb3c8f92818d4 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789477462.890605:0:5832:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:2.0:1789477462.890607:0:5832:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:2.0:1789477462.890614:0:5832:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:2.0:1789477462.890621:0:5832:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9d0d44512000 00010000:00010000:2.0:1789477462.890624:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.123@tcp lock: ffff9d0d50be5400/0xafddb3c8f92818cd lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0xafddb3c8f92818d4 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477462.890630:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.123@tcp lock: ffff9d0d50be5400/0xafddb3c8f92818cd lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0xafddb3c8f92818d4 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477462.890643:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789477462.890645:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789477462.890648:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789477462.895767:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00100000:10000000:1.0:1789477462.911642:0:13255:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0001-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:2.0:1789477462.947005:0:13255:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xafddb3c8f928158c 00000020:00000080:2.0:1789477462.947030:0:13255:0:(genops.c:885:class_export_put()) final put ffff9d0d7535f800/lustre-OST0001-osd_UUID 00000020:01000004:2.0:1789477462.947084:0:13255:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9d0d514ce000 from lustre-OST0001, refs=2 00000020:01000004:2.0:1789477462.947089:0:13255:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9d0d514ce000 2 00000020:01000004:2.0:1789477462.947093:0:13255:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9d0d514ce000 from lustre-OST0001 00000020:00000080:2.0:1789477462.947117:0:13255:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1789477462.947139:0:13255:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:00000080:2.0:1789477462.947143:0:13255:0:(genops.c:885:class_export_put()) final put ffff9d0d7535c000/lustre-OST0001_UUID 00000020:00000080:2.0:1789477462.947145:0:13255:0:(genops.c:844:class_export_destroy()) destroying export ffff9d0d7535c000/lustre-OST0001_UUID for lustre-OST0001 00000020:01000000:2.0:1789477462.947152:0:13255:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001 (lustre-OST0001_UUID) 00000100:00080000:2.0:1789477462.947295:0:13255:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import 07d5e05c-913f-419f-adbc-d3cf15e9cd51->MGS 00010000:00010000:2.0:1789477462.947311:0:13255:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.123@tcp lock: ffff9d0d49ecb000/0xafddb3c8f92814c1 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xafddb3c8f92814c8 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789477462.947323:0:13255:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.123@tcp lock: ffff9d0d49ecb000/0xafddb3c8f92814c1 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xafddb3c8f92814c8 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789477462.947393:0:13255:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 10000000:01000000:2.0:1789477462.947396:0:13255:0:(mgc_request.c:954:mgc_blocking_ast()) log nodemap: disconnecting, won't requeue 10000000:01000000:2.0:1789477462.947399:0:13255:0:(mgc_request.c:130:config_log_put()) dropping config log nodemap 00010000:00010000:2.0:1789477462.947416:0:13255:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9d0d44512000 00010000:00010000:2.0:1789477462.947543:0:13255:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.123@tcp lock: ffff9d0d49ecb000/0xafddb3c8f92814c1 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xafddb3c8f92814c8 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477462.947635:0:13255:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.123@tcp lock: ffff9d0d49ecb600/0xafddb3c8f92816ea lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xafddb3c8f92816f1 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789477462.947708:0:13255:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.123@tcp lock: ffff9d0d49ecb600/0xafddb3c8f92816ea lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xafddb3c8f92816f1 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789477462.947715:0:13255:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1789477462.947717:0:13255:0:(mgc_request.c:954:mgc_blocking_ast()) log lustre-s: disconnecting, won't requeue 10000000:01000000:2.0:1789477462.947719:0:13255:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-sptlrpc 00010000:00010000:2.0:1789477462.947731:0:13255:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9d0d44512000 00010000:00010000:2.0:1789477462.947734:0:13255:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.123@tcp lock: ffff9d0d49ecb600/0xafddb3c8f92816ea lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xafddb3c8f92816f1 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1789477462.947751:0:13255:0:(import.c:65:import_set_state_nolock()) ffff9d0d44512000 MGS: changing import state from CONNECTING to CLOSED 10000000:01000000:2.0:1789477462.947755:0:13255:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:2.0:1789477462.947757:0:13255:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:2.0:1789477462.947759:0:13255:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:2.0:1789477462.947762:0:13255:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:2.0:1789477462.947776:0:13255:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9d0d58071f80 x1876402802609664/t0(0) o250->MGC192.168.201.123@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 1789477470 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'ptlrpcd_00_01.0' uid:0 gid:0 projid:4294967295 10000000:01000000:2.0:1789477462.947944:0:13255:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:2.0:1789477462.947947:0:13255:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 10s for inflight to error out 00000020:00000080:3.0:1789477462.948021:0:1381:0:(genops.c:844:class_export_destroy()) destroying export ffff9d0d7535f800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000100:00100000:0.0:1789477462.948113:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d58071f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:07d5e05c-913f-419f-adbc-d3cf15e9cd51:3309:1876402802609664:0@lo:250:ptlrpcd_00_01.0 10000000:01000000:2.0:1789477462.948253:0:13255:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:2.0:1789477462.948260:0:13255:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xafddb3c8f928137f 00000020:00000080:2.0:1789477462.948266:0:13255:0:(genops.c:885:class_export_put()) final put ffff9d0d46d60800/07d5e05c-913f-419f-adbc-d3cf15e9cd51 00000020:01000000:2.0:1789477462.948281:0:13255:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGC192.168.201.123@tcp (flags='') 00000020:00000080:2.0:1789477462.948286:0:13255:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1789477462.948291:0:13255:0:(obd_config.c:956:class_cleanup()) MGC192.168.201.123@tcp: forcing exports to disconnect: 0/3 00000020:00080000:2.0:1789477462.948295:0:13255:0:(genops.c:1558:class_disconnect_exports()) OBD device 2 (ffff9d0d482499b8) has no exports 10000000:01000000:2.0:1789477462.948318:0:5841:0:(mgc_request.c:708:mgc_requeue_thread()) Ending requeue thread 10000000:01000000:2.0:1789477462.948413:0:13255:0:(obd_class.h:670:obd_cleanup_client_import()) MGC192.168.201.123@tcp: client import never connected 00000100:00080000:2.0:1789477462.948416:0:13255:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 10000000:01000000:2.0:1789477462.948418:0:13255:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:2.0:1789477462.948420:0:13255:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 10000000:01000000:2.0:1789477462.948432:0:13255:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:2.0:1789477462.948465:0:13255:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1789477462.948470:0:13255:0:(obd_config.c:883:class_detach()) detach on obd MGC192.168.201.123@tcp (uuid 07d5e05c-913f-419f-adbc-d3cf15e9cd51) 00000020:01000000:2.0:1789477462.948484:0:13255:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0001 (flags='F') 00000020:00000080:2.0:1789477462.948488:0:13255:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1789477462.948491:0:13255:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1789477462.948497:0:13255:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-OST0001: ACTIVE ffff9d0d505a6800 lustre-MDT0000-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1789477462.948502:0:13255:0:(genops.c:1553:class_disconnect_exports()) OBD device 16 (ffff9d0d7c0719b8) has exports, disconnecting them 00000020:00080000:2.0:1789477462.948506:0:13255:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0001: disconnecting export at 0@lo (ffff9d0d505a6800), last request at 1789477263 00000020:00000080:2.0:1789477462.948510:0:13255:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xafddb3c8f92815b6 00000020:00080000:2.0:1789477462.948520:0:13255:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9d0d505a6800): rc 0 00000020:00000080:2.0:1789477462.948524:0:13255:0:(genops.c:885:class_export_put()) final put ffff9d0d505a6800/lustre-MDT0000-lwp-OST0001 00000020:00000080:3.0:1789477462.948812:0:1381:0:(genops.c:844:class_export_destroy()) destroying export ffff9d0d46d60800/07d5e05c-913f-419f-adbc-d3cf15e9cd51 for MGC192.168.201.123@tcp 00000020:00000080:3.0:1789477462.948831:0:1381:0:(genops.c:844:class_export_destroy()) destroying export ffff9d0d505a6800/lustre-MDT0000-lwp-OST0001 for lustre-MDT0000-lwp-OST0001 00010000:01000000:3.0:1789477462.949690:0:13255:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0001: client import never connected 00000100:00080000:3.0:1789477462.949696:0:13255:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1789477462.949699:0:13255:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:3.0:1789477462.949706:0:13255:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1789477462.949726:0:1381:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9d0d75358800 for lustre-MDT0000-lwp-OST0001 00000020:00000080:3.0:1789477462.950040:0:13255:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1789477462.950048:0:13255:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000020:00000080:3.0:1789477462.950052:0:13255:0:(genops.c:885:class_export_put()) final put ffff9d0d7535d000/lustre-MDT0000-lwp-OST0001_UUID 00000020:00000080:3.0:1789477462.950055:0:13255:0:(genops.c:844:class_export_destroy()) destroying export ffff9d0d7535d000/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000-lwp-OST0001 00000020:01000000:3.0:1789477462.950064:0:13255:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0001 (lustre-MDT0000-lwp-OST0001_UUID) 00000020:01000004:3.0:1789477462.950112:0:13255:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9d0d514ce000 1 00000020:00000080:3.0:1789477462.950118:0:13255:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xafddb3c8f928155b 00000020:00000080:3.0:1789477462.950123:0:13255:0:(genops.c:885:class_export_put()) final put ffff9d0d7f834800/lustre-OST0001-osd_UUID 00000020:01000000:3.0:1789477462.950131:0:13255:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osd (flags='') 00000020:00000080:3.0:1789477462.950139:0:1381:0:(genops.c:844:class_export_destroy()) destroying export ffff9d0d7f834800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:00000080:3.0:1789477462.950148:0:13255:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1789477462.950152:0:13255:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osd: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1789477462.950155:0:13255:0:(genops.c:1558:class_disconnect_exports()) OBD device 14 (ffff9d0d75440000) has no exports 00000020:00000080:3.0:1789477462.951389:0:1381:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9d0d44512000 for MGC192.168.201.123@tcp 00000020:00000080:3.0:1789477462.951399:0:1381:0:(genops.c:885:class_export_put()) final put ffff9d0d47227000/07d5e05c-913f-419f-adbc-d3cf15e9cd51 00000020:00000080:3.0:1789477462.951402:0:1381:0:(genops.c:844:class_export_destroy()) destroying export ffff9d0d47227000/07d5e05c-913f-419f-adbc-d3cf15e9cd51 for MGC192.168.201.123@tcp 00000020:01000000:3.0:1789477462.951407:0:1381:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGC192.168.201.123@tcp (07d5e05c-913f-419f-adbc-d3cf15e9cd51) 00010000:00010000:0.0:1789477462.952726:0:6710:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-1 blwis in pool) 00010000:00010000:0.0:1789477462.953279:0:5832:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-2 blwis in pool) 00010000:00010000:0.0:1789477462.954041:0:5833:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-3 blwis in pool) 00000100:00100000:3.0:1789477462.954212:0:5828:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_001: service thread [ffff9d0d5395f400:5828] 1 exiting: rc = 0 00000100:00100000:0.0:1789477462.954416:0:5827:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_000: service thread [ffff9d0d58150c00:5827] 0 exiting: rc = 1 00000100:00100000:3.0:1789477462.954751:0:1381:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789477462.955017:0:5830:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_001: service thread [ffff9d0d44403600:5830] 1 exiting: rc = 0 00000100:00100000:0.0:1789477462.955084:0:6711:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_003: service thread [ffff9d0d75414600:6711] 3 exiting: rc = 0 00000100:00100000:3.0:1789477462.955968:0:5829:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_000: service thread [ffff9d0d5395f800:5829] 0 exiting: rc = 1 00000100:00100000:0.0:1789477462.956722:0:5831:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_002: service thread [ffff9d0d515ea400:5831] 2 exiting: rc = 0 00000100:00100000:3.0:1789477462.958816:0:13105:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_004: service thread [ffff9d0c4347b800:13105] 4 exiting: rc = 0 00000100:00100000:0.0:1789477462.959066:0:1381:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789477462.959088:0:1381:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789477462.959095:0:1381:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789477462.959102:0:1381:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789477462.959111:0:1381:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789477462.959117:0:1381:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789477462.959123:0:1381:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789477462.959128:0:1381:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789477462.959135:0:1381:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789477462.959140:0:1381:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789477462.959147:0:1381:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789477462.959153:0:1381:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789477462.959161:0:1381:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789477462.959167:0:1381:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789477462.959175:0:1381:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789477462.959181:0:1381:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789477462.959188:0:1381:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789477462.959195:0:1381:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789477462.959201:0:1381:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789477462.959207:0:1381:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789477462.959213:0:1381:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789477462.959220:0:1381:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789477462.959225:0:1381:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789477462.959242:0:1381:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789477462.959250:0:1381:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789477462.959256:0:1381:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789477462.959262:0:1381:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789477462.959268:0:1381:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789477462.959275:0:1381:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789477462.959281:0:1381:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789477462.959287:0:1381:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789477462.959292:0:1381:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789477462.959309:0:1381:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789477462.959316:0:1381:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789477462.959323:0:1381:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789477462.959328:0:1381:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789477462.959547:0:1381:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789477462.959553:0:1381:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789477462.959865:0:1381:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789477462.959872:0:1381:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789477462.959878:0:1381:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789477462.959884:0:1381:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789477462.959890:0:1381:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789477462.959895:0:1381:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789477462.959901:0:1381:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789477462.959907:0:1381:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789477462.959913:0:1381:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789477462.959919:0:1381:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789477462.959924:0:1381:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789477462.959929:0:1381:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789477462.959935:0:1381:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789477462.959940:0:1381:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789477462.959946:0:1381:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789477462.959951:0:1381:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789477462.959957:0:1381:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789477462.959963:0:1381:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789477462.959968:0:1381:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789477462.959974:0:1381:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789477462.959980:0:1381:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789477462.959985:0:1381:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789477462.959991:0:1381:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789477462.959996:0:1381:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789477462.960001:0:1381:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789477462.960007:0:1381:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:0.0:1789477462.974316:0:13255:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789477462.974342:0:13255:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00000020:00000080:0.0:1789477462.974348:0:13255:0:(genops.c:885:class_export_put()) final put ffff9d0d514cf000/lustre-OST0001-osd_UUID 00000020:00000080:0.0:1789477462.974353:0:13255:0:(genops.c:844:class_export_destroy()) destroying export ffff9d0d514cf000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:01000000:0.0:1789477462.974360:0:13255:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osd (lustre-OST0001-osd_UUID) 00000020:01000004:0.0:1789477462.974597:0:13255:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff9d0d514ce800 00000020:01000000:0.0:1789477462.974632:0:13255:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of OSS (flags='F') 00000020:00000080:0.0:1789477462.974636:0:13255:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789477462.974867:0:13255:0:(obd_config.c:956:class_cleanup()) OSS: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1789477462.974874:0:13255:0:(genops.c:1558:class_disconnect_exports()) OBD device 10 (ffff9d0d6cf499b8) has no exports 00000020:00000080:0.0:1789477462.974903:0:13255:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789477462.974910:0:13255:0:(obd_config.c:883:class_detach()) detach on obd OSS (uuid OSS_uuid) 00000020:00000080:0.0:1789477462.974914:0:13255:0:(genops.c:885:class_export_put()) final put ffff9d0d7b17c000/OSS_uuid 00000020:00000080:0.0:1789477462.974917:0:13255:0:(genops.c:844:class_export_destroy()) destroying export ffff9d0d7b17c000/OSS_uuid for OSS 00000020:01000000:0.0:1789477462.974922:0:13255:0:(genops.c:441:class_free_dev()) finishing cleanup of obd OSS (OSS_uuid) 00000100:00080000:0.0:1789477462.974955:0:5840:0:(pinger.c:548:ping_evictor_main()) Exiting Ping Evictor 00000100:00100000:0.0:1789477462.975126:0:6697:0:(service.c:3183:ptlrpc_main()) ll_ost00_002: service thread [ffff9d0d6d46d800:6697] 2 exiting: rc = 0 00000100:00100000:0.0:1789477462.975183:0:6694:0:(service.c:3183:ptlrpc_main()) ll_ost00_000: service thread [ffff9d0d50493e00:6694] 0 exiting: rc = 1 00000100:00100000:1.0:1789477462.977621:0:8241:0:(service.c:3183:ptlrpc_main()) ll_ost00_003: service thread [ffff9d0d75315a00:8241] 3 exiting: rc = 0 00000100:00100000:2.0:1789477462.978280:0:6696:0:(service.c:3183:ptlrpc_main()) ll_ost00_001: service thread [ffff9d0d5bacc000:6696] 1 exiting: rc = 0 00000100:00100000:0.0:1789477462.978468:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789477462.978478:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789477462.978484:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789477462.978502:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789477462.978508:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789477462.978514:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789477462.978520:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789477462.978525:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789477462.978530:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789477462.978535:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789477462.978540:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789477462.978544:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789477462.978550:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789477462.978556:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789477462.978561:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789477462.978567:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789477462.978571:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789477462.978637:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789477462.978654:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789477462.978659:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789477462.978664:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789477462.978669:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789477462.978674:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789477462.978691:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789477462.978696:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789477462.978702:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789477462.978707:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789477462.978711:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789477462.978716:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789477462.978721:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789477462.978726:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789477462.978730:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789477462.978734:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789477462.978740:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789477462.978745:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789477462.978750:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789477462.978755:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789477462.978761:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789477462.978766:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789477462.978771:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789477462.978776:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789477462.978781:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789477462.978785:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789477462.978790:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789477462.978795:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789477462.978800:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789477462.978805:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789477462.978809:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789477462.978814:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789477462.978819:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789477462.978825:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789477462.978829:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789477462.978834:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789477462.978839:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789477462.978844:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789477462.978848:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789477462.978853:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789477462.978857:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789477462.978868:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789477462.978873:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789477462.978879:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789477462.978886:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789477462.978892:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789477462.978897:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789477462.979767:0:6698:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_000: service thread [ffff9d0d6d46d400:6698] 0 exiting: rc = 1 00000100:00100000:3.0:1789477462.980052:0:6699:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_001: service thread [ffff9d0d6d46c600:6699] 1 exiting: rc = 0 00000100:00100000:0.0:1789477462.980152:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789477462.980161:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789477462.980166:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789477462.980170:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789477462.980176:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789477462.980180:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789477462.980186:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789477462.980191:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789477462.980197:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789477462.980203:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789477462.980208:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789477462.980214:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789477462.980219:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789477462.980224:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789477462.980229:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789477462.980247:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789477462.980252:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789477462.980257:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789477462.980261:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789477462.980266:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789477462.980271:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789477462.980276:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789477462.980281:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789477462.980285:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789477462.980290:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789477462.980295:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789477462.980301:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789477462.980305:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789477462.980322:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789477462.980326:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789477462.980331:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789477462.980337:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789477462.980344:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789477462.980349:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789477462.980354:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789477462.980359:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789477462.980364:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789477462.980368:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789477462.980373:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789477462.980378:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789477462.980383:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789477462.980389:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789477462.980395:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789477462.980400:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789477462.980406:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789477462.980411:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789477462.980416:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789477462.980484:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789477462.980489:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789477462.980494:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789477462.980499:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789477462.980505:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789477462.980510:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789477462.980516:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789477462.980522:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789477462.980528:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789477462.980533:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789477462.980537:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789477462.980543:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789477462.980549:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789477462.980554:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789477462.980559:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789477462.980564:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789477462.983543:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789477462.984821:0:6701:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_001: service thread [ffff9d0d75415e00:6701] 1 exiting: rc = 0 00000100:00100000:0.0:1789477462.984990:0:6702:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_002: service thread [ffff9d0d5156ce00:6702] 2 exiting: rc = 0 00000100:00100000:2.0:1789477462.985345:0:6700:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_000: service thread [ffff9d0d762b3a00:6700] 0 exiting: rc = 1 00000100:00100000:0.0:1789477462.985562:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789477462.985569:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789477462.985574:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789477462.985628:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789477462.985634:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789477462.985649:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789477462.985655:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789477462.985661:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789477462.985667:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789477462.985672:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789477462.985678:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789477462.985684:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789477462.985697:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789477462.985704:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789477462.985709:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789477462.985714:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789477462.985719:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789477462.985724:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789477462.985730:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789477462.985735:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789477462.985742:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789477462.985747:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789477462.985753:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789477462.985758:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789477462.985764:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789477462.985769:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789477462.985775:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789477462.985782:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789477462.985787:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789477462.985792:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789477462.985798:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789477462.985803:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789477462.985820:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789477462.985826:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789477462.985831:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789477462.985837:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789477462.985856:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789477462.985863:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789477462.985869:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789477462.985875:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789477462.985880:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789477462.985885:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789477462.985890:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789477462.985895:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789477462.985901:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789477462.985906:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789477462.985911:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789477462.985916:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789477462.985921:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789477462.985926:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789477462.985932:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789477462.985937:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789477462.985942:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789477462.985948:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789477462.985953:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789477462.985958:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789477462.985964:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789477462.985969:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789477462.985974:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789477462.985980:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789477462.985986:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789477462.985991:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789477462.985997:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789477462.986010:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789477462.994095:0:6703:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_000: service thread [ffff9d0d75415600:6703] 0 exiting: rc = 1 00000100:00100000:0.0:1789477462.994306:0:6704:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_001: service thread [ffff9d0d75415200:6704] 1 exiting: rc = 0 00000100:00100000:0.0:1789477462.994364:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789477462.994372:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789477462.994383:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789477462.994388:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789477462.994393:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789477462.994398:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789477462.994402:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789477462.994407:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789477462.994412:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789477462.994416:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789477462.994500:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789477462.994507:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789477462.994511:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789477462.994516:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789477462.994521:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789477462.994525:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789477462.994530:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789477462.994534:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789477462.994539:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789477462.994543:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789477462.994547:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789477462.994551:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789477462.994555:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789477462.994559:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789477462.994563:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789477462.994567:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789477462.994572:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789477462.994711:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789477462.994719:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789477462.994724:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789477462.994730:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789477462.994735:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789477462.994740:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789477462.994745:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789477462.994750:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789477462.994756:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789477462.994760:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789477462.994776:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789477462.994781:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789477462.994791:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789477462.994798:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789477462.994803:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789477462.994810:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789477462.994816:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789477462.994821:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789477462.994827:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789477462.994833:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789477462.994837:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789477462.994842:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789477462.994847:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789477462.994852:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789477462.994857:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789477462.994863:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789477462.994868:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789477462.994874:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789477462.994879:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789477462.994884:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789477462.994889:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789477462.994894:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789477462.994903:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789477462.994912:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789477462.994917:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789477462.994922:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789477462.994929:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789477462.995905:0:6705:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_000: service thread [ffff9d0d74f61a00:6705] 0 exiting: rc = 1 00000100:00100000:1.0:1789477462.996086:0:6706:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_001: service thread [ffff9d0d580a9c00:6706] 1 exiting: rc = 0 00000100:00100000:0.0:1789477462.996172:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789477462.996206:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789477462.996214:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789477462.996219:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789477462.996225:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789477462.996250:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789477462.996259:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789477462.996265:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789477462.996277:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789477462.996283:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789477462.996288:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789477462.996293:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789477462.996298:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789477462.996303:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789477462.996309:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789477462.996314:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789477462.996319:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789477462.996334:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789477462.996340:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789477462.996346:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789477462.996351:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789477462.996356:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789477462.996361:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789477462.996367:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789477462.996372:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789477462.996377:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789477462.996384:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789477462.996389:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789477462.996394:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789477462.996409:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789477462.996415:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789477462.996480:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789477462.996489:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789477462.996494:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789477462.996500:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789477462.996505:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789477462.996510:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789477462.996515:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789477462.996521:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789477462.996526:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789477462.996531:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789477462.996548:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789477462.996554:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789477462.996563:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789477462.996569:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789477462.996574:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789477462.996722:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789477462.996728:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789477462.996734:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789477462.996740:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789477462.996747:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789477462.996753:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789477462.996760:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789477462.997031:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789477462.997039:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789477462.997050:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789477462.997055:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789477462.997061:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789477462.997068:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789477462.997076:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789477462.997104:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789477462.997112:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789477462.997118:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789477462.997126:0:13255:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:02000400:0.0:1789477463.004520:0:13255:0:(tgt_mount.c:2184:server_put_super()) server umount lustre-OST0001 complete 00000001:02000400:3.0:1789477479.511029:0:13871:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg123-server.virtnet: executing load_modules_local 00000020:01000004:1.0:1789477489.368292:0:14332:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:1.0:1789477489.368298:0:14332:0:(obd_mount.c:926:lmd_print()) device: lustre-mdt1/mdt1 00000080:01200004:1.0:1789477489.368431:0:14332:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9d0c43499000 00000020:01000004:1.0:1789477489.368445:0:14332:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-MDT0000, type=osd-zfs, lsifl=200005, mountfl=0 00000020:01000004:1.0:1789477489.368811:0:14332:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-zfs) 00000020:00000080:1.0:1789477489.368829:0:14332:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (ffff9d0d761619b8) 00000020:00000080:1.0:1789477489.368845:0:14332:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-zfs with refcount 2 00100000:10000000:0.0:1789477489.384899:0:14332:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:1.0:1789477489.387510:0:14332:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000003:0x11:0x0] (8/32) 00100000:10000000:1.0:1789477489.387820:0:14332:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-MDT0000 under 451: rc = 0 00100000:10000000:1.0:1789477489.387897:0:14332:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-OST0001 under 451: rc = 0 00100000:10000000:1.0:1789477489.387984:0:14332:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-client under 451: rc = 0 00100000:10000000:1.0:1789477489.388072:0:14332:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled params under 451: rc = 0 00100000:10000000:1.0:1789477489.388241:0:14332:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:1.0:1789477489.388285:0:14332:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled nodemap under 451: rc = 0 00100000:10000000:1.0:1789477489.388343:0:14332:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-OST0000 under 451: rc = 0 00100000:10000000:1.0:1789477489.388514:0:14332:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre under 453: rc = 0 00100000:10000000:1.0:1789477489.389514:0:14332:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled md-0x0 under 646: rc = 0 00100000:10000000:1.0:1789477489.392321:0:14332:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled dt-0x0 under 646: rc = 0 00100000:10000000:1.0:1789477489.396100:0:14332:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000-MDT0000 under 364: rc = 0 00100000:10000000:1.0:1789477489.396707:0:14332:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000 under 364: rc = 0 00100000:10000000:1.0:1789477489.396969:0:14332:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000-MDT0000 under 364: rc = 0 00100000:10000000:1.0:1789477489.397955:0:14332:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000 under 364: rc = 0 00100000:10000000:1.0:1789477489.398328:0:14332:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000 under 364: rc = 0 00100000:10000000:1.0:1789477489.398686:0:14332:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000-MDT0000 under 364: rc = 0 00100000:10000000:1.0:1789477489.399444:0:14332:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000-MDT0000 under 364: rc = 0 00100000:10000000:1.0:1789477489.400745:0:14332:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000 under 364: rc = 0 00100000:10000000:0.0:1789477489.402743:0:14332:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000 under 364: rc = 0 00100000:10000000:0.0:1789477489.403012:0:14332:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000-MDT0000 under 364: rc = 0 00100000:10000000:0.0:1789477489.403254:0:14332:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000 under 364: rc = 0 00100000:10000000:0.0:1789477489.403491:0:14332:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000-MDT0000 under 364: rc = 0 00100000:10000000:0.0:1789477489.403952:0:14332:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_10 under 376: rc = 0 00100000:10000000:0.0:1789477489.404193:0:14332:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_05 under 376: rc = 0 00100000:10000000:0.0:1789477489.404431:0:14332:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_03 under 376: rc = 0 00100000:10000000:0.0:1789477489.404715:0:14332:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_09 under 376: rc = 0 00100000:10000000:0.0:1789477489.404947:0:14332:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_04 under 376: rc = 0 00100000:10000000:0.0:1789477489.405149:0:14332:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_11 under 376: rc = 0 00100000:10000000:0.0:1789477489.405334:0:14332:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_08 under 376: rc = 0 00100000:10000000:0.0:1789477489.405528:0:14332:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_02 under 376: rc = 0 00100000:10000000:0.0:1789477489.407054:0:14332:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_06 under 376: rc = 0 00100000:10000000:0.0:1789477489.407434:0:14332:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_13 under 376: rc = 0 00100000:10000000:0.0:1789477489.407879:0:14332:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_15 under 376: rc = 0 00100000:10000000:0.0:1789477489.408210:0:14332:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_00 under 376: rc = 0 00100000:10000000:0.0:1789477489.408569:0:14332:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_12 under 376: rc = 0 00100000:10000000:0.0:1789477489.408994:0:14332:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_07 under 376: rc = 0 00100000:10000000:0.0:1789477489.409270:0:14332:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_01 under 376: rc = 0 00100000:10000000:0.0:1789477489.409862:0:14332:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_14 under 376: rc = 0 00100000:10000000:0.0:1789477489.410143:0:14332:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_03 under 376: rc = 0 00100000:10000000:0.0:1789477489.410395:0:14332:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_09 under 376: rc = 0 00100000:10000000:0.0:1789477489.410914:0:14332:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_05 under 376: rc = 0 00100000:10000000:0.0:1789477489.411188:0:14332:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_10 under 376: rc = 0 00100000:10000000:0.0:1789477489.411530:0:14332:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_08 under 376: rc = 0 00100000:10000000:0.0:1789477489.411882:0:14332:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_02 under 376: rc = 0 00100000:10000000:0.0:1789477489.412135:0:14332:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_11 under 376: rc = 0 00100000:10000000:0.0:1789477489.412376:0:14332:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_04 under 376: rc = 0 00100000:10000000:0.0:1789477489.412879:0:14332:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_00 under 376: rc = 0 00100000:10000000:0.0:1789477489.413223:0:14332:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_15 under 376: rc = 0 00100000:10000000:0.0:1789477489.413473:0:14332:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_13 under 376: rc = 0 00100000:10000000:0.0:1789477489.413779:0:14332:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_06 under 376: rc = 0 00100000:10000000:0.0:1789477489.414036:0:14332:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_14 under 376: rc = 0 00100000:10000000:0.0:1789477489.414276:0:14332:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_01 under 376: rc = 0 00100000:10000000:0.0:1789477489.414531:0:14332:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_07 under 376: rc = 0 00100000:10000000:0.0:1789477489.415065:0:14332:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_12 under 376: rc = 0 00100000:10000000:0.0:1789477489.415428:0:14332:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled [0x200000400:0x1:0x0] under 659: rc = 0 00100000:10000000:0.0:1789477489.416156:0:14332:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x1010000:0x0] (8/32) 00100000:10000000:0.0:1789477489.416336:0:14332:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000 under 647: rc = 0 00100000:10000000:0.0:1789477489.416860:0:14332:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x2010000:0x0] (8/32) 00100000:10000000:0.0:1789477489.416929:0:14332:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000 under 647: rc = 0 00100000:10000000:0.0:1789477489.417118:0:14332:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x10000:0x0] (8/32) 00100000:10000000:0.0:1789477489.417184:0:14332:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000 under 647: rc = 0 00100000:10000000:0.0:1789477489.417559:0:14332:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x1020000:0x0] (8/32) 00100000:10000000:0.0:1789477489.418252:0:14332:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000 under 650: rc = 0 00100000:10000000:0.0:1789477489.418441:0:14332:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x20000:0x0] (8/32) 00100000:10000000:0.0:1789477489.418866:0:14332:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000 under 650: rc = 0 00100000:10000000:0.0:1789477489.419054:0:14332:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x2020000:0x0] (8/32) 00100000:10000000:0.0:1789477489.419124:0:14332:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000 under 650: rc = 0 00000020:00000080:0.0:1789477489.419396:0:14332:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:0.0:1789477489.419404:0:14332:0:(osd_handler.c:1564:osd_obd_connect()) connect #0 00000020:00000080:0.0:1789477489.419416:0:14332:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xafddb3c8f9282680 00000020:01000004:0.0:1789477489.419423:0:14332:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-MDT0000 on device lustre-mdt1/mdt1 00000020:01000000:0.0:1789477489.419429:0:14332:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:0.0:1789477489.419433:0:14332:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9d0c43499000 from MGS 00000020:01000004:0.0:1789477489.419437:0:14332:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:0.0:1789477489.419446:0:14332:0:(genops.c:413:class_newdev()) Allocate new device MGS (ffff9d0d6cf499b8) 00000020:00000080:0.0:1789477489.419528:0:14332:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:0.0:1789477489.419734:0:14332:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9d0c43499000 from MGS, refs=2 00080000:01000000:0.0:1789477489.419740:0:14332:0:(osd_handler.c:1564:osd_obd_connect()) connect #1 00000020:00000080:0.0:1789477489.419751:0:14332:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xafddb3c8f928268e 00000100:00100000:0.0:1789477489.419860:0:14332:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:0.0:1789477489.420001:0:14332:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:0.0:1789477489.420007:0:14332:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:0.0:1789477489.420411:0:14332:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:0.0:1789477489.420424:0:14332:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:0.0:1789477489.421391:0:14332:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1789477489.421838:0:14332:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:0.0:1789477489.421845:0:14332:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:0.0:1789477489.430056:0:14332:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:0.0:1789477489.430082:0:14332:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:0.0:1789477489.436165:0:14332:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:1.0:1789477489.439157:0:14332:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:3.0:1789477489.450208:0:14338:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789477489.450216:0:14338:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789477489.450219:0:14338:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789477489.454851:0:14339:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789477489.454858:0:14339:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789477489.454861:0:14339:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789477489.458681:0:14332:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:3.0:1789477489.466093:0:14338:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:0.0:1789477489.476880:0:14332:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 20000000:01000000:0.0:1789477489.476902:0:14332:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:0.0:1789477489.476905:0:14332:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 10000000:01000000:3.0:1789477489.488135:0:14341:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:1.0:1789477489.488420:0:14332:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:1.0:1789477489.488534:0:14332:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1789477489.490863:0:14332:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:1.0:1789477489.491191:0:14332:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1789477489.491399:0:14332:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:1.0:1789477489.491405:0:14332:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:0.0:1789477489.502051:0:14332:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:0.0:1789477489.502066:0:14332:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:1.0:1789477489.506057:0:14332:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:1.0:1789477489.506069:0:14332:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:1.0:1789477489.506773:0:14332:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:1.0:1789477489.506793:0:14332:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.201.123@tcp' 00000020:01000004:1.0:1789477489.506795:0:14332:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:1.0:1789477489.506825:0:14332:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.201.123@tcp (typ=mgc) 00000020:00000080:1.0:1789477489.506840:0:14332:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.201.123@tcp (ffff9d0d76164d28) 00000020:00000080:1.0:1789477489.506856:0:14332:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:1.0:1789477489.506934:0:14332:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9d0d44510000@MGC192.168.201.123@tcp: add connection 192.168.201.123@tcp at head 00010000:00010000:1.0:1789477489.507104:0:14332:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.201.123@tcp-0 is initialized 00000040:01000000:1.0:1789477489.507111:0:14332:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.123@tcp ctxt 1 is initialized 00000100:00080000:3.0:1789477489.507636:0:14346:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 10000000:01000000:3.0:1789477489.507907:0:14347:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:1.0:1789477489.507969:0:14332:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.201.123@tcp (uuid 730ef4b7-dbd8-4cb5-9f31-5e7e04ae8864) 00000020:00000080:1.0:1789477489.507986:0:14332:0:(genops.c:1385:class_connect()) connect: client 730ef4b7-dbd8-4cb5-9f31-5e7e04ae8864, cookie 0xafddb3c8f928269c 00000100:00080000:1.0:1789477489.507996:0:14332:0:(import.c:510:import_select_connection()) MGC192.168.201.123@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1789477489.508007:0:14332:0:(import.c:625:import_select_connection()) MGC192.168.201.123@tcp: import ffff9d0d44510000 using connection 192.168.201.123@tcp/0@lo 00000100:00100000:1.0:1789477489.508040:0:14332:0:(import.c:827:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9d0d7f700700 x1876402802609920/t0(0) o250->MGC192.168.201.123@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1789477489.508067:0:14332:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import 730ef4b7-dbd8-4cb5-9f31-5e7e04ae8864->MGS 00000100:00100000:3.0:1789477489.508134:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d7f700700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:730ef4b7-dbd8-4cb5-9f31-5e7e04ae8864:3309:1876402802609920:0@lo:250:mount.lustre.0 00000100:00100000:3.0:1789477489.508198:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:01000004:1.0:1789477489.508271:0:14332:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:1.0:1789477489.508276:0:14332:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:1.0:1789477489.508285:0:14332:0:(genops.c:413:class_newdev()) Allocate new device MDS (ffff9d0d76163370) 00000020:00000080:1.0:1789477489.508294:0:14332:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:3.0:1789477489.511629:0:14343:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802609920 00000100:00100000:3.0:1789477489.511657:0:14343:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802609920 00000100:00100000:3.0:1789477489.511705:0:14343:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789477489.511714:0:14343:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d760dc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3309:x1876402802609920:12345-0@lo:250:mount.lustre.0 00010000:00080000:3.0:1789477489.511742:0:14343:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from 730ef4b7-dbd8-4cb5-9f31-5e7e04ae8864@0@lo t0 exp 0000000000000000 cur 434 last 0 00000020:00000080:3.0:1789477489.511784:0:14343:0:(genops.c:1385:class_connect()) connect: client 730ef4b7-dbd8-4cb5-9f31-5e7e04ae8864, cookie 0xafddb3c8f92826aa 00000100:00080000:3.0:1789477489.511927:0:14343:0:(import.c:65:import_set_state_nolock()) ffff9d0d6ec4d000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789477489.512008:0:14343:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d760dc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:730ef4b7-dbd8-4cb5-9f31-5e7e04ae8864+5:3309:x1876402802609920:12345-0@lo:250:mount.lustre.0 Request processed in 293us (3808us total) trans 0 rc 0/0 00000100:00100000:3.0:1789477489.512016:0:14343:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789477489.512062:0:3309:0:(client.c:3125:ptlrpc_free_committed()) MGC192.168.201.123@tcp: committing for last_committed 0 gen 1 00000100:00080000:3.0:1789477489.512070:0:3309:0:(import.c:1133:ptlrpc_connect_interpret()) MGC192.168.201.123@tcp: connect to target with instance 0 00000100:00080000:3.0:1789477489.512078:0:3309:0:(import.c:957:ptlrpc_connect_set_flags()) MGC192.168.201.123@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:3.0:1789477489.512082:0:3309:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:3.0:1789477489.512099:0:3309:0:(import.c:65:import_set_state_nolock()) ffff9d0d44510000 MGS: changing import state from CONNECTING to FULL 10000000:01000000:3.0:1789477489.512101:0:3309:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:3.0:1789477489.512110:0:3309:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:3.0:1789477489.512116:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d7f700700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:730ef4b7-dbd8-4cb5-9f31-5e7e04ae8864:3309:1876402802609920:0@lo:250:mount.lustre.0 00000100:00100000:1.0:1789477489.527333:0:14332:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1789477489.539043:0:14332:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:0.0:1789477489.539052:0:14332:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:2.0:1789477489.540290:0:14332:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:2.0:1789477489.540303:0:14332:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:0.0:1789477489.541778:0:14332:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:0.0:1789477489.541790:0:14332:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:0.0:1789477489.542544:0:14332:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1789477489.542783:0:14332:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:0.0:1789477489.542789:0:14332:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:0.0:1789477489.550162:0:14332:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:0.0:1789477489.550180:0:14332:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:2.0:1789477489.581015:0:14332:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789477489.581251:0:14332:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:2.0:1789477489.581258:0:14332:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:0.0:1789477489.585367:0:14332:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:0.0:1789477489.585385:0:14332:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:0.0:1789477489.586156:0:14332:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1789477489.586345:0:14332:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:0.0:1789477489.586350:0:14332:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:2.0:1789477489.586975:0:14332:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:2.0:1789477489.586982:0:14332:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:2.0:1789477489.587441:0:14332:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789477489.587676:0:14332:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:2.0:1789477489.587681:0:14332:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:2.0:1789477489.588103:0:14332:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:2.0:1789477489.588109:0:14332:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:2.0:1789477489.588564:0:14332:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789477489.598197:0:14332:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:2.0:1789477489.598208:0:14332:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:0.0:1789477489.601000:0:14332:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:0.0:1789477489.601019:0:14332:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:3.0:1789477489.618773:0:14332:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1789477489.619216:0:14332:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:3.0:1789477489.619225:0:14332:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:3.0:1789477489.620742:0:14332:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:3.0:1789477489.620768:0:14332:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:0.0:1789477489.621908:0:14332:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:0.0:1789477489.621919:0:14332:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:0.0:1789477489.622911:0:14332:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:0.0:1789477489.622942:0:14332:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-mdt1/mdt1 10000000:01000000:0.0:1789477489.623094:0:14332:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.201.123@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:0.0:1789477489.623380:0:14332:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.123@tcp ctxt 0 is initialized 00000020:01000004:0.0:1789477489.623425:0:14332:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.201.123@tcp, index=0000, flags=0x20005 00000020:01000004:0.0:1789477489.623435:0:14332:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1789477489.623437:0:14332:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1789477489.623438:0:14332:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789477489.623439:0:14332:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789477489.623440:0:14332:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789477489.623441:0:14332:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789477489.623443:0:14332:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1789477489.623444:0:14332:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1789477489.623446:0:14332:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789477489.623447:0:14332:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1789477489.623451:0:14332:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020005 00000020:01000004:0.0:1789477489.623453:0:14332:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1789477489.623454:0:14332:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1789477489.623454:0:14332:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789477489.623455:0:14332:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789477489.623456:0:14332:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789477489.623457:0:14332:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789477489.623458:0:14332:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1789477489.623458:0:14332:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1789477489.623459:0:14332:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789477489.623460:0:14332:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1789477489.623511:0:14332:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:0.0:1789477489.623537:0:14332:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d6d481180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:730ef4b7-dbd8-4cb5-9f31-5e7e04ae8864:14332:1876402802610048:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1789477489.623857:0:14332:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789477489.623952:0:14332:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d0d585f2840 going to sleep for 11 seconds 00000100:00100000:1.0:1789477489.624009:0:14345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802610048 00000100:00100000:1.0:1789477489.624017:0:14345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802610048 00000100:00100000:1.0:1789477489.624103:0:14345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789477489.624114:0:14345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d760df050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:730ef4b7-dbd8-4cb5-9f31-5e7e04ae8864+5:14332:x1876402802610048:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1789477489.624234:0:14345:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1789477489.624238:0:14345:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:1.0:1789477489.624242:0:14345:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0000 is running on 0@lo 10000000:01000000:1.0:1789477489.625047:0:14366:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:0.0:1789477489.625791:0:14345:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 5 20000000:01000000:3.0:1789477489.627363:0:14367:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 0 20000000:01000000:3.0:1789477489.627372:0:14367:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0000_UUID is 0 (0) 20000000:01000000:3.0:1789477489.627375:0:14367:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0001_UUID is 1 (1) 00000040:00080000:3.0:1789477489.627408:0:14367:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 20000000:01000000:0.0:1789477489.628229:0:14345:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1789477489.628241:0:14345:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:0.0:1789477489.652106:0:14345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d760df050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:730ef4b7-dbd8-4cb5-9f31-5e7e04ae8864+5:14332:x1876402802610048:12345-0@lo:253:mount.lustre.0 Request processed in 27982us (28237us total) trans 0 rc 0/0 00000100:00100000:0.0:1789477489.652125:0:14345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789477489.652786:0:14332:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d6d481180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:730ef4b7-dbd8-4cb5-9f31-5e7e04ae8864:14332:1876402802610048:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1789477489.652805:0:14332:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:3.0:1789477489.652810:0:14332:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1789477489.652812:0:14332:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1789477489.652813:0:14332:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789477489.652814:0:14332:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789477489.652815:0:14332:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789477489.652817:0:14332:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789477489.652818:0:14332:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1789477489.652820:0:14332:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1789477489.652822:0:14332:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789477489.652823:0:14332:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1789477489.652855:0:14332:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9d0c43499000 from lustre-MDT0000 10000000:01000000:3.0:1789477489.652884:0:14332:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:3.0:1789477489.652887:0:14332:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:3.0:1789477489.652892:0:14332:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff9d0d76164d28 10000000:01000000:3.0:1789477489.652965:0:14332:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1789477489.652975:0:14332:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff9d0d76164d28 from 1 10000000:01000000:3.0:1789477489.652978:0:14332:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1789477489.653026:0:14332:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.123@tcp lock: ffff9d0d49ecbe00/0xafddb3c8f92826b1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477489.653053:0:14332:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.123@tcp lock: ffff9d0d49ecbe00/0xafddb3c8f92826b1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477489.653064:0:14332:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.123@tcp lock: ffff9d0d49ecbe00/0xafddb3c8f92826b1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789477489.653087:0:14332:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d58072a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:730ef4b7-dbd8-4cb5-9f31-5e7e04ae8864:14332:1876402802610176:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1789477489.653136:0:14332:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789477489.653347:0:14332:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d0d46cd80c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789477489.653430:0:14344:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802610176 00000100:00100000:2.0:1789477489.653438:0:14344:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802610176 00000100:00100000:2.0:1789477489.653480:0:14344:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789477489.653490:0:14344:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d760dec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:730ef4b7-dbd8-4cb5-9f31-5e7e04ae8864+5:14332:x1876402802610176:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789477489.653502:0:14344:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789477489.653518:0:14344:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d0d50416c00/0xafddb3c8f92826b8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xafddb3c8f92826b1 expref: -99 pid: 14344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477489.653541:0:14344:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d0d50416c00/0xafddb3c8f92826b8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xafddb3c8f92826b1 expref: 6 pid: 14344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477489.653552:0:14344:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d0d50416c00/0xafddb3c8f92826b8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xafddb3c8f92826b1 expref: 6 pid: 14344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477489.653562:0:14344:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d0d50416c00, rc 0) 00000100:00100000:2.0:1789477489.653641:0:14344:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d760dec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:730ef4b7-dbd8-4cb5-9f31-5e7e04ae8864+6:14332:x1876402802610176:12345-0@lo:101:mount.lustre.0 Request processed in 152us (505us total) trans 0 rc 0/0 00000100:00100000:2.0:1789477489.653648:0:14344:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789477489.653732:0:14332:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d58072a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:730ef4b7-dbd8-4cb5-9f31-5e7e04ae8864:14332:1876402802610176:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789477489.653746:0:14332:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.123@tcp lock: ffff9d0d49ecbe00/0xafddb3c8f92826b1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xafddb3c8f92826b8 expref: -99 pid: 14332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477489.653767:0:14332:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.123@tcp lock: ffff9d0d49ecbe00/0xafddb3c8f92826b1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xafddb3c8f92826b8 expref: -99 pid: 14332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789477489.653816:0:14332:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d58072a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:730ef4b7-dbd8-4cb5-9f31-5e7e04ae8864:14332:1876402802610304:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789477489.653842:0:14332:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789477489.653876:0:14332:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d0d46cd80c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789477489.654276:0:14345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802610304 00000100:00100000:0.0:1789477489.654282:0:14345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802610304 00000100:00100000:0.0:1789477489.654316:0:14345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1789477489.654324:0:14345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d760dd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:730ef4b7-dbd8-4cb5-9f31-5e7e04ae8864+6:14332:x1876402802610304:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789477489.654638:0:14345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d760dd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:730ef4b7-dbd8-4cb5-9f31-5e7e04ae8864+6:14332:x1876402802610304:12345-0@lo:501:mount.lustre.0 Request processed in 314us (795us total) trans 0 rc -2/-2 00000100:00100000:0.0:1789477489.654645:0:14345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789477489.654777:0:14332:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d58072a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:730ef4b7-dbd8-4cb5-9f31-5e7e04ae8864:14332:1876402802610304:0@lo:501:mount.lustre.0 10000000:01000000:1.0:1789477489.654805:0:14332:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.123@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1789477489.654816:0:14332:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.123@tcp lock: ffff9d0d49ecbe00/0xafddb3c8f92826b1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xafddb3c8f92826b8 expref: -99 pid: 14332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477489.654824:0:14332:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.123@tcp lock: ffff9d0d49ecbe00/0xafddb3c8f92826b1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xafddb3c8f92826b8 expref: -99 pid: 14332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789477489.654831:0:14332:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9d0c43499000 10000000:01000000:1.0:1789477489.654837:0:14332:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1789477489.654840:0:14332:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff9d0c43499000 10000000:01000000:1.0:1789477489.654842:0:14332:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:1.0:1789477489.654845:0:14332:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff9d0c43499000 from 1 10000000:01000000:1.0:1789477489.654848:0:14332:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:1.0:1789477489.654871:0:14332:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.123@tcp lock: ffff9d0d7f519200/0xafddb3c8f92826bf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477489.654878:0:14332:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.123@tcp lock: ffff9d0d7f519200/0xafddb3c8f92826bf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477489.654887:0:14332:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.123@tcp lock: ffff9d0d7f519200/0xafddb3c8f92826bf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789477489.654908:0:14332:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d7f702a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:730ef4b7-dbd8-4cb5-9f31-5e7e04ae8864:14332:1876402802610432:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1789477489.654938:0:14332:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789477489.654963:0:14344:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802610432 00000100:00100000:1.0:1789477489.654967:0:14344:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802610432 00000100:00100000:1.0:1789477489.654994:0:14344:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1789477489.654999:0:14344:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d761b2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:730ef4b7-dbd8-4cb5-9f31-5e7e04ae8864+6:14332:x1876402802610432:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789477489.655006:0:14344:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789477489.655019:0:14344:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d0d7f518a00/0xafddb3c8f92826c6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xafddb3c8f92826bf expref: -99 pid: 14344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477489.655033:0:14344:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d0d7f518a00/0xafddb3c8f92826c6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xafddb3c8f92826bf expref: 7 pid: 14344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477489.655041:0:14344:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d0d7f518a00/0xafddb3c8f92826c6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xafddb3c8f92826bf expref: 7 pid: 14344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477489.655047:0:14344:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d0d7f518a00, rc 0) 00000100:00100000:1.0:1789477489.655070:0:14344:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d761b2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:730ef4b7-dbd8-4cb5-9f31-5e7e04ae8864+7:14332:x1876402802610432:12345-0@lo:101:mount.lustre.0 Request processed in 70us (132us total) trans 0 rc 0/0 00000100:00100000:1.0:1789477489.655146:0:14344:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1789477489.655237:0:14332:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d0d50a1e240 going to sleep for 11 seconds 00000100:00100000:1.0:1789477489.655253:0:14332:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d7f702a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:730ef4b7-dbd8-4cb5-9f31-5e7e04ae8864:14332:1876402802610432:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789477489.655263:0:14332:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.123@tcp lock: ffff9d0d7f519200/0xafddb3c8f92826bf lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xafddb3c8f92826c6 expref: -99 pid: 14332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477489.655271:0:14332:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.123@tcp lock: ffff9d0d7f519200/0xafddb3c8f92826bf lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xafddb3c8f92826c6 expref: -99 pid: 14332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789477489.655289:0:14332:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.123@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:1.0:1789477489.655293:0:14332:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.123@tcp lock: ffff9d0d7f519200/0xafddb3c8f92826bf lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xafddb3c8f92826c6 expref: -99 pid: 14332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477489.655299:0:14332:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.123@tcp lock: ffff9d0d7f519200/0xafddb3c8f92826bf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xafddb3c8f92826c6 expref: -99 pid: 14332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789477489.655304:0:14332:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:1.0:1789477489.655307:0:14332:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1789477489.655311:0:14332:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff9d0c43499000 10000000:01000000:1.0:1789477489.655314:0:14332:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:1.0:1789477489.655317:0:14332:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:1.0:1789477489.655319:0:14332:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:1.0:1789477489.655332:0:14332:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.123@tcp lock: ffff9d0d7f519400/0xafddb3c8f92826cd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477489.655338:0:14332:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.123@tcp lock: ffff9d0d7f519400/0xafddb3c8f92826cd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477489.655345:0:14332:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.123@tcp lock: ffff9d0d7f519400/0xafddb3c8f92826cd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789477489.655356:0:14332:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d7f702a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:730ef4b7-dbd8-4cb5-9f31-5e7e04ae8864:14332:1876402802610560:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1789477489.655380:0:14332:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789477489.655399:0:14344:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802610560 00000100:00100000:1.0:1789477489.655403:0:14344:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802610560 00000100:00100000:1.0:1789477489.655425:0:14344:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1789477489.655431:0:14344:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d761b1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:730ef4b7-dbd8-4cb5-9f31-5e7e04ae8864+7:14332:x1876402802610560:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789477489.655444:0:14344:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789477489.655452:0:14344:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d0d7f518000/0xafddb3c8f92826d4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xafddb3c8f92826cd expref: -99 pid: 14344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477489.655465:0:14344:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d0d7f518000/0xafddb3c8f92826d4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xafddb3c8f92826cd expref: 8 pid: 14344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477489.655473:0:14344:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d0d7f518000/0xafddb3c8f92826d4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xafddb3c8f92826cd expref: 8 pid: 14344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477489.655480:0:14344:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d0d7f518000, rc 0) 00000100:00100000:1.0:1789477489.655503:0:14344:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d761b1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:730ef4b7-dbd8-4cb5-9f31-5e7e04ae8864+8:14332:x1876402802610560:12345-0@lo:101:mount.lustre.0 Request processed in 72us (122us total) trans 0 rc 0/0 00000100:00100000:1.0:1789477489.655508:0:14344:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1789477489.655530:0:14332:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d0d50a1e240 going to sleep for 11 seconds 00000100:00100000:1.0:1789477489.655542:0:14332:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d7f702a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:730ef4b7-dbd8-4cb5-9f31-5e7e04ae8864:14332:1876402802610560:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789477489.655551:0:14332:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.123@tcp lock: ffff9d0d7f519400/0xafddb3c8f92826cd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xafddb3c8f92826d4 expref: -99 pid: 14332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477489.655559:0:14332:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.123@tcp lock: ffff9d0d7f519400/0xafddb3c8f92826cd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xafddb3c8f92826d4 expref: -99 pid: 14332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789477489.655620:0:14332:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d7f702a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:730ef4b7-dbd8-4cb5-9f31-5e7e04ae8864:14332:1876402802610688:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789477489.655644:0:14332:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789477489.655659:0:14332:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d0d50a1e240 going to sleep for 11 seconds 00000100:00100000:3.0:1789477489.655749:0:14343:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802610688 00000100:00100000:3.0:1789477489.655763:0:14343:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802610688 00000100:00100000:3.0:1789477489.655786:0:14343:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1789477489.655792:0:14343:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d761b3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:730ef4b7-dbd8-4cb5-9f31-5e7e04ae8864+8:14332:x1876402802610688:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789477489.656493:0:14343:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d761b3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:730ef4b7-dbd8-4cb5-9f31-5e7e04ae8864+9:14332:x1876402802610688:12345-0@lo:501:mount.lustre.0 Request processed in 361us (508us total) trans 0 rc 0/0 00000100:00100000:3.0:1789477489.656501:0:14343:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1789477489.657535:0:14332:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d7f702a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:730ef4b7-dbd8-4cb5-9f31-5e7e04ae8864:14332:1876402802610688:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789477489.657613:0:14332:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d7f702a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:730ef4b7-dbd8-4cb5-9f31-5e7e04ae8864:14332:1876402802610816:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1789477489.657683:0:14332:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789477489.657729:0:14332:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d0d50a1e240 going to sleep for 11 seconds 00000100:00100000:3.0:1789477489.657746:0:14345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802610816 00000100:00100000:3.0:1789477489.657762:0:14345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802610816 00000100:00100000:3.0:1789477489.657809:0:14345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1789477489.657819:0:14345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d761b1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:730ef4b7-dbd8-4cb5-9f31-5e7e04ae8864+9:14332:x1876402802610816:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1789477489.658468:0:14345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d761b1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:730ef4b7-dbd8-4cb5-9f31-5e7e04ae8864+9:14332:x1876402802610816:12345-0@lo:503:mount.lustre.0 Request processed in 649us (783us total) trans 0 rc 0/0 00000100:00100000:3.0:1789477489.658476:0:14345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1789477489.658526:0:14332:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d7f702a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:730ef4b7-dbd8-4cb5-9f31-5e7e04ae8864:14332:1876402802610816:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1789477489.660096:0:14368:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d6d483100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:730ef4b7-dbd8-4cb5-9f31-5e7e04ae8864:14368:1876402802610944:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789477489.660184:0:14368:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789477489.660225:0:14368:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d0d74cd0d80 going to sleep for 11 seconds 00000100:00100000:1.0:1789477489.660563:0:14344:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802610944 00000100:00100000:1.0:1789477489.660570:0:14344:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802610944 00000100:00100000:1.0:1789477489.660658:0:14344:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1789477489.660668:0:14344:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d7db7f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:730ef4b7-dbd8-4cb5-9f31-5e7e04ae8864+9:14368:x1876402802610944:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789477489.661067:0:14344:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d7db7f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:730ef4b7-dbd8-4cb5-9f31-5e7e04ae8864+9:14368:x1876402802610944:12345-0@lo:502:llog_process_th.0 Request processed in 399us (895us total) trans 0 rc 0/0 00000100:00100000:1.0:1789477489.661278:0:14344:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1789477489.661451:0:14368:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d6d483100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:730ef4b7-dbd8-4cb5-9f31-5e7e04ae8864:14368:1876402802610944:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1789477489.661488:0:14368:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789477489.661503:0:14368:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789477489.661505:0:14368:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:0.0:1789477489.661511:0:14368:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:0.0:1789477489.661514:0:14368:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1789477489.661530:0:14368:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (ffff9d0d6cf48000) 00000020:00000080:0.0:1789477489.661556:0:14368:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:0.0:1789477489.661560:0:14368:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:0.0:1789477489.661658:0:14368:0:(osd_handler.c:1564:osd_obd_connect()) connect #2 00000020:00000080:0.0:1789477489.661665:0:14368:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xafddb3c8f92826e2 00000020:00000080:0.0:1789477489.661970:0:14368:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:0.0:1789477489.661975:0:14368:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789477489.661979:0:14368:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789477489.661981:0:14368:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:0.0:1789477489.661984:0:14368:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789477489.661987:0:14368:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789477489.661988:0:14368:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:0.0:1789477489.661991:0:14368:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1789477489.661998:0:14368:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (ffff9d0d6cf4cd28) 00000020:00000080:0.0:1789477489.662008:0:14368:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:0.0:1789477489.662012:0:14368:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:0.0:1789477489.662014:0:14368:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:0.0:1789477489.662023:0:14368:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:0.0:1789477489.662030:0:14368:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1789477489.662147:0:14368:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9d0c43499000 from lustre-MDT0000, refs=3 00000020:00000080:0.0:1789477489.662163:0:14368:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (ffff9d0d6cf4b370) 00000020:00000080:0.0:1789477489.662320:0:14368:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:0.0:1789477489.662368:0:14368:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:0.0:1789477489.662374:0:14368:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xafddb3c8f92826f7 00000020:00000080:0.0:1789477489.662473:0:14368:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:0.0:1789477489.662480:0:14368:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:0.0:1789477489.662485:0:14368:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0xafddb3c8f92826fe 00080000:01000000:0.0:1789477489.662490:0:14368:0:(osd_handler.c:1564:osd_obd_connect()) connect #3 00000020:00000080:0.0:1789477489.662494:0:14368:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xafddb3c8f9282705 00010000:00010000:3.0:1789477489.760067:0:14368:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:00000004:3.0:1789477489.760547:0:14368:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 4294967527 00000001:00080000:3.0:1789477489.767559:0:14368:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:3.0:1789477489.768466:0:14368:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (ffff9d0d7c0719b8) 00000020:00000080:3.0:1789477489.768492:0:14368:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:3.0:1789477489.768615:0:14368:0:(osd_handler.c:1564:osd_obd_connect()) connect #4 00000020:00000080:3.0:1789477489.768624:0:14368:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xafddb3c8f9282713 00000020:00000080:3.0:1789477489.787608:0:14368:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:3.0:1789477489.801139:0:14368:0:(genops.c:1385:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0xafddb3c8f928271a 00000020:00000080:3.0:1789477489.803041:0:14368:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:3.0:1789477489.803057:0:14368:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789477489.803066:0:14368:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789477489.803068:0:14368:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:3.0:1789477489.803197:0:14368:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1789477489.803200:0:14368:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #9 00000020:01000000:3.0:1789477489.803202:0:14368:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1789477489.803204:0:14368:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1789477489.803205:0:14368:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1789477489.803209:0:14368:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789477489.803210:0:14368:0:(obd_config.c:1563:class_process_config()) marker 9 (0x6) lustre sys.timeout 00000020:01000000:3.0:1789477489.803213:0:14368:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789477489.803218:0:14368:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789477489.803219:0:14368:0:(obd_config.c:1563:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:3.0:1789477489.803224:0:14368:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:3.0:1789477489.803280:0:14368:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:3.0:1789477489.803295:0:14368:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789477489.803298:0:14368:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789477489.803299:0:14368:0:(obd_config.c:1563:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:3.0:1789477489.803302:0:14368:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1789477489.803305:0:14368:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-mdt1/mdt1 00000020:00000080:3.0:1789477489.803309:0:14368:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789477489.803310:0:14368:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-OST0000 add osc 00000020:00000080:3.0:1789477489.803313:0:14368:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1789477489.803318:0:14368:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.201.123@tcp to nid 0x20000c0a8c97b (192.168.201.123@tcp) 00000020:01000000:3.0:1789477489.803343:0:14368:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:3.0:1789477489.803347:0:14368:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1789477489.803363:0:14368:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff9d0d7c070000) 00000020:00000080:3.0:1789477489.803381:0:14368:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type osp with refcount 2 00000020:00000080:3.0:1789477489.803385:0:14368:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1789477489.803454:0:14368:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:3.0:1789477489.803459:0:14368:0:(osd_handler.c:1564:osd_obd_connect()) connect #5 00000020:00000080:3.0:1789477489.803465:0:14368:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xafddb3c8f9282728 00010000:00080000:3.0:1789477489.803495:0:14368:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9d0d505c1000@lustre-OST0000-osc-MDT0000: add connection 192.168.201.123@tcp at head 00010000:00010000:3.0:1789477489.806307:0:14368:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-1 is initialized 00000040:01000000:3.0:1789477489.809512:0:14368:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:3.0:1789477489.809631:0:14368:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:3.0:1789477489.810654:0:14368:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789477489.810710:0:14368:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].2, 64 off8320 00000040:00080000:3.0:1789477489.811378:0:14368:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1, 64 off8256 00000040:00080000:1.0:1789477489.816953:0:14372:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1789477489.816961:0:14372:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xa:0x0] at index 2 of catalog [0x1:0x2:0x0] 00000020:00000080:3.0:1789477489.817996:0:14368:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1789477489.818012:0:14368:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1789477489.818044:0:14368:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:3.0:1789477489.818064:0:14368:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xafddb3c8f928272f 00000100:00080000:3.0:1789477489.818230:0:14368:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1789477489.818244:0:14368:0:(import.c:625:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9d0d505c1000 using connection 192.168.201.123@tcp/0@lo 00000100:00100000:3.0:1789477489.818291:0:14368:0:(import.c:827:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9d0d58073800 x1876402802611072/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1789477489.818326:0:14368:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:3.0:1789477489.818418:0:14368:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789477489.818423:0:14368:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789477489.818425:0:14368:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-OST0000 add osc 00000020:01000000:3.0:1789477489.818428:0:14368:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1789477489.818431:0:14368:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #16 00000020:01000000:3.0:1789477489.818433:0:14368:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1789477489.818434:0:14368:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1789477489.818436:0:14368:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1789477489.818438:0:14368:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789477489.818440:0:14368:0:(obd_config.c:1563:class_process_config()) marker 16 (0x6) lustre sys.timeout 00000020:01000000:3.0:1789477489.818442:0:14368:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1789477489.818446:0:14368:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-mdt1/mdt1 00000020:00000080:3.0:1789477489.818449:0:14368:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789477489.818451:0:14368:0:(obd_config.c:1563:class_process_config()) marker 18 (0x1) lustre-OST0001 add osc 00000020:00000080:3.0:1789477489.818454:0:14368:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1789477489.818457:0:14368:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.201.123@tcp to nid 0x20000c0a8c97b (192.168.201.123@tcp) 00000020:01000000:3.0:1789477489.818480:0:14368:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:3.0:1789477489.818483:0:14368:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1789477489.818495:0:14368:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff9d0d7c074d28) 00000020:00000080:3.0:1789477489.818506:0:14368:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osp with refcount 2 00000020:00000080:3.0:1789477489.818511:0:14368:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1789477489.818607:0:14368:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:3.0:1789477489.818613:0:14368:0:(osd_handler.c:1564:osd_obd_connect()) connect #6 00000020:00000080:3.0:1789477489.818619:0:14368:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xafddb3c8f928273d 00010000:00080000:3.0:1789477489.818654:0:14368:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9d0d4823f000@lustre-OST0001-osc-MDT0000: add connection 192.168.201.123@tcp at head 00010000:00010000:3.0:1789477489.818858:0:14368:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-2 is initialized 00000100:00100000:0.0:1789477489.819003:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d58073800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3309:1876402802611072:0@lo:8:llog_process_th.0 00000400:00000100:0.0:1789477489.819058:0:3309:0:(lib-move.c:4383:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1876402802611072 offset 0 length 520: 4 00000040:01000000:3.0:1789477489.819420:0:14368:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:3.0:1789477489.819443:0:14368:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:3.0:1789477489.822455:0:14368:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789477489.822540:0:14368:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].2, 64 off8320 00000040:00080000:3.0:1789477489.823360:0:14368:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].1, 64 off8256 00000040:00080000:3.0:1789477489.830561:0:14374:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1789477489.830570:0:14374:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xc:0x0] at index 2 of catalog [0x1:0x5:0x0] 00000020:00000080:3.0:1789477489.849641:0:14368:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1789477489.849657:0:14368:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1789477489.849695:0:14368:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:3.0:1789477489.849715:0:14368:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xafddb3c8f9282744 00000100:00080000:3.0:1789477489.849727:0:14368:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1789477489.849739:0:14368:0:(import.c:625:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9d0d4823f000 using connection 192.168.201.123@tcp/0@lo 00000100:00100000:3.0:1789477489.849782:0:14368:0:(import.c:827:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9d0d58073b80 x1876402802611200/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1789477489.849846:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d58073b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3309:1876402802611200:0@lo:8:llog_process_th.0 00000400:00000100:0.0:1789477489.849904:0:3309:0:(lib-move.c:4383:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1876402802611200 offset 0 length 520: 4 00000100:00080000:3.0:1789477489.849959:0:14368:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:3.0:1789477489.850011:0:14368:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789477489.850015:0:14368:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789477489.850017:0:14368:0:(obd_config.c:1563:class_process_config()) marker 18 (0x2) lustre-OST0001 add osc 00000020:01000000:3.0:1789477489.850021:0:14368:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789477489.850025:0:14368:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789477489.850026:0:14368:0:(obd_config.c:1563:class_process_config()) marker 23 (0x1) lustre sys.timeout 00000020:00000080:3.0:1789477489.850029:0:14368:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1789477489.850031:0:14368:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1789477489.850033:0:14368:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789477489.850035:0:14368:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789477489.850036:0:14368:0:(obd_config.c:1563:class_process_config()) marker 23 (0x2) lustre sys.timeout 00000020:01000000:3.0:1789477489.850039:0:14368:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789477489.850041:0:14368:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789477489.850043:0:14368:0:(obd_config.c:1563:class_process_config()) marker 27 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1789477489.850046:0:14368:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:3.0:1789477489.850084:0:14368:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d58072300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:730ef4b7-dbd8-4cb5-9f31-5e7e04ae8864:14368:1876402802611328:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789477489.850142:0:14368:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789477489.850167:0:14368:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d0d4840cf00 going to sleep for 11 seconds 00000100:00100000:3.0:1789477489.850424:0:14345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802611328 00000100:00100000:3.0:1789477489.850431:0:14345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802611328 00000100:00100000:3.0:1789477489.850503:0:14345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1789477489.850512:0:14345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d7db7fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:730ef4b7-dbd8-4cb5-9f31-5e7e04ae8864+9:14368:x1876402802611328:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789477489.850771:0:14345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d7db7fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:730ef4b7-dbd8-4cb5-9f31-5e7e04ae8864+9:14368:x1876402802611328:12345-0@lo:502:llog_process_th.0 Request processed in 259us (628us total) trans 0 rc 0/0 00000100:00100000:3.0:1789477489.850779:0:14345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1789477489.857436:0:14368:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d58072300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:730ef4b7-dbd8-4cb5-9f31-5e7e04ae8864:14368:1876402802611328:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1789477489.857488:0:14368:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789477489.857499:0:14368:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789477489.857502:0:14368:0:(obd_config.c:1563:class_process_config()) marker 27 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1789477489.857507:0:14368:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 37 count 37 00000020:01000000:1.0:1789477489.862059:0:14332:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-36 (rc=0) 10000000:01000000:1.0:1789477489.862103:0:14332:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.123@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:1.0:1789477489.862127:0:14332:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.123@tcp lock: ffff9d0d7f519400/0xafddb3c8f92826cd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xafddb3c8f92826d4 expref: -99 pid: 14332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477489.862139:0:14332:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.123@tcp lock: ffff9d0d7f519400/0xafddb3c8f92826cd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xafddb3c8f92826d4 expref: -99 pid: 14332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789477489.862147:0:14332:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9d0c43499000 from 1 10000000:01000000:1.0:1789477489.862150:0:14332:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1789477489.862206:0:14332:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.123@tcp lock: ffff9d0d7f518600/0xafddb3c8f928274b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477489.862214:0:14332:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.123@tcp lock: ffff9d0d7f518600/0xafddb3c8f928274b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477489.862246:0:14332:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.123@tcp lock: ffff9d0d7f518600/0xafddb3c8f928274b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789477489.862271:0:14332:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d7f702a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:730ef4b7-dbd8-4cb5-9f31-5e7e04ae8864:14332:1876402802611456:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1789477489.862348:0:14332:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789477489.862394:0:14332:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d0d50a1e180 going to sleep for 11 seconds 00000100:00100000:3.0:1789477489.862720:0:14343:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802611456 00000100:00100000:3.0:1789477489.862728:0:14343:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802611456 00000100:00100000:3.0:1789477489.862783:0:14343:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1789477489.862792:0:14343:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d7db7cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:730ef4b7-dbd8-4cb5-9f31-5e7e04ae8864+9:14332:x1876402802611456:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789477489.862805:0:14343:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789477489.862820:0:14343:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d0d49ecae00/0xafddb3c8f9282752 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xafddb3c8f928274b expref: -99 pid: 14343 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477489.862845:0:14343:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d0d49ecae00/0xafddb3c8f9282752 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xafddb3c8f928274b expref: 10 pid: 14343 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477489.862856:0:14343:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d0d49ecae00/0xafddb3c8f9282752 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xafddb3c8f928274b expref: 10 pid: 14343 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477489.862864:0:14343:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d0d49ecae00, rc 0) 00000100:00100000:3.0:1789477489.862925:0:14343:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d7db7cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:730ef4b7-dbd8-4cb5-9f31-5e7e04ae8864+10:14332:x1876402802611456:12345-0@lo:101:mount.lustre.0 Request processed in 134us (577us total) trans 0 rc 0/0 00000100:00100000:3.0:1789477489.862932:0:14343:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1789477489.863012:0:14332:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d7f702a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:730ef4b7-dbd8-4cb5-9f31-5e7e04ae8864:14332:1876402802611456:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789477489.863026:0:14332:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.123@tcp lock: ffff9d0d7f518600/0xafddb3c8f928274b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xafddb3c8f9282752 expref: -99 pid: 14332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477489.863037:0:14332:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.123@tcp lock: ffff9d0d7f518600/0xafddb3c8f928274b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xafddb3c8f9282752 expref: -99 pid: 14332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789477489.863563:0:14332:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d6d483100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:730ef4b7-dbd8-4cb5-9f31-5e7e04ae8864:14332:1876402802611584:0@lo:256:mount.lustre.0 00000100:00100000:0.0:1789477489.863645:0:14332:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789477489.863666:0:14332:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d0d74cd0540 going to sleep for 11 seconds 00000100:00100000:3.0:1789477489.863976:0:14345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802611584 00000100:00100000:3.0:1789477489.863981:0:14345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802611584 00000100:00100000:3.0:1789477489.864016:0:14345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1789477489.864029:0:14345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d7db7c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:730ef4b7-dbd8-4cb5-9f31-5e7e04ae8864+10:14332:x1876402802611584:12345-0@lo:256:mount.lustre.0 20000000:01000000:3.0:1789477489.864042:0:14345:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:3.0:1789477489.864048:0:14345:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:3.0:1789477489.864113:0:14345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d7db7c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:730ef4b7-dbd8-4cb5-9f31-5e7e04ae8864+10:14332:x1876402802611584:12345-0@lo:256:mount.lustre.0 Request processed in 85us (468us total) trans 0 rc 0/0 00000100:00100000:3.0:1789477489.864120:0:14345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1789477489.864368:0:14332:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d6d483100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:730ef4b7-dbd8-4cb5-9f31-5e7e04ae8864:14332:1876402802611584:0@lo:256:mount.lustre.0 10000000:01000000:0.0:1789477489.864933:0:14332:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.123@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1789477489.864946:0:14332:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.123@tcp lock: ffff9d0d7f518600/0xafddb3c8f928274b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xafddb3c8f9282752 expref: -99 pid: 14332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477489.864957:0:14332:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.123@tcp lock: ffff9d0d7f518600/0xafddb3c8f928274b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xafddb3c8f9282752 expref: -99 pid: 14332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789477489.864966:0:14332:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9d0c43499000 from 1 10000000:01000000:0.0:1789477489.864969:0:14332:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1789477489.864994:0:14332:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.123@tcp lock: ffff9d0d50be4400/0xafddb3c8f9282759 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477489.865001:0:14332:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.123@tcp lock: ffff9d0d50be4400/0xafddb3c8f9282759 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477489.865010:0:14332:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.123@tcp lock: ffff9d0d50be4400/0xafddb3c8f9282759 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789477489.865023:0:14332:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d6d483100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:730ef4b7-dbd8-4cb5-9f31-5e7e04ae8864:14332:1876402802611712:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1789477489.865052:0:14332:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789477489.865088:0:14332:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d0d74cd0540 going to sleep for 11 seconds 00000100:00100000:3.0:1789477489.865369:0:14345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802611712 00000100:00100000:3.0:1789477489.865380:0:14345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802611712 00000100:00100000:3.0:1789477489.865413:0:14345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1789477489.865420:0:14345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d7db7e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:730ef4b7-dbd8-4cb5-9f31-5e7e04ae8864+10:14332:x1876402802611712:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789477489.865429:0:14345:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789477489.865441:0:14345:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d0d49eca600/0xafddb3c8f9282760 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xafddb3c8f9282759 expref: -99 pid: 14345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477489.865459:0:14345:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d0d49eca600/0xafddb3c8f9282760 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xafddb3c8f9282759 expref: 11 pid: 14345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477489.865468:0:14345:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d0d49eca600/0xafddb3c8f9282760 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xafddb3c8f9282759 expref: 11 pid: 14345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477489.865476:0:14345:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d0d49eca600, rc 0) 00000100:00100000:3.0:1789477489.865505:0:14345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d7db7e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:730ef4b7-dbd8-4cb5-9f31-5e7e04ae8864+11:14332:x1876402802611712:12345-0@lo:101:mount.lustre.0 Request processed in 86us (452us total) trans 0 rc 0/0 00000100:00100000:3.0:1789477489.865511:0:14345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1789477489.865871:0:14332:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d6d483100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:730ef4b7-dbd8-4cb5-9f31-5e7e04ae8864:14332:1876402802611712:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789477489.865885:0:14332:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.123@tcp lock: ffff9d0d50be4400/0xafddb3c8f9282759 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xafddb3c8f9282760 expref: -99 pid: 14332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477489.865920:0:14332:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.123@tcp lock: ffff9d0d50be4400/0xafddb3c8f9282759 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xafddb3c8f9282760 expref: -99 pid: 14332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789477489.865973:0:14332:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d6d483100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:730ef4b7-dbd8-4cb5-9f31-5e7e04ae8864:14332:1876402802611840:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789477489.865999:0:14332:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789477489.866024:0:14332:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d0d74cd0540 going to sleep for 11 seconds 00000100:00100000:3.0:1789477489.866152:0:14345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802611840 00000100:00100000:3.0:1789477489.866157:0:14345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802611840 00000100:00100000:3.0:1789477489.866194:0:14345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1789477489.866201:0:14345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d7db7e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:730ef4b7-dbd8-4cb5-9f31-5e7e04ae8864+11:14332:x1876402802611840:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789477489.866631:0:14345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d7db7e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:730ef4b7-dbd8-4cb5-9f31-5e7e04ae8864+11:14332:x1876402802611840:12345-0@lo:501:mount.lustre.0 Request processed in 430us (630us total) trans 0 rc 0/0 00000100:00100000:3.0:1789477489.866639:0:14345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1789477489.866868:0:14332:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d6d483100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:730ef4b7-dbd8-4cb5-9f31-5e7e04ae8864:14332:1876402802611840:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789477489.866911:0:14332:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d6d483100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:730ef4b7-dbd8-4cb5-9f31-5e7e04ae8864:14332:1876402802611968:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1789477489.866946:0:14332:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789477489.866972:0:14332:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d0d74cd0540 going to sleep for 11 seconds 00000100:00100000:3.0:1789477489.867104:0:14343:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802611968 00000100:00100000:3.0:1789477489.867109:0:14343:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802611968 00000100:00100000:3.0:1789477489.867143:0:14343:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1789477489.867149:0:14343:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d7db7d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:730ef4b7-dbd8-4cb5-9f31-5e7e04ae8864+11:14332:x1876402802611968:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1789477489.867500:0:14343:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d7db7d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:730ef4b7-dbd8-4cb5-9f31-5e7e04ae8864+11:14332:x1876402802611968:12345-0@lo:503:mount.lustre.0 Request processed in 350us (552us total) trans 0 rc 0/0 00000100:00100000:3.0:1789477489.867507:0:14343:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1789477489.868994:0:14332:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d6d483100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:730ef4b7-dbd8-4cb5-9f31-5e7e04ae8864:14332:1876402802611968:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1789477489.871224:0:14376:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d58071500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:730ef4b7-dbd8-4cb5-9f31-5e7e04ae8864:14376:1876402802612096:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789477489.871307:0:14376:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789477489.871352:0:14376:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d0d4840c600 going to sleep for 11 seconds 00000100:00100000:1.0:1789477489.871674:0:14344:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802612096 00000100:00100000:1.0:1789477489.871685:0:14344:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802612096 00000100:00100000:1.0:1789477489.871734:0:14344:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1789477489.871743:0:14344:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d7db7d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:730ef4b7-dbd8-4cb5-9f31-5e7e04ae8864+11:14376:x1876402802612096:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789477489.872033:0:14344:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d7db7d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:730ef4b7-dbd8-4cb5-9f31-5e7e04ae8864+11:14376:x1876402802612096:12345-0@lo:502:llog_process_th.0 Request processed in 290us (726us total) trans 0 rc 0/0 00000100:00100000:1.0:1789477489.872041:0:14344:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1789477489.872288:0:14376:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d58071500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:730ef4b7-dbd8-4cb5-9f31-5e7e04ae8864:14376:1876402802612096:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1789477489.872318:0:14376:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789477489.872329:0:14376:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789477489.872331:0:14376:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1789477489.872338:0:14376:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9d0c43499000 00000020:00000080:2.0:1789477489.872341:0:14376:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1789477489.872349:0:14376:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789477489.872352:0:14376:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789477489.872353:0:14376:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:2.0:1789477489.872363:0:14376:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789477489.872366:0:14376:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789477489.872368:0:14376:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1789477489.872371:0:14376:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9d0c43499000 00000020:00000080:2.0:1789477489.872373:0:14376:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1789477489.872453:0:14376:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789477489.872457:0:14376:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789477489.872458:0:14376:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:2.0:1789477489.872461:0:14376:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789477489.872464:0:14376:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789477489.872465:0:14376:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1789477489.872468:0:14376:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9d0c43499000 00000020:00000080:2.0:1789477489.872471:0:14376:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1789477489.872508:0:14376:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d7523d500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:730ef4b7-dbd8-4cb5-9f31-5e7e04ae8864:14376:1876402802612224:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789477489.872547:0:14376:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789477489.872607:0:14376:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d0d48ea8180 going to sleep for 11 seconds 00000100:00100000:1.0:1789477489.872816:0:14343:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802612224 00000100:00100000:1.0:1789477489.872821:0:14343:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802612224 00000100:00100000:1.0:1789477489.872859:0:14343:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1789477489.872866:0:14343:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d7db7c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:730ef4b7-dbd8-4cb5-9f31-5e7e04ae8864+11:14376:x1876402802612224:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789477489.872996:0:14343:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d7db7c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:730ef4b7-dbd8-4cb5-9f31-5e7e04ae8864+11:14376:x1876402802612224:12345-0@lo:502:llog_process_th.0 Request processed in 130us (448us total) trans 0 rc 0/0 00000100:00100000:1.0:1789477489.873003:0:14343:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1789477489.874767:0:14376:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d7523d500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:730ef4b7-dbd8-4cb5-9f31-5e7e04ae8864:14376:1876402802612224:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1789477489.874807:0:14376:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789477489.874815:0:14376:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789477489.874818:0:14376:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:2.0:1789477489.874823:0:14376:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:1.0:1789477489.874967:0:14332:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:1.0:1789477489.874986:0:14332:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.123@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1789477489.875007:0:14332:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.123@tcp lock: ffff9d0d50be4400/0xafddb3c8f9282759 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xafddb3c8f9282760 expref: -99 pid: 14332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477489.875029:0:14332:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.123@tcp lock: ffff9d0d50be4400/0xafddb3c8f9282759 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xafddb3c8f9282760 expref: -99 pid: 14332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789477489.875084:0:14332:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1789477489.875088:0:14332:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9d0c43499000 10000000:01000000:1.0:1789477489.875090:0:14332:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9d0c43499000 10000000:01000000:1.0:1789477489.875094:0:14332:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1789477489.875100:0:14332:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9d0c43499000 from 1 10000000:01000000:1.0:1789477489.875103:0:14332:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1789477489.875135:0:14332:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.123@tcp lock: ffff9d0d7f518c00/0xafddb3c8f9282767 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477489.875143:0:14332:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.123@tcp lock: ffff9d0d7f518c00/0xafddb3c8f9282767 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477489.875162:0:14332:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.123@tcp lock: ffff9d0d7f518c00/0xafddb3c8f9282767 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789477489.875181:0:14332:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d7f700000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:730ef4b7-dbd8-4cb5-9f31-5e7e04ae8864:14332:1876402802612352:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1789477489.875234:0:14332:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789477489.875271:0:14332:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d0d50a1e3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789477489.875300:0:14345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802612352 00000100:00100000:3.0:1789477489.875305:0:14345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802612352 00000100:00100000:3.0:1789477489.875347:0:14345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1789477489.875356:0:14345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d7db7e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:730ef4b7-dbd8-4cb5-9f31-5e7e04ae8864+11:14332:x1876402802612352:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789477489.875370:0:14345:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789477489.875383:0:14345:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d0d49ecba00/0xafddb3c8f928276e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xafddb3c8f9282767 expref: -99 pid: 14345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477489.875405:0:14345:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d0d49ecba00/0xafddb3c8f928276e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xafddb3c8f9282767 expref: 12 pid: 14345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477489.875416:0:14345:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d0d49ecba00/0xafddb3c8f928276e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xafddb3c8f9282767 expref: 12 pid: 14345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477489.875436:0:14345:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d0d49ecba00, rc 0) 00000100:00100000:3.0:1789477489.875481:0:14345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d7db7e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:730ef4b7-dbd8-4cb5-9f31-5e7e04ae8864+12:14332:x1876402802612352:12345-0@lo:101:mount.lustre.0 Request processed in 126us (246us total) trans 0 rc 0/0 00000100:00100000:3.0:1789477489.875487:0:14345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1789477489.875570:0:14332:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d7f700000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:730ef4b7-dbd8-4cb5-9f31-5e7e04ae8864:14332:1876402802612352:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789477489.875606:0:14332:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.123@tcp lock: ffff9d0d7f518c00/0xafddb3c8f9282767 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xafddb3c8f928276e expref: -99 pid: 14332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477489.875616:0:14332:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.123@tcp lock: ffff9d0d7f518c00/0xafddb3c8f9282767 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xafddb3c8f928276e expref: -99 pid: 14332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789477489.875677:0:14332:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d7f700000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:730ef4b7-dbd8-4cb5-9f31-5e7e04ae8864:14332:1876402802612480:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789477489.875701:0:14332:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789477489.875719:0:14332:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d0d50a1e3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789477489.875997:0:14344:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802612480 00000100:00100000:2.0:1789477489.876001:0:14344:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802612480 00000100:00100000:2.0:1789477489.876035:0:14344:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1789477489.876043:0:14344:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d7db7dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:730ef4b7-dbd8-4cb5-9f31-5e7e04ae8864+12:14332:x1876402802612480:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789477489.876301:0:14344:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d7db7dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:730ef4b7-dbd8-4cb5-9f31-5e7e04ae8864+12:14332:x1876402802612480:12345-0@lo:501:mount.lustre.0 Request processed in 258us (597us total) trans 0 rc 0/0 00000100:00100000:2.0:1789477489.876307:0:14344:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1789477489.876450:0:14332:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d7f700000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:730ef4b7-dbd8-4cb5-9f31-5e7e04ae8864:14332:1876402802612480:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789477489.876476:0:14332:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d7f700000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:730ef4b7-dbd8-4cb5-9f31-5e7e04ae8864:14332:1876402802612608:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1789477489.876513:0:14332:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789477489.876535:0:14332:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d0d50a1e3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789477489.876560:0:14345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802612608 00000100:00100000:2.0:1789477489.876570:0:14345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802612608 00000100:00100000:2.0:1789477489.876621:0:14345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1789477489.876628:0:14345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d7db7d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:730ef4b7-dbd8-4cb5-9f31-5e7e04ae8864+12:14332:x1876402802612608:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1789477489.876771:0:14345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d7db7d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:730ef4b7-dbd8-4cb5-9f31-5e7e04ae8864+12:14332:x1876402802612608:12345-0@lo:503:mount.lustre.0 Request processed in 143us (257us total) trans 0 rc 0/0 00000100:00100000:2.0:1789477489.876778:0:14345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1789477489.876780:0:14332:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d7f700000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:730ef4b7-dbd8-4cb5-9f31-5e7e04ae8864:14332:1876402802612608:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1789477489.878419:0:14378:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d7523d500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:730ef4b7-dbd8-4cb5-9f31-5e7e04ae8864:14378:1876402802612736:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789477489.878481:0:14378:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789477489.878523:0:14378:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d0d48ea8540 going to sleep for 11 seconds 00000100:00100000:1.0:1789477489.878612:0:14343:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802612736 00000100:00100000:1.0:1789477489.878619:0:14343:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802612736 00000100:00100000:1.0:1789477489.878733:0:14343:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1789477489.878742:0:14343:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d7db7f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:730ef4b7-dbd8-4cb5-9f31-5e7e04ae8864+12:14378:x1876402802612736:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789477489.879000:0:14343:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d7db7f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:730ef4b7-dbd8-4cb5-9f31-5e7e04ae8864+12:14378:x1876402802612736:12345-0@lo:502:llog_process_th.0 Request processed in 258us (518us total) trans 0 rc 0/0 00000100:00100000:1.0:1789477489.879009:0:14343:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1789477489.879032:0:14378:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d7523d500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:730ef4b7-dbd8-4cb5-9f31-5e7e04ae8864:14378:1876402802612736:0@lo:502:llog_process_th.0 00000020:01000004:2.0:1789477489.879090:0:14378:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:2.0:1789477489.879105:0:14378:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (ffff9d0d75444d28) 00000020:00000080:2.0:1789477489.879122:0:14378:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type lwp with refcount 2 00000020:01000004:2.0:1789477489.879997:0:14378:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9d0c43499000 from lustre-MDT0000, refs=4 00000020:01000004:2.0:1789477489.880003:0:14378:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9d0c43499000 from lustre-MDT0000, refs=4 00000020:01000004:2.0:1789477489.880006:0:14378:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9d0c43499000 4 00010000:00080000:2.0:1789477489.880036:0:14378:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9d0d482aa000@lustre-MDT0000-lwp-MDT0000: add connection 192.168.201.123@tcp at head 00010000:00010000:2.0:1789477489.886796:0:14378:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-3 is initialized 00000020:00000080:2.0:1789477489.887029:0:14378:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:2.0:1789477489.887066:0:14378:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1789477489.887082:0:14378:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0xafddb3c8f928277c 00000100:00080000:2.0:1789477489.887094:0:14378:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1789477489.887107:0:14378:0:(import.c:625:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff9d0d482aa000 using connection 192.168.201.123@tcp/0@lo 00000100:00100000:2.0:1789477489.887143:0:14378:0:(import.c:827:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9d0d7523d500 x1876402802612864/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1789477489.887204:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d7523d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3309:1876402802612864:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1789477489.887277:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1789477489.887344:0:14378:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:2.0:1789477489.887827:0:14378:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d7523ce00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:730ef4b7-dbd8-4cb5-9f31-5e7e04ae8864:14378:1876402802612992:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789477489.887870:0:14378:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789477489.887892:0:14345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802612992 00000100:00100000:0.0:1789477489.887897:0:14350:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802612864 00000100:00100000:2.0:1789477489.887898:0:14345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802612992 00000100:00100000:0.0:1789477489.887900:0:14350:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802612864 00000100:00100000:2.0:1789477489.887928:0:14345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1789477489.887928:0:14350:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789477489.887935:0:14350:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d7523ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3309:x1876402802612864:12345-0@lo:38:llog_process_th.0 00000100:00100000:2.0:1789477489.887936:0:14345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d7db7f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:730ef4b7-dbd8-4cb5-9f31-5e7e04ae8864+12:14378:x1876402802612992:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789477489.887985:0:14350:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d7523ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3309:x1876402802612864:12345-0@lo:38:llog_process_th.0 Request processed in 49us (708us total) trans 0 rc -11/-11 00000100:00100000:0.0:1789477489.887992:0:14350:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789477489.888025:0:3309:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1789477489.888033:0:3309:0:(import.c:65:import_set_state_nolock()) ffff9d0d482aa000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1789477489.888036:0:3309:0:(import.c:1512:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:0.0:1789477489.888039:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d7523d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3309:1876402802612864:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1789477489.888158:0:14345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d7db7f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:730ef4b7-dbd8-4cb5-9f31-5e7e04ae8864+12:14378:x1876402802612992:12345-0@lo:502:llog_process_th.0 Request processed in 221us (287us total) trans 0 rc 0/0 00000100:00100000:2.0:1789477489.888165:0:14345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1789477489.888221:0:14378:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d0d48ea8840 going to sleep for 11 seconds 00000100:00100000:2.0:1789477489.888240:0:14378:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d7523ce00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:730ef4b7-dbd8-4cb5-9f31-5e7e04ae8864:14378:1876402802612992:0@lo:502:llog_process_th.0 00000040:00080000:2.0:1789477489.888261:0:14378:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:3.0:1789477489.890386:0:14332:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:3.0:1789477489.890418:0:14332:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.123@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1789477489.890437:0:14332:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.123@tcp lock: ffff9d0d7f518c00/0xafddb3c8f9282767 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xafddb3c8f928276e expref: -99 pid: 14332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477489.890450:0:14332:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.123@tcp lock: ffff9d0d7f518c00/0xafddb3c8f9282767 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xafddb3c8f928276e expref: -99 pid: 14332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1789477489.890497:0:14332:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1789477489.890499:0:14332:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1789477489.890500:0:14332:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789477489.890501:0:14332:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789477489.890503:0:14332:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789477489.890504:0:14332:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789477489.890506:0:14332:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1789477489.890507:0:14332:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1789477489.890509:0:14332:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789477489.890511:0:14332:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1789477489.890514:0:14332:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020005 00000020:01000004:3.0:1789477489.890517:0:14332:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1789477489.890518:0:14332:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1789477489.890520:0:14332:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789477489.890521:0:14332:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789477489.890522:0:14332:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789477489.890523:0:14332:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789477489.890524:0:14332:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1789477489.890525:0:14332:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1789477489.890526:0:14332:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789477489.890527:0:14332:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1789477489.890552:0:14332:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:3.0:1789477489.890568:0:14332:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d58070e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:730ef4b7-dbd8-4cb5-9f31-5e7e04ae8864:14332:1876402802613120:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1789477489.890658:0:14332:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789477489.890699:0:14332:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d0d7c401300 going to sleep for 11 seconds 00000100:00100000:1.0:1789477489.890856:0:14343:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802613120 00000100:00100000:1.0:1789477489.890863:0:14343:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802613120 00000100:00100000:1.0:1789477489.890907:0:14343:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1789477489.890917:0:14343:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d6cd23450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:730ef4b7-dbd8-4cb5-9f31-5e7e04ae8864+12:14332:x1876402802613120:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1789477489.890944:0:14343:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:1.0:1789477489.890963:0:14343:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:1.0:1789477489.971162:0:14343:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1789477489.971185:0:14343:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:2.0:1789477489.971252:0:14366:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1789477489.971258:0:14366:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1789477489.971281:0:14366:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9d0d50416800/0xafddb3c8f9282783 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477489.971301:0:14366:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9d0d49ecae00/0xafddb3c8f9282752 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xafddb3c8f928274b expref: 12 pid: 14343 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477489.971311:0:14366:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9d0d50416800/0xafddb3c8f9282783 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477489.971361:0:14366:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9d0d49ecae00/0xafddb3c8f9282752 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xafddb3c8f928274b expref: 12 pid: 14343 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477489.971399:0:14366:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9d0d49ecae00/0xafddb3c8f9282752 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xafddb3c8f928274b expref: 12 pid: 14343 timeout: 535 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789477489.971418:0:14366:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d7523ce00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14366:1876402802613248:0@lo:104: 00000100:00100000:2.0:1789477489.971506:0:14366:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789477489.971603:0:14366:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d0d7fb8d300 going to sleep for 11 seconds 00000100:00100000:0.0:1789477489.972704:0:14333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802613248 00000100:00100000:0.0:1789477489.972716:0:14333:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802613248 00000100:00100000:0.0:1789477489.972777:0:14333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789477489.972790:0:14333:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d7523d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:730ef4b7-dbd8-4cb5-9f31-5e7e04ae8864+3:14366:x1876402802613248:12345-0@lo:104: 00010000:00010000:0.0:1789477489.972816:0:14333:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.123@tcp lock: ffff9d0d7f518600/0xafddb3c8f928274b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xafddb3c8f9282752 expref: -99 pid: 14332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477489.972901:0:14333:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1789477489.972907:0:14333:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d7523d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:730ef4b7-dbd8-4cb5-9f31-5e7e04ae8864+3:14366:x1876402802613248:12345-0@lo:104: Request processed in 122us (1402us total) trans 0 rc 0/0 00000100:00100000:0.0:1789477489.972914:0:14333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:0.0:1789477489.972936:0:14339:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789477489.972942:0:14339:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.123@tcp lock: ffff9d0d7f518600/0xafddb3c8f928274b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xafddb3c8f9282752 expref: -99 pid: 14332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477489.972950:0:14339:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d0d7f518600 already unused, calling callback (ffffffffc1bb3c20) 10000000:00010000:0.0:1789477489.972955:0:14339:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.123@tcp lock: ffff9d0d7f518600/0xafddb3c8f928274b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xafddb3c8f9282752 expref: -99 pid: 14332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477489.972963:0:14339:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.123@tcp lock: ffff9d0d7f518600/0xafddb3c8f928274b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xafddb3c8f9282752 expref: -99 pid: 14332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789477489.972970:0:14339:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.123@tcp lock: ffff9d0d7f518600/0xafddb3c8f928274b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xafddb3c8f9282752 expref: -99 pid: 14332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789477489.972975:0:14339:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1789477489.973005:0:14339:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.123@tcp lock: ffff9d0d7f518600/0xafddb3c8f928274b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xafddb3c8f9282752 expref: -99 pid: 14332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477489.973011:0:14339:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789477489.973030:0:14339:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.123@tcp lock: ffff9d0d7f518600/0xafddb3c8f928274b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xafddb3c8f9282752 expref: -99 pid: 14332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477489.973035:0:14339:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.123@tcp lock: ffff9d0d7f518600/0xafddb3c8f928274b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xafddb3c8f9282752 expref: -99 pid: 14332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477489.973058:0:14339:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789477489.973060:0:14339:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789477489.973062:0:14339:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789477489.973100:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d6d480700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:730ef4b7-dbd8-4cb5-9f31-5e7e04ae8864:3311:1876402802613376:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789477489.973137:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789477489.973217:0:14335:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802613376 00000100:00100000:0.0:1789477489.973221:0:14335:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802613376 00010000:00010000:0.0:1789477489.973239:0:14335:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9d0d49ecae00/0xafddb3c8f9282752 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xafddb3c8f928274b expref: 13 pid: 14343 timeout: 535 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789477489.973261:0:14335:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789477489.973267:0:14335:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d6d480000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:730ef4b7-dbd8-4cb5-9f31-5e7e04ae8864+13:3311:x1876402802613376:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789477489.973277:0:14335:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789477489.973283:0:14335:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9d0d49ecae00/0xafddb3c8f9282752 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xafddb3c8f928274b expref: 13 pid: 14343 timeout: 535 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477489.973293:0:14335:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9d0d49ecae00/0xafddb3c8f9282752 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xafddb3c8f928274b expref: 13 pid: 14343 timeout: 535 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477489.973310:0:14335:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9d0d50416800/0xafddb3c8f9282783 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477489.973318:0:14335:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d0d50416800/0xafddb3c8f9282783 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1789477489.973331:0:14335:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.002074786s 00010000:00010000:0.0:1789477489.973336:0:14335:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9d0d50416800/0xafddb3c8f9282783 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477489.973352:0:14335:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9d0d50416800/0xafddb3c8f9282783 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477489.973360:0:14335:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9d0d50416800/0xafddb3c8f9282783 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477489.973366:0:14335:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9d0d50416800/0xafddb3c8f9282783 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477489.973371:0:14335:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d0d50416800 already unused, calling callback (ffffffffc15972a0) 00010000:00010000:0.0:1789477489.973376:0:14335:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9d0d50416800/0xafddb3c8f9282783 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477489.973383:0:14335:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9d0d50416800/0xafddb3c8f9282783 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477489.973390:0:14335:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9d0d50416800/0xafddb3c8f9282783 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477489.973400:0:14335:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789477489.973428:0:14335:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d6d480000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:730ef4b7-dbd8-4cb5-9f31-5e7e04ae8864+13:3311:x1876402802613376:12345-0@lo:103:ldlm_bl.0 Request processed in 162us (292us total) trans 0 rc 0/0 00000100:00100000:0.0:1789477489.973435:0:14335:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789477489.973468:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d6d480700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:730ef4b7-dbd8-4cb5-9f31-5e7e04ae8864:3311:1876402802613376:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789477489.973728:0:14366:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d0d49ecae00/0xafddb3c8f9282752 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xafddb3c8f928274b expref: 12 pid: 14343 timeout: 535 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789477489.973756:0:14366:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d7523ce00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14366:1876402802613248:0@lo:104: 00010000:00010000:1.0:1789477489.973772:0:14366:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9d0d50416800/0xafddb3c8f9282783 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477489.973782:0:14366:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9d0d50416800/0xafddb3c8f9282783 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477489.973789:0:14366:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9d0d50416800/0xafddb3c8f9282783 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477489.973795:0:14366:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d0d50416800/0xafddb3c8f9282783 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789477489.978925:0:14343:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d6cd23450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:730ef4b7-dbd8-4cb5-9f31-5e7e04ae8864+11:14332:x1876402802613120:12345-0@lo:253:mount.lustre.0 Request processed in 87998us (88255us total) trans 0 rc 0/0 00000100:00100000:1.0:1789477489.978942:0:14343:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1789477489.979064:0:14332:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d58070e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:730ef4b7-dbd8-4cb5-9f31-5e7e04ae8864:14332:1876402802613120:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1789477489.979094:0:14332:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:3.0:1789477489.979098:0:14332:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1789477489.979099:0:14332:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1789477489.979101:0:14332:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789477489.979102:0:14332:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789477489.979103:0:14332:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789477489.979104:0:14332:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789477489.979106:0:14332:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1789477489.979107:0:14332:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1789477489.979109:0:14332:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789477489.979110:0:14332:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1789477489.979130:0:14332:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:2.0:1789477489.984059:0:14332:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/8/4) registered 00080000:10000000:2.0:1789477489.984368:0:14332:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:2.0:1789477489.984870:0:14332:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00080000:10000000:2.0:1789477489.985031:0:14332:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:2.0:1789477489.985364:0:14332:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/8/4) registered 00080000:10000000:2.0:1789477489.985522:0:14332:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00080000:10000000:2.0:1789477489.986313:0:14332:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/8/4) registered 00080000:10000000:2.0:1789477489.986467:0:14332:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8/1) registered 00080000:10000000:2.0:1789477489.986911:0:14332:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/8/4) registered 00080000:10000000:2.0:1789477489.987147:0:14332:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8/1) registered 00080000:10000000:2.0:1789477489.987406:0:14332:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xf:0x0] (8/8/4) registered 00080000:10000000:2.0:1789477489.987562:0:14332:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8/1) registered 00000020:00080000:2.0:1789477490.005129:0:14332:0:(update_trans.c:1496:distribute_txn_commit_batchid_init()) lustre-MDT0000: committed batchid 8 00000040:01000000:2.0:1789477490.005611:0:14332:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000040:01000000:2.0:1789477490.005871:0:14391:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:00080000:2.0:1789477490.005940:0:14391:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1789477490.008047:0:14391:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:2.0:1789477490.008148:0:14391:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:2.0:1789477490.008153:0:14391:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00000040:01000000:3.0:1789477490.010570:0:14332:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:3.0:1789477490.010718:0:14332:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:3.0:1789477490.011180:0:14332:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:3.0:1789477490.011188:0:14332:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:3.0:1789477490.011310:0:14332:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000020:00080000:1.0:1789477490.012374:0:14390:0:(update_trans.c:1539:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 8 00000020:00080000:1.0:1789477490.012381:0:14390:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000040:00080000:3.0:1789477490.013973:0:14332:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:3.0:1789477490.015477:0:14332:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:2.0:1789477490.015820:0:14332:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00080000:10000000:2.0:1789477490.017966:0:14332:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x36:0x0] (8/8/4) registered 00000001:00000004:0.0:1789477490.025244:0:14332:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000001:00080000:3.0:1789477490.060784:0:14332:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:3.0:1789477490.060825:0:14332:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffbc0b81db7988 00100000:10000000:3.0:1789477490.060835:0:14332:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:1.0:1789477490.061767:0:14332:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1789477490.061784:0:14332:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.201.123@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1789477490.061800:0:14332:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=46 00000080:00000004:1.0:1789477490.061832:0:14332:0:(super25.c:182:lustre_fill_super()) lustre-mdt1/mdt1: Mount complete 00010000:00010000:3.0:1789477490.479926:0:14338:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1789477490.936702:0:14385:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 10000000:01000000:2.0:1789477491.440281:0:14347:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1789477491.440290:0:14347:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9d0c43499000 from 6 10000000:01000000:2.0:1789477491.440296:0:14347:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1789477491.440346:0:14347:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.123@tcp lock: ffff9d0d50417a00/0xafddb3c8f928278a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477491.440359:0:14347:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.123@tcp lock: ffff9d0d50417a00/0xafddb3c8f928278a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477491.440373:0:14347:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.123@tcp lock: ffff9d0d50417a00/0xafddb3c8f928278a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789477491.440400:0:14347:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d7523e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:730ef4b7-dbd8-4cb5-9f31-5e7e04ae8864:14347:1876402802613504:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789477491.440521:0:14347:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789477491.440566:0:14347:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d0d462433c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789477491.440602:0:14344:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802613504 00000100:00100000:2.0:1789477491.440609:0:14344:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802613504 00000100:00100000:2.0:1789477491.440658:0:14344:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1789477491.440667:0:14344:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d7b09b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:730ef4b7-dbd8-4cb5-9f31-5e7e04ae8864+11:14347:x1876402802613504:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789477491.440680:0:14344:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789477491.440693:0:14344:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d0d50417e00/0xafddb3c8f9282791 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xafddb3c8f928278a expref: -99 pid: 14344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477491.440716:0:14344:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d0d50417e00/0xafddb3c8f9282791 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xafddb3c8f928278a expref: 12 pid: 14344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477491.440738:0:14344:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d0d50417e00/0xafddb3c8f9282791 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xafddb3c8f928278a expref: 12 pid: 14344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477491.440764:0:14344:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d0d50417e00, rc 0) 00000100:00100000:2.0:1789477491.440801:0:14344:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d7b09b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:730ef4b7-dbd8-4cb5-9f31-5e7e04ae8864+12:14347:x1876402802613504:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 135us (280us total) trans 0 rc 0/0 00000100:00100000:2.0:1789477491.440808:0:14344:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1789477491.440853:0:14347:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d7523e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:730ef4b7-dbd8-4cb5-9f31-5e7e04ae8864:14347:1876402802613504:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789477491.440867:0:14347:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.123@tcp lock: ffff9d0d50417a00/0xafddb3c8f928278a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xafddb3c8f9282791 expref: -99 pid: 14347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477491.440875:0:14347:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.123@tcp lock: ffff9d0d50417a00/0xafddb3c8f928278a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xafddb3c8f9282791 expref: -99 pid: 14347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789477491.440918:0:14347:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d7523e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:730ef4b7-dbd8-4cb5-9f31-5e7e04ae8864:14347:1876402802613632:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1789477491.440946:0:14347:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789477491.440964:0:14347:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d0d462433c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789477491.440977:0:14343:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802613632 00000100:00100000:2.0:1789477491.440980:0:14343:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802613632 00000100:00100000:2.0:1789477491.441001:0:14343:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1789477491.441007:0:14343:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d7b09a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:730ef4b7-dbd8-4cb5-9f31-5e7e04ae8864+12:14347:x1876402802613632:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1789477491.441020:0:14343:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1789477491.441035:0:14343:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1789477491.441039:0:14343:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 6 00000100:00100000:2.0:1789477491.441629:0:14343:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d7b09a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:730ef4b7-dbd8-4cb5-9f31-5e7e04ae8864+12:14347:x1876402802613632:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 620us (680us total) trans 0 rc 0/0 00000100:00100000:2.0:1789477491.441637:0:14343:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1789477491.441670:0:14347:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d7523e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:730ef4b7-dbd8-4cb5-9f31-5e7e04ae8864:14347:1876402802613632:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1789477491.441711:0:14347:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.123@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1789477491.441718:0:14347:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.123@tcp lock: ffff9d0d50417a00/0xafddb3c8f928278a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xafddb3c8f9282791 expref: -99 pid: 14347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477491.441738:0:14347:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.123@tcp lock: ffff9d0d50417a00/0xafddb3c8f928278a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xafddb3c8f9282791 expref: -99 pid: 14347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477491.504035:0:14339:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1789477491.952428:0:14385:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1789477492.528411:0:14338:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789477493.560342:0:14339:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789477494.584093:0:14338:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1789477495.227776:0:12773:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789477495.227793:0:12773:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1789477495.227796:0:12773:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789477495.227798:0:12773:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1789477495.227801:0:12773:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1789477495.227804:0:12773:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1789477495.227808:0:12773:0:(import.c:65:import_set_state_nolock()) ffff9d0d482aa000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1789477495.227827:0:12773:0:(import.c:625:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff9d0d482aa000 using connection 192.168.201.123@tcp/0@lo 00000100:00100000:0.0:1789477495.227853:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789477495.227867:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d6d480700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:730ef4b7-dbd8-4cb5-9f31-5e7e04ae8864:3313:1876402802613760:0@lo:400:kworker.0 00000100:00100000:0.0:1789477495.227940:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789477495.228020:0:14345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802613760 00000100:00100000:0.0:1789477495.228029:0:14345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802613760 00000100:00100000:0.0:1789477495.228072:0:14345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1789477495.228081:0:14345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d7b098c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:730ef4b7-dbd8-4cb5-9f31-5e7e04ae8864+12:3313:x1876402802613760:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789477495.228130:0:14345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d7b098c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:730ef4b7-dbd8-4cb5-9f31-5e7e04ae8864+12:3313:x1876402802613760:12345-0@lo:400:kworker.0 Request processed in 49us (189us total) trans 0 rc 0/0 00000100:00100000:0.0:1789477495.228137:0:14345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1789477495.228189:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d6d480700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:730ef4b7-dbd8-4cb5-9f31-5e7e04ae8864:3313:1876402802613760:0@lo:400:kworker.0 00000100:00100000:0.0:1789477495.228228:0:12773:0:(import.c:827:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9d0d6d480700 x1876402802613888/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1789477495.228255:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d6d480700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3309:1876402802613888:0@lo:38:kworker.0 00000100:00100000:0.0:1789477495.233803:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789477495.239957:0:14352:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802613888 00000100:00100000:3.0:1789477495.239975:0:14352:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802613888 00000100:00100000:3.0:1789477495.240026:0:14352:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789477495.240035:0:14352:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d6d481c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3309:x1876402802613888:12345-0@lo:38:kworker.0 00010000:00080000:3.0:1789477495.240074:0:14352:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 440 last 0 00000020:00000080:3.0:1789477495.240110:0:14352:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0xafddb3c8f9282798 00000004:00100000:3.0:1789477495.240126:0:14352:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1789477495.240258:0:14352:0:(import.c:65:import_set_state_nolock()) ffff9d0d51558000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789477495.240358:0:14352:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d6d481c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1876402802613888:12345-0@lo:38:kworker.0 Request processed in 323us (6561us total) trans 0 rc 0/0 00000100:00100000:3.0:1789477495.240365:0:14352:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1789477495.240538:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9d0d6d480700 x1876402802613888/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789477505 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1789477495.240555:0:3309:0:(import.c:1133:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 2 00000100:00080000:2.0:1789477495.240709:0:3309:0:(import.c:957:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:2.0:1789477495.240715:0:3309:0:(import.c:1214:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1789477495.240718:0:3309:0:(import.c:65:import_set_state_nolock()) ffff9d0d482aa000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1789477495.240724:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d6d480700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3309:1876402802613888:0@lo:38:kworker.0 00000001:02000400:3.0:1789477495.553681:0:14635:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg123-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:0.0:1789477495.600909:0:14339:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789477496.624511:0:14338:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789477497.650711:0:14339:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789477498.679083:0:14338:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1789477498.839254:0:14786:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffd3df7d3d0 20000000:00000080:3.0:1789477498.839272:0:14786:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9d0d6e663c00 uarg=0000000000000000 20000000:01000000:3.0:1789477498.839307:0:14786:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:3.0:1789477498.839314:0:14786:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:3.0:1789477498.839319:0:14786:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:1.0:1789477498.840325:0:14787:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 2 count 10 20000000:00000400:3.0:1789477498.840485:0:14786:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 10000000:01000000:3.0:1789477498.847369:0:14786:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1789477498.847404:0:14786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9d0d49ecae00/0xafddb3c8f928279f lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477498.847424:0:14786:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9d0d49eca600/0xafddb3c8f9282760 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xafddb3c8f9282759 expref: 11 pid: 14345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477498.847433:0:14786:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9d0d49ecae00/0xafddb3c8f928279f lrc: 4/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477498.847479:0:14786:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9d0d49eca600/0xafddb3c8f9282760 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xafddb3c8f9282759 expref: 11 pid: 14345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477498.847516:0:14786:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9d0d49eca600/0xafddb3c8f9282760 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xafddb3c8f9282759 expref: 11 pid: 14345 timeout: 543 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789477498.847535:0:14786:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d58070e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:14786:1876402802614016:0@lo:104: 00000100:00100000:3.0:1789477498.847649:0:14786:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789477498.847700:0:14786:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d0d584b3900 going to sleep for 11 seconds 00000100:00100000:2.0:1789477498.848121:0:14334:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802614016 00000100:00100000:2.0:1789477498.848128:0:14334:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802614016 00000100:00100000:2.0:1789477498.848175:0:14334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789477498.848184:0:14334:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d58071180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:730ef4b7-dbd8-4cb5-9f31-5e7e04ae8864+3:14786:x1876402802614016:12345-0@lo:104: 00010000:00010000:2.0:1789477498.848198:0:14334:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.123@tcp lock: ffff9d0d50be4400/0xafddb3c8f9282759 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xafddb3c8f9282760 expref: -99 pid: 14332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477498.848263:0:14334:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1789477498.848269:0:14334:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d58071180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:730ef4b7-dbd8-4cb5-9f31-5e7e04ae8864+3:14786:x1876402802614016:12345-0@lo:104: Request processed in 87us (621us total) trans 0 rc 0/0 00000100:00100000:2.0:1789477498.848286:0:14334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00010000:2.0:1789477498.848309:0:14339:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789477498.848315:0:14339:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.123@tcp lock: ffff9d0d50be4400/0xafddb3c8f9282759 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xafddb3c8f9282760 expref: -99 pid: 14332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477498.848322:0:14339:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d0d50be4400 already unused, calling callback (ffffffffc1bb3c20) 10000000:00010000:2.0:1789477498.848326:0:14339:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.123@tcp lock: ffff9d0d50be4400/0xafddb3c8f9282759 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xafddb3c8f9282760 expref: -99 pid: 14332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477498.848335:0:14339:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.123@tcp lock: ffff9d0d50be4400/0xafddb3c8f9282759 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xafddb3c8f9282760 expref: -99 pid: 14332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789477498.848343:0:14339:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.123@tcp lock: ffff9d0d50be4400/0xafddb3c8f9282759 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xafddb3c8f9282760 expref: -99 pid: 14332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789477498.848349:0:14339:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1789477498.848380:0:14339:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.123@tcp lock: ffff9d0d50be4400/0xafddb3c8f9282759 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xafddb3c8f9282760 expref: -99 pid: 14332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477498.848386:0:14339:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789477498.848405:0:14339:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.123@tcp lock: ffff9d0d50be4400/0xafddb3c8f9282759 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xafddb3c8f9282760 expref: -99 pid: 14332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477498.848412:0:14339:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.123@tcp lock: ffff9d0d50be4400/0xafddb3c8f9282759 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xafddb3c8f9282760 expref: -99 pid: 14332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477498.848426:0:14339:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789477498.848428:0:14339:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789477498.848430:0:14339:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789477498.848436:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789477498.848455:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d7523e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:730ef4b7-dbd8-4cb5-9f31-5e7e04ae8864:3312:1876402802614144:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789477498.848485:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789477498.848553:0:14335:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802614144 00000100:00100000:0.0:1789477498.848563:0:14335:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802614144 00010000:00010000:0.0:1789477498.848618:0:14335:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9d0d49eca600/0xafddb3c8f9282760 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xafddb3c8f9282759 expref: 12 pid: 14345 timeout: 543 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789477498.848643:0:14335:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789477498.848650:0:14335:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d7523f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:730ef4b7-dbd8-4cb5-9f31-5e7e04ae8864+12:3312:x1876402802614144:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789477498.848662:0:14335:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789477498.848667:0:14335:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9d0d49eca600/0xafddb3c8f9282760 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xafddb3c8f9282759 expref: 12 pid: 14345 timeout: 543 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477498.848676:0:14335:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9d0d49eca600/0xafddb3c8f9282760 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xafddb3c8f9282759 expref: 12 pid: 14345 timeout: 543 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477498.848692:0:14335:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9d0d49ecae00/0xafddb3c8f928279f lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477498.848700:0:14335:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d0d49ecae00/0xafddb3c8f928279f lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477498.848714:0:14335:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9d0d49ecae00/0xafddb3c8f928279f lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477498.848720:0:14335:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9d0d49ecae00/0xafddb3c8f928279f lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477498.848727:0:14335:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9d0d49ecae00/0xafddb3c8f928279f lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477498.848733:0:14335:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9d0d49ecae00/0xafddb3c8f928279f lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477498.848738:0:14335:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d0d49ecae00 already unused, calling callback (ffffffffc15972a0) 00010000:00010000:0.0:1789477498.848749:0:14335:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9d0d49ecae00/0xafddb3c8f928279f lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477498.848756:0:14335:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9d0d49ecae00/0xafddb3c8f928279f lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477498.848765:0:14335:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9d0d49ecae00/0xafddb3c8f928279f lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477498.848774:0:14335:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789477498.848808:0:14335:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d7523f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:730ef4b7-dbd8-4cb5-9f31-5e7e04ae8864+12:3312:x1876402802614144:12345-0@lo:103:ldlm_bl.0 Request processed in 159us (322us total) trans 0 rc 0/0 00000100:00100000:0.0:1789477498.848815:0:14335:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789477498.848850:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d7523e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:730ef4b7-dbd8-4cb5-9f31-5e7e04ae8864:3312:1876402802614144:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789477498.849046:0:14786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d0d49eca600/0xafddb3c8f9282760 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xafddb3c8f9282759 expref: 11 pid: 14345 timeout: 543 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789477498.849059:0:14786:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d58070e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:14786:1876402802614016:0@lo:104: 00010000:00010000:3.0:1789477498.849079:0:14786:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9d0d49ecae00/0xafddb3c8f928279f lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477498.849087:0:14786:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9d0d49ecae00/0xafddb3c8f928279f lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477498.849094:0:14786:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9d0d49ecae00/0xafddb3c8f928279f lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477498.849100:0:14786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d0d49ecae00/0xafddb3c8f928279f lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789477499.312677:0:3309:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789477489/real 1789477489] req@ffff9d0d58073b80 x1876402802611200/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789477499 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789477499.312710:0:3309:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9d0d58073b80 x1876402802611200/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789477499 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789477499.312734:0:3309:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789477489/real 1789477489] req@ffff9d0d58073800 x1876402802611072/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789477499 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789477499.312747:0:3309:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9d0d58073800 x1876402802611072/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789477499 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1789477499.312766:0:3309:0:(import.c:65:import_set_state_nolock()) ffff9d0d4823f000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1789477499.312790:0:3309:0:(import.c:1512:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1789477499.312794:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d58073b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3309:1876402802611200:0@lo:8:llog_process_th.0 00000100:00080000:1.0:1789477499.312800:0:3309:0:(import.c:65:import_set_state_nolock()) ffff9d0d505c1000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1789477499.312806:0:3309:0:(import.c:1512:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1789477499.312809:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d58073800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3309:1876402802611072:0@lo:8:llog_process_th.0 00000100:00080000:0.0:1789477499.312921:0:1381:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789477499.312927:0:1381:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:0.0:1789477499.312930:0:1381:0:(import.c:65:import_set_state_nolock()) ffff9d0d505c1000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1789477499.312936:0:1381:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 434 00000100:00080000:0.0:1789477499.312941:0:1381:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1789477499.312951:0:1381:0:(import.c:625:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9d0d505c1000 using connection 192.168.201.123@tcp/0@lo 00000100:00100000:3.0:1789477499.313099:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789477499.313114:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d6d480700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:730ef4b7-dbd8-4cb5-9f31-5e7e04ae8864:3311:1876402802614272:0@lo:400:kworker.0 00000100:00100000:0.0:1789477499.313141:0:1381:0:(import.c:827:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9d0d6d483480 x1876402802614400/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1789477499.313164:0:1381:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789477499.313168:0:1381:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1789477499.313171:0:1381:0:(import.c:65:import_set_state_nolock()) ffff9d0d4823f000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1789477499.313175:0:1381:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 434 00000100:00080000:0.0:1789477499.313178:0:1381:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00100000:3.0:1789477499.313183:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1789477499.313195:0:1381:0:(import.c:625:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9d0d4823f000 using connection 192.168.201.123@tcp/0@lo 00000100:00100000:0.0:1789477499.313212:0:1381:0:(import.c:827:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9d0d6d481880 x1876402802614528/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1789477499.313249:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d6d483800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3311:1876402802614656:0@lo:400:kworker.0 00000100:00100000:1.0:1789477499.313285:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d6d483480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3309:1876402802614400:0@lo:8:kworker.0 00000100:00100000:3.0:1789477499.313295:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000400:00000100:1.0:1789477499.313322:0:3309:0:(lib-move.c:4383:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1876402802614400 offset 0 length 520: 4 00000100:00100000:1.0:1789477499.313339:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d6d481880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3309:1876402802614528:0@lo:8:kworker.0 00000400:00000100:1.0:1789477499.313357:0:3309:0:(lib-move.c:4383:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1876402802614528 offset 0 length 520: 4 00000100:00100000:3.0:1789477499.313403:0:14344:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802614272 00000100:00100000:3.0:1789477499.313417:0:14344:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802614272 00000100:00100000:0.0:1789477499.313424:0:14351:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802614656 00000100:00100000:0.0:1789477499.313431:0:14351:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802614656 00000100:00100000:0.0:1789477499.313471:0:14351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789477499.313477:0:14344:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1789477499.313482:0:14351:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d58070e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1876402802614656:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789477499.313490:0:14344:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d7b09a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:730ef4b7-dbd8-4cb5-9f31-5e7e04ae8864+11:3311:x1876402802614272:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789477499.313546:0:14344:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d7b09a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:730ef4b7-dbd8-4cb5-9f31-5e7e04ae8864+11:3311:x1876402802614272:12345-0@lo:400:kworker.0 Request processed in 59us (364us total) trans 0 rc 0/0 00000100:00100000:3.0:1789477499.313553:0:14344:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00010000:00080000:3.0:1789477499.315349:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9d0d6d483800 x1876402802614656/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789477515 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789477499.315372:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d6d483800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3311:1876402802614656:0@lo:400:kworker.0 00000100:00100000:0.0:1789477499.315375:0:14351:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d58070e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1876402802614656:12345-0@lo:400:kworker.0 Request processed in 1892us (2076us total) trans 0 rc 0/0 00000100:00100000:0.0:1789477499.315388:0:14351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789477499.315452:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d6d480700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:730ef4b7-dbd8-4cb5-9f31-5e7e04ae8864:3311:1876402802614272:0@lo:400:kworker.0 00010000:00010000:3.0:1789477499.699264:0:14338:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1789477500.208689:0:14347:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1789477500.208701:0:14347:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9d0c43499000 from 10 10000000:01000000:0.0:1789477500.208708:0:14347:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1789477500.208770:0:14347:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.123@tcp lock: ffff9d0d50be4000/0xafddb3c8f92827a6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477500.208784:0:14347:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.123@tcp lock: ffff9d0d50be4000/0xafddb3c8f92827a6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477500.208797:0:14347:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.123@tcp lock: ffff9d0d50be4000/0xafddb3c8f92827a6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789477500.208832:0:14347:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d6d481f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:730ef4b7-dbd8-4cb5-9f31-5e7e04ae8864:14347:1876402802614784:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789477500.208929:0:14347:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789477500.208988:0:14347:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d0d51503780 going to sleep for 11 seconds 00000100:00100000:0.0:1789477500.209018:0:14343:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802614784 00000100:00100000:0.0:1789477500.209026:0:14343:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802614784 00000100:00100000:0.0:1789477500.209089:0:14343:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1789477500.209099:0:14343:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d7b098450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:730ef4b7-dbd8-4cb5-9f31-5e7e04ae8864+11:14347:x1876402802614784:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789477500.209124:0:14343:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789477500.209141:0:14343:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d0d50be5400/0xafddb3c8f92827ad lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xafddb3c8f92827a6 expref: -99 pid: 14343 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477500.209169:0:14343:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d0d50be5400/0xafddb3c8f92827ad lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xafddb3c8f92827a6 expref: 12 pid: 14343 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477500.209181:0:14343:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d0d50be5400/0xafddb3c8f92827ad lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xafddb3c8f92827a6 expref: 12 pid: 14343 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477500.209192:0:14343:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d0d50be5400, rc 0) 00000100:00100000:0.0:1789477500.209234:0:14343:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d7b098450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:730ef4b7-dbd8-4cb5-9f31-5e7e04ae8864+12:14347:x1876402802614784:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 135us (305us total) trans 0 rc 0/0 00000100:00100000:0.0:1789477500.209241:0:14343:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1789477500.209299:0:14347:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d6d481f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:730ef4b7-dbd8-4cb5-9f31-5e7e04ae8864:14347:1876402802614784:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789477500.209316:0:14347:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.123@tcp lock: ffff9d0d50be4000/0xafddb3c8f92827a6 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xafddb3c8f92827ad expref: -99 pid: 14347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477500.209326:0:14347:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.123@tcp lock: ffff9d0d50be4000/0xafddb3c8f92827a6 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xafddb3c8f92827ad expref: -99 pid: 14347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789477500.209389:0:14347:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d6d481f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:730ef4b7-dbd8-4cb5-9f31-5e7e04ae8864:14347:1876402802614912:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789477500.209415:0:14347:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789477500.209443:0:14347:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d0d51503780 going to sleep for 11 seconds 00000100:00100000:0.0:1789477500.210805:0:14344:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802614912 00000100:00100000:0.0:1789477500.210823:0:14344:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802614912 00000100:00100000:0.0:1789477500.210893:0:14344:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1789477500.210906:0:14344:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d6ec5d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:730ef4b7-dbd8-4cb5-9f31-5e7e04ae8864+12:14347:x1876402802614912:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789477500.212184:0:14344:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d6ec5d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:730ef4b7-dbd8-4cb5-9f31-5e7e04ae8864+12:14347:x1876402802614912:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 1272us (2757us total) trans 0 rc 0/0 00000100:00100000:0.0:1789477500.212199:0:14344:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1789477500.212305:0:14347:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d6d481f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:730ef4b7-dbd8-4cb5-9f31-5e7e04ae8864:14347:1876402802614912:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789477500.212499:0:14347:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d6d481f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:730ef4b7-dbd8-4cb5-9f31-5e7e04ae8864:14347:1876402802615040:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789477500.212614:0:14347:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789477500.212653:0:14347:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d0d51503780 going to sleep for 11 seconds 00000100:00100000:0.0:1789477500.212673:0:14345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802615040 00000100:00100000:0.0:1789477500.212679:0:14345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802615040 00000100:00100000:0.0:1789477500.212716:0:14345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1789477500.212724:0:14345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d6ec5d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:730ef4b7-dbd8-4cb5-9f31-5e7e04ae8864+12:14347:x1876402802615040:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789477500.213020:0:14345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d6ec5d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:730ef4b7-dbd8-4cb5-9f31-5e7e04ae8864+12:14347:x1876402802615040:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 296us (405us total) trans 0 rc 0/0 00000100:00100000:0.0:1789477500.213028:0:14345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1789477500.213075:0:14347:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d6d481f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:730ef4b7-dbd8-4cb5-9f31-5e7e04ae8864:14347:1876402802615040:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1789477500.217256:0:14847:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:3.0:1789477500.217685:0:14347:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:3.0:1789477500.217711:0:14347:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.123@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1789477500.217726:0:14347:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.123@tcp lock: ffff9d0d50be4000/0xafddb3c8f92827a6 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xafddb3c8f92827ad expref: -99 pid: 14347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477500.217739:0:14347:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.123@tcp lock: ffff9d0d50be4000/0xafddb3c8f92827a6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xafddb3c8f92827ad expref: -99 pid: 14347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477500.722779:0:14339:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1789477501.168747:0:14385:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1789477501.751632:0:14338:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789477502.776130:0:14339:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789477503.798124:0:14338:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1789477504.432109:0:12773:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789477504.432117:0:12773:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1789477504.432121:0:12773:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789477504.432124:0:12773:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1789477504.432263:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d7523dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:730ef4b7-dbd8-4cb5-9f31-5e7e04ae8864:3312:1876402802615168:0@lo:400:kworker.0 00000100:00100000:0.0:1789477504.432346:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789477504.432398:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789477504.432403:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d7523ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3312:1876402802615296:0@lo:400:kworker.0 00000100:00100000:0.0:1789477504.432424:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789477504.432450:0:14350:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802615296 00000100:00100000:0.0:1789477504.432457:0:14350:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802615296 00000100:00100000:0.0:1789477504.432517:0:14350:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789477504.432548:0:14350:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d6d481f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1876402802615296:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789477504.432637:0:14350:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d6d481f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1876402802615296:12345-0@lo:400:kworker.0 Request processed in 91us (210us total) trans 0 rc 0/0 00000100:00100000:0.0:1789477504.432645:0:14350:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1789477504.432690:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9d0d7523ea00 x1876402802615296/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789477520 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789477504.432704:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d7523ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3312:1876402802615296:0@lo:400:kworker.0 00000100:00100000:2.0:1789477504.432816:0:14343:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802615168 00000100:00100000:2.0:1789477504.432820:0:14343:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802615168 00000100:00100000:2.0:1789477504.432841:0:14343:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1789477504.432846:0:14343:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d6ec5c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:730ef4b7-dbd8-4cb5-9f31-5e7e04ae8864+12:3312:x1876402802615168:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789477504.432883:0:14343:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d6ec5c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:730ef4b7-dbd8-4cb5-9f31-5e7e04ae8864+12:3312:x1876402802615168:12345-0@lo:400:kworker.0 Request processed in 36us (536us total) trans 0 rc 0/0 00000100:00100000:2.0:1789477504.432889:0:14343:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1789477504.433093:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d7523dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:730ef4b7-dbd8-4cb5-9f31-5e7e04ae8864:3312:1876402802615168:0@lo:400:kworker.0 00010000:00010000:3.0:1789477504.815769:0:14339:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1789477505.071938:0:15036:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:0.0:1789477505.071943:0:15036:0:(obd_mount.c:926:lmd_print()) device: lustre-ost1/ost1 00000080:01200004:0.0:1789477505.072317:0:15036:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9d0d7c06e000 00000020:01000004:0.0:1789477505.072334:0:15036:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-OST0000, type=osd-zfs, lsifl=200002, mountfl=0 00000020:01000004:0.0:1789477505.072349:0:15036:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-zfs) 00000020:00000080:0.0:1789477505.072384:0:15036:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff9d0d514cb370) 00000020:00000080:0.0:1789477505.072404:0:15036:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type osd-zfs with refcount 2 00100000:10000000:3.0:1789477505.116468:0:15036:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:3.0:1789477505.116967:0:15036:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0000: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:3.0:1789477505.118295:0:15036:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:3.0:1789477505.118683:0:15036:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00100000:10000000:3.0:1789477505.122331:0:15036:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0000: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:3.0:1789477505.123141:0:15036:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled lustre-client under 655: rc = 0 00100000:10000000:3.0:1789477505.123236:0:15036:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled lustre-OST0000 under 655: rc = 0 00100000:10000000:3.0:1789477505.123318:0:15036:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled params under 655: rc = 0 00100000:10000000:3.0:1789477505.124133:0:15036:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x2020000-OST0000 under 799: rc = 0 00100000:10000000:3.0:1789477505.124401:0:15036:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x1020000 under 799: rc = 0 00100000:10000000:3.0:1789477505.124778:0:15036:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x2020000 under 799: rc = 0 00100000:10000000:3.0:1789477505.125146:0:15036:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x1020000-OST0000 under 799: rc = 0 00100000:10000000:3.0:1789477505.125400:0:15036:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x20000-OST0000 under 799: rc = 0 00100000:10000000:3.0:1789477505.125967:0:15036:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x20000 under 799: rc = 0 00000020:00000080:3.0:1789477505.126956:0:15036:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:3.0:1789477505.126973:0:15036:0:(osd_handler.c:1564:osd_obd_connect()) connect #0 00000020:00000080:3.0:1789477505.126988:0:15036:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xafddb3c8f92827bb 00000020:01000004:3.0:1789477505.127000:0:15036:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-OST0000 on device lustre-ost1/ost1 00000020:01000004:3.0:1789477505.127031:0:15036:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.201.123@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1789477505.127036:0:15036:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.201.123@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1789477505.127043:0:15036:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-OST0000 00000020:01000004:3.0:1789477505.127050:0:15036:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:3.0:1789477505.127066:0:15036:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff9d0d7c073370) 00000020:00000080:3.0:1789477505.127080:0:15036:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type ost with refcount 2 00000100:00100000:3.0:1789477505.128508:0:15036:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1789477505.128773:0:15036:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:3.0:1789477505.128781:0:15036:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:2.0:1789477505.129522:0:15036:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:2.0:1789477505.129536:0:15036:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:3.0:1789477505.130433:0:15036:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:3.0:1789477505.130445:0:15036:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:3.0:1789477505.134202:0:15036:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1789477505.134550:0:15036:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:3.0:1789477505.134868:0:15036:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:3.0:1789477505.136269:0:15036:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:3.0:1789477505.136282:0:15036:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:3.0:1789477505.198202:0:15036:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1789477505.198516:0:15036:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:3.0:1789477505.198544:0:15036:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:3.0:1789477505.207324:0:15036:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:3.0:1789477505.207350:0:15036:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:2.0:1789477505.208545:0:15036:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:2.0:1789477505.208558:0:15036:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:0.0:1789477505.215881:0:15036:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1789477505.216152:0:15036:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:0.0:1789477505.216160:0:15036:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:1.0:1789477505.218403:0:15036:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:1.0:1789477505.218422:0:15036:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:2.0:1789477505.331222:0:15036:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789477505.331458:0:15036:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:2.0:1789477505.331464:0:15036:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:0.0:1789477505.335867:0:15036:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:0.0:1789477505.335879:0:15036:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:0.0:1789477505.337048:0:15036:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:0.0:1789477505.337076:0:15036:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost1/ost1 10000000:01000000:0.0:1789477505.337084:0:15036:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.201.123@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:1.0:1789477505.373306:0:15036:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.123@tcp ctxt 0 is initialized 00000020:01000004:1.0:1789477505.373361:0:15036:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.201.123@tcp, index=0000, flags=0x20002 00000020:01000004:1.0:1789477505.373366:0:15036:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1789477505.373367:0:15036:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1789477505.373369:0:15036:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789477505.373370:0:15036:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789477505.373372:0:15036:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789477505.373377:0:15036:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789477505.373379:0:15036:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1789477505.373381:0:15036:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789477505.373382:0:15036:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1789477505.373385:0:15036:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020002 00000020:01000004:1.0:1789477505.373388:0:15036:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1789477505.373389:0:15036:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1789477505.373390:0:15036:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789477505.373391:0:15036:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789477505.373392:0:15036:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789477505.373393:0:15036:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789477505.373394:0:15036:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1789477505.373395:0:15036:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789477505.373396:0:15036:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1789477505.373425:0:15036:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:1.0:1789477505.373445:0:15036:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d7f700000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:730ef4b7-dbd8-4cb5-9f31-5e7e04ae8864:15036:1876402802615424:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1789477505.374757:0:15036:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789477505.374828:0:15036:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d0d44480600 going to sleep for 11 seconds 00000100:00100000:0.0:1789477505.375199:0:14344:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802615424 00000100:00100000:0.0:1789477505.375210:0:14344:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802615424 00000100:00100000:0.0:1789477505.375270:0:14344:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1789477505.375280:0:14344:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d6ec5e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:730ef4b7-dbd8-4cb5-9f31-5e7e04ae8864+12:15036:x1876402802615424:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1789477505.375332:0:14344:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:0.0:1789477505.375339:0:14344:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0000 is running on 0@lo 20000000:01000000:0.0:1789477505.375344:0:14344:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:2.0:1789477505.386228:0:14344:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d6ec5e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:730ef4b7-dbd8-4cb5-9f31-5e7e04ae8864+12:15036:x1876402802615424:12345-0@lo:253:mount.lustre.0 Request processed in 10938us (11464us total) trans 0 rc 0/0 00000100:00100000:2.0:1789477505.386246:0:14344:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1789477505.386301:0:15036:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d7f700000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:730ef4b7-dbd8-4cb5-9f31-5e7e04ae8864:15036:1876402802615424:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1789477505.386396:0:15036:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:3.0:1789477505.386454:0:15036:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1789477505.386456:0:15036:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1789477505.386458:0:15036:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789477505.386459:0:15036:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789477505.386460:0:15036:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789477505.386462:0:15036:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789477505.386464:0:15036:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1789477505.386466:0:15036:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789477505.386468:0:15036:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1789477505.386510:0:15036:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9d0d7c06e000 from lustre-OST0000 10000000:01000000:3.0:1789477505.386857:0:15036:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:3.0:1789477505.386861:0:15036:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:3.0:1789477505.386871:0:15036:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9d0d76164d28 local copy 00010000:00010000:3.0:1789477505.386886:0:15036:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.123@tcp lock: ffff9d0d49ecbe00/0xafddb3c8f92826b1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xafddb3c8f92826b8 expref: -99 pid: 14332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789477505.387217:0:15036:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d58073100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:730ef4b7-dbd8-4cb5-9f31-5e7e04ae8864:15036:1876402802615552:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789477505.387288:0:15036:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789477505.387612:0:14345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802615552 00000100:00100000:0.0:1789477505.387621:0:14345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802615552 00000100:00100000:3.0:1789477505.387797:0:15036:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d0d48195600 going to sleep for 11 seconds 00000100:00100000:3.0:1789477505.388153:0:14345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1789477505.388167:0:14345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d6ec5cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:730ef4b7-dbd8-4cb5-9f31-5e7e04ae8864+12:15036:x1876402802615552:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789477505.388459:0:14345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d6ec5cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:730ef4b7-dbd8-4cb5-9f31-5e7e04ae8864+12:15036:x1876402802615552:12345-0@lo:501:mount.lustre.0 Request processed in 294us (1171us total) trans 0 rc -2/-2 00000100:00100000:3.0:1789477505.388485:0:14345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1789477505.388609:0:15036:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d58073100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:730ef4b7-dbd8-4cb5-9f31-5e7e04ae8864:15036:1876402802615552:0@lo:501:mount.lustre.0 10000000:01000000:0.0:1789477505.388644:0:15036:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.201.123@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:0.0:1789477505.388844:0:15036:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.201.123@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:0.0:1789477505.388855:0:15036:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.123@tcp lock: ffff9d0d49ecbe00/0xafddb3c8f92826b1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xafddb3c8f92826b8 expref: -99 pid: 14332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477505.388867:0:15036:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.123@tcp lock: ffff9d0d49ecbe00/0xafddb3c8f92826b1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xafddb3c8f92826b8 expref: -99 pid: 14332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789477505.388895:0:15036:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9d0d7c06e000 10000000:01000000:0.0:1789477505.388900:0:15036:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1789477505.388905:0:15036:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff9d0d76164d28 10000000:01000000:0.0:1789477505.388908:0:15036:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:0.0:1789477505.388913:0:15036:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff9d0d76164d28 from 1 10000000:01000000:0.0:1789477505.388917:0:15036:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:0.0:1789477505.388957:0:15036:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.123@tcp lock: ffff9d0d50be4e00/0xafddb3c8f92827c9 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15036 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477505.388966:0:15036:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.123@tcp lock: ffff9d0d50be4e00/0xafddb3c8f92827c9 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15036 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477505.388978:0:15036:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.123@tcp lock: ffff9d0d50be4e00/0xafddb3c8f92827c9 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15036 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789477505.389000:0:15036:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d6d483b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:730ef4b7-dbd8-4cb5-9f31-5e7e04ae8864:15036:1876402802615680:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1789477505.389039:0:15036:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789477505.394309:0:15036:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d0d515033c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789477505.394548:0:14343:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802615680 00000100:00100000:2.0:1789477505.394565:0:14343:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802615680 00000100:00100000:2.0:1789477505.394900:0:14343:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1789477505.394938:0:14343:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d6ec5c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:730ef4b7-dbd8-4cb5-9f31-5e7e04ae8864+12:15036:x1876402802615680:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789477505.394962:0:14343:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789477505.394988:0:14343:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d0d50416e00/0xafddb3c8f92827d0 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xafddb3c8f92827c9 expref: -99 pid: 14343 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477505.395026:0:14343:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d0d50416e00/0xafddb3c8f92827d0 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xafddb3c8f92827c9 expref: 13 pid: 14343 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477505.395039:0:14343:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d0d50416e00/0xafddb3c8f92827d0 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xafddb3c8f92827c9 expref: 13 pid: 14343 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477505.395051:0:14343:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d0d50416e00, rc 0) 00000100:00100000:2.0:1789477505.395173:0:14343:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d6ec5c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:730ef4b7-dbd8-4cb5-9f31-5e7e04ae8864+13:15036:x1876402802615680:12345-0@lo:101:mount.lustre.0 Request processed in 238us (6133us total) trans 0 rc 0/0 00000100:00100000:2.0:1789477505.395183:0:14343:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1789477505.395382:0:15036:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d6d483b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:730ef4b7-dbd8-4cb5-9f31-5e7e04ae8864:15036:1876402802615680:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789477505.395406:0:15036:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.123@tcp lock: ffff9d0d50be4e00/0xafddb3c8f92827c9 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xafddb3c8f92827d0 expref: -99 pid: 15036 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477505.395417:0:15036:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.123@tcp lock: ffff9d0d50be4e00/0xafddb3c8f92827c9 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xafddb3c8f92827d0 expref: -99 pid: 15036 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789477505.395443:0:15036:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.123@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:0.0:1789477505.395463:0:15036:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.123@tcp lock: ffff9d0d50be4e00/0xafddb3c8f92827c9 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xafddb3c8f92827d0 expref: -99 pid: 15036 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477505.395480:0:15036:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.123@tcp lock: ffff9d0d50be4e00/0xafddb3c8f92827c9 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xafddb3c8f92827d0 expref: -99 pid: 15036 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789477505.395492:0:15036:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:0.0:1789477505.395500:0:15036:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1789477505.395509:0:15036:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:0.0:1789477505.395513:0:15036:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:0.0:1789477505.395550:0:15036:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.123@tcp lock: ffff9d0d50be4400/0xafddb3c8f92827d7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15036 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477505.395558:0:15036:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.123@tcp lock: ffff9d0d50be4400/0xafddb3c8f92827d7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15036 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477505.395568:0:15036:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.123@tcp lock: ffff9d0d50be4400/0xafddb3c8f92827d7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15036 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789477505.395617:0:15036:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d6d483b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:730ef4b7-dbd8-4cb5-9f31-5e7e04ae8864:15036:1876402802615808:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1789477505.395666:0:15036:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789477505.395722:0:15036:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d0d515033c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789477505.395945:0:14343:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802615808 00000100:00100000:2.0:1789477505.395952:0:14343:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802615808 00000100:00100000:2.0:1789477505.395981:0:14343:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1789477505.395989:0:14343:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d6ec5f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:730ef4b7-dbd8-4cb5-9f31-5e7e04ae8864+13:15036:x1876402802615808:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789477505.395999:0:14343:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789477505.396011:0:14343:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d0d50417400/0xafddb3c8f92827de lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xafddb3c8f92827d7 expref: -99 pid: 14343 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477505.396028:0:14343:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d0d50417400/0xafddb3c8f92827de lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xafddb3c8f92827d7 expref: 14 pid: 14343 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477505.396038:0:14343:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d0d50417400/0xafddb3c8f92827de lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xafddb3c8f92827d7 expref: 14 pid: 14343 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477505.396057:0:14343:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d0d50417400, rc 0) 00000100:00100000:2.0:1789477505.396100:0:14343:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d6ec5f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:730ef4b7-dbd8-4cb5-9f31-5e7e04ae8864+14:15036:x1876402802615808:12345-0@lo:101:mount.lustre.0 Request processed in 111us (434us total) trans 0 rc 0/0 00000100:00100000:2.0:1789477505.396107:0:14343:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1789477505.396496:0:15036:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d6d483b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:730ef4b7-dbd8-4cb5-9f31-5e7e04ae8864:15036:1876402802615808:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789477505.396510:0:15036:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.123@tcp lock: ffff9d0d50be4400/0xafddb3c8f92827d7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xafddb3c8f92827de expref: -99 pid: 15036 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477505.396532:0:15036:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.123@tcp lock: ffff9d0d50be4400/0xafddb3c8f92827d7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xafddb3c8f92827de expref: -99 pid: 15036 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1789477505.398021:0:15036:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:0.0:1789477505.400540:0:15036:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1789477505.404104:0:15036:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:0.0:1789477505.404249:0:15036:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:0.0:1789477505.404285:0:15036:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:0.0:1789477505.404864:0:15036:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:0.0:1789477505.404912:0:15036:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:0.0:1789477505.404944:0:15036:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:0.0:1789477505.405034:0:15036:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:0.0:1789477505.405044:0:15036:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:0.0:1789477505.405206:0:15036:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d6d483b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:730ef4b7-dbd8-4cb5-9f31-5e7e04ae8864:15036:1876402802615936:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789477505.405300:0:15036:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789477505.405724:0:15036:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d0d51503b40 going to sleep for 11 seconds 00000100:00100000:3.0:1789477505.406152:0:14343:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802615936 00000100:00100000:3.0:1789477505.406165:0:14343:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802615936 00000100:00100000:3.0:1789477505.406248:0:14343:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1789477505.406261:0:14343:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d6ec5e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:730ef4b7-dbd8-4cb5-9f31-5e7e04ae8864+14:15036:x1876402802615936:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789477505.421362:0:14343:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d6ec5e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:730ef4b7-dbd8-4cb5-9f31-5e7e04ae8864+14:15036:x1876402802615936:12345-0@lo:501:mount.lustre.0 Request processed in 15087us (16045us total) trans 0 rc 0/0 00000100:00100000:3.0:1789477505.421381:0:14343:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1789477505.423150:0:15036:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d6d483b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:730ef4b7-dbd8-4cb5-9f31-5e7e04ae8864:15036:1876402802615936:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789477505.423236:0:15036:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d6d483b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:730ef4b7-dbd8-4cb5-9f31-5e7e04ae8864:15036:1876402802616064:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1789477505.423354:0:15036:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789477505.423476:0:15036:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d0d51503b40 going to sleep for 11 seconds 00000100:00100000:1.0:1789477505.423782:0:14344:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802616064 00000100:00100000:1.0:1789477505.423856:0:14344:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802616064 00000100:00100000:1.0:1789477505.423931:0:14344:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1789477505.423943:0:14344:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d6ec5c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:730ef4b7-dbd8-4cb5-9f31-5e7e04ae8864+14:15036:x1876402802616064:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1789477505.427173:0:14344:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d6ec5c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:730ef4b7-dbd8-4cb5-9f31-5e7e04ae8864+14:15036:x1876402802616064:12345-0@lo:503:mount.lustre.0 Request processed in 3219us (3807us total) trans 0 rc 0/0 00000100:00100000:1.0:1789477505.427190:0:14344:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1789477505.427941:0:15036:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d6d483b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:730ef4b7-dbd8-4cb5-9f31-5e7e04ae8864:15036:1876402802616064:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1789477505.432211:0:15036:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1789477505.432355:0:15036:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d7523c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:730ef4b7-dbd8-4cb5-9f31-5e7e04ae8864:15036:1876402802616192:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789477505.432507:0:15036:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789477505.432564:0:15036:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d0d477fe000 going to sleep for 11 seconds 00000100:00100000:3.0:1789477505.433249:0:14343:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802616192 00000100:00100000:3.0:1789477505.433264:0:14343:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802616192 00000100:00100000:3.0:1789477505.433345:0:14343:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1789477505.433358:0:14343:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d6ec5f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:730ef4b7-dbd8-4cb5-9f31-5e7e04ae8864+14:15036:x1876402802616192:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789477505.433778:0:14343:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d6ec5f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:730ef4b7-dbd8-4cb5-9f31-5e7e04ae8864+14:15036:x1876402802616192:12345-0@lo:502:mount.lustre.0 Request processed in 421us (1269us total) trans 0 rc 0/0 00000100:00100000:3.0:1789477505.433786:0:14343:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1789477505.434247:0:15036:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d7523c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:730ef4b7-dbd8-4cb5-9f31-5e7e04ae8864:15036:1876402802616192:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1789477505.434928:0:15036:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:2.0:1789477505.435010:0:15036:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:2.0:1789477505.435061:0:15036:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:2.0:1789477505.435109:0:15036:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:2.0:1789477505.435146:0:15036:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:2.0:1789477505.435178:0:15036:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:2.0:1789477505.435225:0:15036:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:2.0:1789477505.435261:0:15036:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:2.0:1789477505.435295:0:15036:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 80 off9712 00000040:00080000:2.0:1789477505.435376:0:15036:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9936 00000040:00080000:2.0:1789477505.435417:0:15036:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].11, 224 off10160 00000040:00080000:2.0:1789477505.435466:0:15036:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].12, 120 off10280 00000100:00100000:2.0:1789477505.435961:0:15036:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d7523c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:730ef4b7-dbd8-4cb5-9f31-5e7e04ae8864:15036:1876402802616320:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789477505.436062:0:15036:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789477505.436177:0:15036:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d0d477fe000 going to sleep for 11 seconds 00000100:00100000:0.0:1789477505.442465:0:14345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802616320 00000100:00100000:0.0:1789477505.442499:0:14345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802616320 00000100:00100000:0.0:1789477505.444661:0:14345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1789477505.444693:0:14345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d6ec5ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:730ef4b7-dbd8-4cb5-9f31-5e7e04ae8864+14:15036:x1876402802616320:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789477505.446240:0:14345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d6ec5ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:730ef4b7-dbd8-4cb5-9f31-5e7e04ae8864+14:15036:x1876402802616320:12345-0@lo:502:mount.lustre.0 Request processed in 1551us (10166us total) trans 0 rc 0/0 00000100:00100000:0.0:1789477505.446256:0:14345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1789477505.447355:0:15036:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d7523c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:730ef4b7-dbd8-4cb5-9f31-5e7e04ae8864:15036:1876402802616320:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1789477505.447672:0:15036:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].13, 224 off10504 00000040:00080000:2.0:1789477505.447724:0:15036:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 14 00000020:01000000:2.0:1789477505.451197:0:15050:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1789477505.451215:0:15050:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-ost1/ost1 00000020:00000080:2.0:1789477505.451224:0:15050:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789477505.451228:0:15050:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-OST0000 add ost 00000020:00000080:2.0:1789477505.451238:0:15050:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1789477505.451261:0:15050:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff9d0d75443370) 00000020:00000080:2.0:1789477505.451294:0:15050:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type obdfilter with refcount 2 00000020:00000080:2.0:1789477505.451301:0:15050:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1789477505.451917:0:15050:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9d0d7c06e000 from lustre-OST0000, refs=2 00080000:01000000:2.0:1789477505.451929:0:15050:0:(osd_handler.c:1564:osd_obd_connect()) connect #1 00000020:00000080:2.0:1789477505.451940:0:15050:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xafddb3c8f92827ec 00010000:00010000:2.0:1789477505.470444:0:15050:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-2 is initialized 00000001:00000004:2.0:1789477505.471188:0:15050:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 4294967310 00080000:10000000:2.0:1789477505.478313:0:15050:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00000020:00000080:2.0:1789477505.482927:0:15050:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:2.0:1789477505.482941:0:15050:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789477505.483084:0:15050:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789477505.483088:0:15050:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-OST0000 add ost 00000020:01000000:3.0:1789477505.483093:0:15050:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1789477505.483096:0:15050:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #14 00000020:01000000:3.0:1789477505.483098:0:15050:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1789477505.483099:0:15050:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1789477505.483101:0:15050:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1789477505.483104:0:15050:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789477505.483105:0:15050:0:(obd_config.c:1563:class_process_config()) marker 14 (0x6) lustre sys.timeout 00000020:01000000:3.0:1789477505.483107:0:15050:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789477505.483111:0:15050:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789477505.483112:0:15050:0:(obd_config.c:1563:class_process_config()) marker 20 (0x1) lustre sys.timeout 00000020:00000080:3.0:1789477505.483115:0:15050:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1789477505.483117:0:15050:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1789477505.483120:0:15050:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789477505.483164:0:15050:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789477505.483165:0:15050:0:(obd_config.c:1563:class_process_config()) marker 20 (0x2) lustre sys.timeout 00000020:01000000:3.0:1789477505.483169:0:15050:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789477505.483171:0:15050:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789477505.483172:0:15050:0:(obd_config.c:1563:class_process_config()) marker 24 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1789477505.483176:0:15050:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:3.0:1789477505.483263:0:15050:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789477505.483267:0:15050:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789477505.483269:0:15050:0:(obd_config.c:1563:class_process_config()) marker 24 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1789477505.483272:0:15050:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 14 count 14 00000020:01000000:2.0:1789477505.483489:0:15036:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-13 (rc=0) 10000000:01000000:2.0:1789477505.483517:0:15036:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.123@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:2.0:1789477505.483549:0:15036:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.123@tcp lock: ffff9d0d50be4400/0xafddb3c8f92827d7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xafddb3c8f92827de expref: -99 pid: 15036 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477505.483562:0:15036:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.123@tcp lock: ffff9d0d50be4400/0xafddb3c8f92827d7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xafddb3c8f92827de expref: -99 pid: 15036 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789477505.483571:0:15036:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9d0d7c06e000 from 1 10000000:01000000:2.0:1789477505.483573:0:15036:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1789477505.483633:0:15036:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.123@tcp lock: ffff9d0d50416200/0xafddb3c8f92827f3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15036 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477505.483641:0:15036:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.123@tcp lock: ffff9d0d50416200/0xafddb3c8f92827f3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15036 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477505.483659:0:15036:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.123@tcp lock: ffff9d0d50416200/0xafddb3c8f92827f3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15036 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789477505.483685:0:15036:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d7523c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:730ef4b7-dbd8-4cb5-9f31-5e7e04ae8864:15036:1876402802616448:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1789477505.483882:0:15036:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789477505.483935:0:15036:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d0d58576a80 going to sleep for 11 seconds 00000100:00100000:0.0:1789477505.484156:0:14344:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802616448 00000100:00100000:0.0:1789477505.484163:0:14344:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802616448 00000100:00100000:0.0:1789477505.484208:0:14344:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1789477505.484218:0:14344:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d6ec5d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:730ef4b7-dbd8-4cb5-9f31-5e7e04ae8864+14:15036:x1876402802616448:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789477505.484231:0:14344:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789477505.484245:0:14344:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d0d50be5600/0xafddb3c8f92827fa lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xafddb3c8f92827f3 expref: -99 pid: 14344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477505.484269:0:14344:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d0d50be5600/0xafddb3c8f92827fa lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xafddb3c8f92827f3 expref: 15 pid: 14344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477505.484278:0:14344:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d0d50be5600/0xafddb3c8f92827fa lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xafddb3c8f92827f3 expref: 15 pid: 14344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477505.484287:0:14344:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d0d50be5600, rc 0) 00000100:00100000:0.0:1789477505.484325:0:14344:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d6ec5d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:730ef4b7-dbd8-4cb5-9f31-5e7e04ae8864+15:15036:x1876402802616448:12345-0@lo:101:mount.lustre.0 Request processed in 107us (443us total) trans 0 rc 0/0 00000100:00100000:0.0:1789477505.484331:0:14344:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1789477505.485393:0:15036:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d7523c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:730ef4b7-dbd8-4cb5-9f31-5e7e04ae8864:15036:1876402802616448:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789477505.485413:0:15036:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.123@tcp lock: ffff9d0d50416200/0xafddb3c8f92827f3 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xafddb3c8f92827fa expref: -99 pid: 15036 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477505.485424:0:15036:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.123@tcp lock: ffff9d0d50416200/0xafddb3c8f92827f3 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xafddb3c8f92827fa expref: -99 pid: 15036 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1789477505.486160:0:15036:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:2.0:1789477505.486501:0:15036:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789477505.489045:0:15036:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:3.0:1789477505.489100:0:15036:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:3.0:1789477505.489156:0:15036:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:3.0:1789477505.489164:0:15036:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:3.0:1789477505.489261:0:15036:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d58071c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:730ef4b7-dbd8-4cb5-9f31-5e7e04ae8864:15036:1876402802616576:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789477505.489325:0:15036:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789477505.489368:0:15036:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d0d48195000 going to sleep for 11 seconds 00000100:00100000:0.0:1789477505.489475:0:14345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802616576 00000100:00100000:0.0:1789477505.489483:0:14345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802616576 00000100:00100000:0.0:1789477505.489540:0:14345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1789477505.489550:0:14345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d6ec5e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:730ef4b7-dbd8-4cb5-9f31-5e7e04ae8864+15:15036:x1876402802616576:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789477505.489816:0:14345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d6ec5e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:730ef4b7-dbd8-4cb5-9f31-5e7e04ae8864+15:15036:x1876402802616576:12345-0@lo:501:mount.lustre.0 Request processed in 267us (489us total) trans 0 rc 0/0 00000100:00100000:0.0:1789477505.489831:0:14345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1789477505.495181:0:15036:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d58071c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:730ef4b7-dbd8-4cb5-9f31-5e7e04ae8864:15036:1876402802616576:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789477505.495273:0:15036:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d58071c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:730ef4b7-dbd8-4cb5-9f31-5e7e04ae8864:15036:1876402802616704:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1789477505.495362:0:15036:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789477505.495403:0:15036:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d0d48195000 going to sleep for 11 seconds 00000100:00100000:0.0:1789477505.495820:0:14343:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802616704 00000100:00100000:0.0:1789477505.495829:0:14343:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802616704 00000100:00100000:0.0:1789477505.495880:0:14343:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1789477505.495889:0:14343:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d6ec5dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:730ef4b7-dbd8-4cb5-9f31-5e7e04ae8864+15:15036:x1876402802616704:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1789477505.496104:0:14343:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d6ec5dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:730ef4b7-dbd8-4cb5-9f31-5e7e04ae8864+15:15036:x1876402802616704:12345-0@lo:503:mount.lustre.0 Request processed in 214us (741us total) trans 0 rc 0/0 00000100:00100000:0.0:1789477505.496712:0:14343:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1789477505.498764:0:15036:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d58071c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:730ef4b7-dbd8-4cb5-9f31-5e7e04ae8864:15036:1876402802616704:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1789477505.500150:0:15036:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1789477505.500339:0:15036:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d7f700380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:730ef4b7-dbd8-4cb5-9f31-5e7e04ae8864:15036:1876402802616832:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789477505.500429:0:15036:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789477505.500482:0:15036:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d0d44480600 going to sleep for 11 seconds 00000100:00100000:2.0:1789477505.500626:0:14344:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802616832 00000100:00100000:2.0:1789477505.500635:0:14344:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802616832 00000100:00100000:2.0:1789477505.500693:0:14344:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1789477505.500704:0:14344:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d6ec5fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:730ef4b7-dbd8-4cb5-9f31-5e7e04ae8864+15:15036:x1876402802616832:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789477505.500957:0:14344:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d6ec5fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:730ef4b7-dbd8-4cb5-9f31-5e7e04ae8864+15:15036:x1876402802616832:12345-0@lo:502:mount.lustre.0 Request processed in 254us (527us total) trans 0 rc 0/0 00000100:00100000:2.0:1789477505.500967:0:14344:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1789477505.501356:0:15036:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d7f700380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:730ef4b7-dbd8-4cb5-9f31-5e7e04ae8864:15036:1876402802616832:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1789477505.502016:0:15036:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:1.0:1789477505.502078:0:15036:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:1.0:1789477505.502140:0:15036:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:1.0:1789477505.502178:0:15036:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:1.0:1789477505.502212:0:15036:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:1.0:1789477505.502441:0:15036:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:1.0:1789477505.502492:0:15036:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:1.0:1789477505.502701:0:15036:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000100:00100000:1.0:1789477505.502817:0:15036:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d7f700380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:730ef4b7-dbd8-4cb5-9f31-5e7e04ae8864:15036:1876402802616960:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789477505.502886:0:15036:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789477505.502926:0:15036:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d0d44480600 going to sleep for 11 seconds 00000100:00100000:0.0:1789477505.504203:0:14343:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802616960 00000100:00100000:0.0:1789477505.504218:0:14343:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802616960 00000100:00100000:0.0:1789477505.504272:0:14343:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1789477505.504283:0:14343:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d6ec5f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:730ef4b7-dbd8-4cb5-9f31-5e7e04ae8864+15:15036:x1876402802616960:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789477505.504782:0:14343:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d6ec5f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:730ef4b7-dbd8-4cb5-9f31-5e7e04ae8864+15:15036:x1876402802616960:12345-0@lo:502:mount.lustre.0 Request processed in 500us (1895us total) trans 0 rc 0/0 00000100:00100000:0.0:1789477505.504791:0:14343:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1789477505.506451:0:15036:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d7f700380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:730ef4b7-dbd8-4cb5-9f31-5e7e04ae8864:15036:1876402802616960:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1789477505.506691:0:15036:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:1.0:1789477505.506707:0:15036:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 9 count 10 00000020:01000000:1.0:1789477505.517946:0:15054:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789477505.517965:0:15054:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789477505.517967:0:15054:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1789477505.517976:0:15054:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9d0d7c06e000 00000020:00000080:1.0:1789477505.517978:0:15054:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1789477505.517984:0:15054:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789477505.517987:0:15054:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789477505.517988:0:15054:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:1.0:1789477505.517991:0:15054:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789477505.517993:0:15054:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789477505.517994:0:15054:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1789477505.517998:0:15054:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9d0d7c06e000 00000020:00000080:1.0:1789477505.518000:0:15054:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1789477505.518134:0:15054:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789477505.518139:0:15054:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789477505.518140:0:15054:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:1.0:1789477505.518143:0:15054:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789477505.518146:0:15054:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789477505.518147:0:15054:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1789477505.518150:0:15054:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9d0d7c06e000 00000020:00000080:1.0:1789477505.518169:0:15054:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1789477505.531557:0:15054:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789477505.531572:0:15054:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789477505.531597:0:15054:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:0.0:1789477505.531604:0:15054:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 10 count 10 00000020:01000000:2.0:1789477505.532458:0:15036:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:2.0:1789477505.532523:0:15036:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.123@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1789477505.532965:0:15036:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.123@tcp lock: ffff9d0d50416200/0xafddb3c8f92827f3 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xafddb3c8f92827fa expref: -99 pid: 15036 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477505.532991:0:15036:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.123@tcp lock: ffff9d0d50416200/0xafddb3c8f92827f3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xafddb3c8f92827fa expref: -99 pid: 15036 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789477505.533039:0:15036:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1789477505.533042:0:15036:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9d0d7c06e000 10000000:01000000:2.0:1789477505.533045:0:15036:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9d0d7c06e000 10000000:01000000:2.0:1789477505.533049:0:15036:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1789477505.533056:0:15036:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9d0d7c06e000 from 1 10000000:01000000:2.0:1789477505.533059:0:15036:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1789477505.533099:0:15036:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.123@tcp lock: ffff9d0d50417600/0xafddb3c8f9282801 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15036 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477505.533108:0:15036:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.123@tcp lock: ffff9d0d50417600/0xafddb3c8f9282801 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15036 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477505.533120:0:15036:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.123@tcp lock: ffff9d0d50417600/0xafddb3c8f9282801 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15036 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789477505.533148:0:15036:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d7523c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:730ef4b7-dbd8-4cb5-9f31-5e7e04ae8864:15036:1876402802617088:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1789477505.533224:0:15036:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789477505.533278:0:15036:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d0d584b3b40 going to sleep for 11 seconds 00000100:00100000:3.0:1789477505.534636:0:14345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802617088 00000100:00100000:3.0:1789477505.534648:0:14345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802617088 00000100:00100000:3.0:1789477505.534695:0:14345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1789477505.534706:0:14345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d6ec55050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:730ef4b7-dbd8-4cb5-9f31-5e7e04ae8864+15:15036:x1876402802617088:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789477505.534724:0:14345:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789477505.534740:0:14345:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d0d49eca600/0xafddb3c8f9282808 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xafddb3c8f9282801 expref: -99 pid: 14345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477505.534769:0:14345:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d0d49eca600/0xafddb3c8f9282808 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xafddb3c8f9282801 expref: 16 pid: 14345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477505.534792:0:14345:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d0d49eca600/0xafddb3c8f9282808 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xafddb3c8f9282801 expref: 16 pid: 14345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477505.534803:0:14345:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d0d49eca600, rc 0) 00000100:00100000:3.0:1789477505.534863:0:14345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d6ec55050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:730ef4b7-dbd8-4cb5-9f31-5e7e04ae8864+16:15036:x1876402802617088:12345-0@lo:101:mount.lustre.0 Request processed in 159us (1639us total) trans 0 rc 0/0 00000100:00100000:3.0:1789477505.534870:0:14345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1789477505.537222:0:15036:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d7523c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:730ef4b7-dbd8-4cb5-9f31-5e7e04ae8864:15036:1876402802617088:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789477505.537259:0:15036:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.123@tcp lock: ffff9d0d50417600/0xafddb3c8f9282801 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xafddb3c8f9282808 expref: -99 pid: 15036 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477505.537275:0:15036:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.123@tcp lock: ffff9d0d50417600/0xafddb3c8f9282801 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xafddb3c8f9282808 expref: -99 pid: 15036 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1789477505.538284:0:15036:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000040:00080000:2.0:1789477505.540026:0:15036:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1789477505.540383:0:15036:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:2.0:1789477505.540434:0:15036:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:2.0:1789477505.540487:0:15036:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:2.0:1789477505.540732:0:15036:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:2.0:1789477505.540907:0:15036:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:2.0:1789477505.540966:0:15036:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:2.0:1789477505.541009:0:15036:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:2.0:1789477505.541057:0:15036:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:2.0:1789477505.541115:0:15036:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:2.0:1789477505.541157:0:15036:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:2.0:1789477505.541242:0:15036:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:2.0:1789477505.541294:0:15036:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:2.0:1789477505.541332:0:15036:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:2.0:1789477505.541367:0:15036:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:2.0:1789477505.541428:0:15036:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:2.0:1789477505.541487:0:15036:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:2.0:1789477505.541932:0:15036:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:2.0:1789477505.542038:0:15036:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:2.0:1789477505.542101:0:15036:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:2.0:1789477505.542140:0:15036:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:2.0:1789477505.542191:0:15036:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:2.0:1789477505.542229:0:15036:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:2.0:1789477505.542265:0:15036:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:2.0:1789477505.542315:0:15036:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:2.0:1789477505.542355:0:15036:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 128 off12440 00000040:00080000:2.0:1789477505.542391:0:15036:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12664 00000040:00080000:2.0:1789477505.542458:0:15036:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12888 00000040:00080000:2.0:1789477505.542909:0:15036:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off12968 00000040:00080000:2.0:1789477505.543025:0:15036:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13192 00000040:00080000:2.0:1789477505.543044:0:15036:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 29 count 30 00000100:00100000:2.0:1789477505.543165:0:15036:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d7523c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:730ef4b7-dbd8-4cb5-9f31-5e7e04ae8864:15036:1876402802617216:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789477505.543239:0:15036:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789477505.543338:0:15036:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d0d584b3b40 going to sleep for 11 seconds 00000100:00100000:0.0:1789477505.543848:0:14343:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802617216 00000100:00100000:0.0:1789477505.543859:0:14343:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802617216 00000100:00100000:0.0:1789477505.543922:0:14343:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1789477505.543934:0:14343:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d6ec54850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:730ef4b7-dbd8-4cb5-9f31-5e7e04ae8864+16:15036:x1876402802617216:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789477505.544240:0:14343:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d6ec54850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:730ef4b7-dbd8-4cb5-9f31-5e7e04ae8864+16:15036:x1876402802617216:12345-0@lo:501:mount.lustre.0 Request processed in 308us (1000us total) trans 0 rc 0/0 00000100:00100000:0.0:1789477505.544249:0:14343:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1789477505.544340:0:15036:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d7523c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:730ef4b7-dbd8-4cb5-9f31-5e7e04ae8864:15036:1876402802617216:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789477505.544387:0:15036:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d7523c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:730ef4b7-dbd8-4cb5-9f31-5e7e04ae8864:15036:1876402802617344:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1789477505.544432:0:15036:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789477505.544483:0:15036:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d0d584b3b40 going to sleep for 11 seconds 00000100:00100000:3.0:1789477505.544529:0:14344:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802617344 00000100:00100000:3.0:1789477505.544535:0:14344:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802617344 00000100:00100000:3.0:1789477505.544644:0:14344:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1789477505.544654:0:14344:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d6ec56850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:730ef4b7-dbd8-4cb5-9f31-5e7e04ae8864+16:15036:x1876402802617344:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1789477505.544959:0:14344:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d6ec56850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:730ef4b7-dbd8-4cb5-9f31-5e7e04ae8864+16:15036:x1876402802617344:12345-0@lo:503:mount.lustre.0 Request processed in 307us (527us total) trans 0 rc 0/0 00000100:00100000:3.0:1789477505.544967:0:14344:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1789477505.545022:0:15036:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d7523c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:730ef4b7-dbd8-4cb5-9f31-5e7e04ae8864:15036:1876402802617344:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1789477505.546339:0:15036:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1789477505.546478:0:15036:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d7523c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:730ef4b7-dbd8-4cb5-9f31-5e7e04ae8864:15036:1876402802617472:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789477505.546554:0:15036:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789477505.546639:0:14343:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802617472 00000100:00100000:0.0:1789477505.546647:0:14343:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802617472 00000100:00100000:2.0:1789477505.546680:0:15036:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d0d584b3b40 going to sleep for 11 seconds 00000100:00100000:0.0:1789477505.546712:0:14343:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1789477505.546723:0:14343:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d6ec54c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:730ef4b7-dbd8-4cb5-9f31-5e7e04ae8864+16:15036:x1876402802617472:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789477505.546953:0:14343:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d6ec54c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:730ef4b7-dbd8-4cb5-9f31-5e7e04ae8864+16:15036:x1876402802617472:12345-0@lo:502:mount.lustre.0 Request processed in 231us (398us total) trans 0 rc 0/0 00000100:00100000:0.0:1789477505.546962:0:14343:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1789477505.546994:0:15036:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d7523c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:730ef4b7-dbd8-4cb5-9f31-5e7e04ae8864:15036:1876402802617472:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1789477505.547633:0:15036:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:2.0:1789477505.547712:0:15036:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:2.0:1789477505.547745:0:15036:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:2.0:1789477505.547792:0:15036:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:2.0:1789477505.547827:0:15036:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:2.0:1789477505.547867:0:15036:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:2.0:1789477505.547894:0:15036:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:2.0:1789477505.547922:0:15036:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:2.0:1789477505.547965:0:15036:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:2.0:1789477505.547994:0:15036:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:2.0:1789477505.548037:0:15036:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:2.0:1789477505.548074:0:15036:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:2.0:1789477505.548101:0:15036:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:2.0:1789477505.548653:0:15036:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:2.0:1789477505.548874:0:15036:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:2.0:1789477505.548916:0:15036:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:2.0:1789477505.548951:0:15036:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:2.0:1789477505.549001:0:15036:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:2.0:1789477505.549038:0:15036:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:2.0:1789477505.549073:0:15036:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:2.0:1789477505.549523:0:15036:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:2.0:1789477505.549570:0:15036:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:2.0:1789477505.549644:0:15036:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:2.0:1789477505.549693:0:15036:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:2.0:1789477505.549739:0:15036:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 128 off12440 00000040:00080000:2.0:1789477505.549780:0:15036:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12664 00000040:00080000:2.0:1789477505.549861:0:15036:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12888 00000040:00080000:2.0:1789477505.549895:0:15036:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off12968 00000040:00080000:2.0:1789477505.549924:0:15036:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13192 00000040:00080000:2.0:1789477505.549963:0:15036:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13416 00000040:00080000:2.0:1789477505.549994:0:15036:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13504 00000040:00080000:2.0:1789477505.550021:0:15036:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13632 00000040:00080000:2.0:1789477505.550047:0:15036:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13776 00000040:00080000:2.0:1789477505.550089:0:15036:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13904 00000040:00080000:2.0:1789477505.550139:0:15036:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14128 00000040:00080000:2.0:1789477505.550206:0:15036:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14352 00000040:00080000:2.0:1789477505.550244:0:15036:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14432 00000040:00080000:2.0:1789477505.550299:0:15036:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14656 00000040:00080000:2.0:1789477505.550357:0:15036:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14880 00000040:00080000:2.0:1789477505.550393:0:15036:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 120 off15000 00000100:00100000:2.0:1789477505.550450:0:15036:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d7523c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:730ef4b7-dbd8-4cb5-9f31-5e7e04ae8864:15036:1876402802617600:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789477505.550553:0:15036:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789477505.550637:0:15036:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d0d584b3b40 going to sleep for 11 seconds 00000100:00100000:3.0:1789477505.551133:0:14344:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802617600 00000100:00100000:3.0:1789477505.551142:0:14344:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802617600 00000100:00100000:3.0:1789477505.551195:0:14344:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1789477505.551207:0:14344:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d6ec54450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:730ef4b7-dbd8-4cb5-9f31-5e7e04ae8864+16:15036:x1876402802617600:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789477505.551514:0:14344:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d6ec54450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:730ef4b7-dbd8-4cb5-9f31-5e7e04ae8864+16:15036:x1876402802617600:12345-0@lo:502:mount.lustre.0 Request processed in 307us (960us total) trans 0 rc 0/0 00000100:00100000:3.0:1789477505.551524:0:14344:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1789477505.551688:0:15036:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d7523c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:730ef4b7-dbd8-4cb5-9f31-5e7e04ae8864:15036:1876402802617600:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1789477505.551801:0:15036:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 224 off15224 00000040:00080000:0.0:1789477505.551815:0:15036:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 41 count 42 00000020:01000004:3.0:1789477505.553320:0:15059:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:3.0:1789477505.553343:0:15059:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff9d0d50b80000) 00000020:00000080:3.0:1789477505.553369:0:15059:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type lwp with refcount 2 00000020:01000004:3.0:1789477505.553493:0:15059:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9d0d7c06e000 from lustre-OST0000, refs=3 00000020:01000004:3.0:1789477505.553498:0:15059:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9d0d7c06e000 from lustre-OST0000, refs=3 00000020:01000004:3.0:1789477505.553508:0:15059:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9d0d7c06e000 3 00010000:00080000:3.0:1789477505.553558:0:15059:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9d0d728f6000@lustre-MDT0000-lwp-OST0000: add connection 192.168.201.123@tcp at head 00010000:00010000:3.0:1789477505.556944:0:15059:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-4 is initialized 00000020:00000080:3.0:1789477505.560445:0:15059:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:3.0:1789477505.560503:0:15059:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1789477505.560522:0:15059:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0xafddb3c8f9282816 00000100:00080000:3.0:1789477505.560536:0:15059:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1789477505.560550:0:15059:0:(import.c:625:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9d0d728f6000 using connection 192.168.201.123@tcp/0@lo 00000100:00100000:3.0:1789477505.560615:0:15059:0:(import.c:827:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9d0d58073480 x1876402802617728/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1789477505.560640:0:15059:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1789477505.560667:0:12773:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789477505.560671:0:12773:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1789477505.560674:0:12773:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789477505.560677:0:12773:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1789477505.560709:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789477505.560909:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d58070700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3311:1876402802617856:0@lo:400:kworker.0 00000100:00100000:3.0:1789477505.560971:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000040:00080000:3.0:1789477505.561345:0:15059:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 42 count 42 00000100:00100000:0.0:1789477505.561623:0:14351:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802617856 00000100:00100000:0.0:1789477505.561632:0:14351:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802617856 00000100:00100000:0.0:1789477505.561681:0:14351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1789477505.561691:0:14351:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d58071880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1876402802617856:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789477505.561775:0:14351:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d58071880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1876402802617856:12345-0@lo:400:kworker.0 Request processed in 86us (803us total) trans 0 rc 0/0 00000100:00100000:0.0:1789477505.561783:0:14351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000020:01000000:0.0:1789477505.561834:0:15036:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:0.0:1789477505.561867:0:15036:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.123@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1789477505.561886:0:15036:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.123@tcp lock: ffff9d0d50417600/0xafddb3c8f9282801 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xafddb3c8f9282808 expref: -99 pid: 15036 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477505.561899:0:15036:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.123@tcp lock: ffff9d0d50417600/0xafddb3c8f9282801 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xafddb3c8f9282808 expref: -99 pid: 15036 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1789477505.561955:0:15036:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1789477505.561958:0:15036:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1789477505.561961:0:15036:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789477505.561966:0:15036:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789477505.561969:0:15036:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789477505.561971:0:15036:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789477505.561972:0:15036:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1789477505.561975:0:15036:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789477505.561976:0:15036:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1789477505.561981:0:15036:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020002 00000020:01000004:0.0:1789477505.561984:0:15036:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1789477505.561985:0:15036:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1789477505.561986:0:15036:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789477505.561987:0:15036:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789477505.561988:0:15036:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789477505.561991:0:15036:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789477505.561994:0:15036:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1789477505.561997:0:15036:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789477505.561999:0:15036:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1789477505.562022:0:15036:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:0.0:1789477505.562040:0:15036:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d6d482a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:730ef4b7-dbd8-4cb5-9f31-5e7e04ae8864:15036:1876402802617984:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1789477505.562085:0:15036:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789477505.562117:0:15036:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d0d515b4d80 going to sleep for 11 seconds 00000100:00100000:0.0:1789477505.562143:0:14343:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802617984 00000100:00100000:0.0:1789477505.562147:0:14343:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802617984 00000100:00100000:0.0:1789477505.562188:0:14343:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1789477505.562196:0:14343:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d6ec57850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:730ef4b7-dbd8-4cb5-9f31-5e7e04ae8864+16:15036:x1876402802617984:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1789477505.562234:0:14343:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:0.0:1789477505.562372:0:14343:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00010000:00080000:3.0:1789477505.563121:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9d0d58070700 x1876402802617856/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789477521 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789477505.563141:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d58070700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3311:1876402802617856:0@lo:400:kworker.0 00000100:00100000:3.0:1789477505.563653:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d58073480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3309:1876402802617728:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1789477505.563720:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789477505.563805:0:14352:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802617728 00000100:00100000:3.0:1789477505.563824:0:14352:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802617728 00000100:00100000:3.0:1789477505.563859:0:14352:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789477505.563866:0:14352:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d58070700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3309:x1876402802617728:12345-0@lo:38:llog_process_th.0 00010000:00080000:3.0:1789477505.563891:0:14352:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 450 last 0 00000020:00000080:3.0:1789477505.563925:0:14352:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0xafddb3c8f928281d 00000004:00100000:3.0:1789477505.563942:0:14352:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1789477505.563984:0:14352:0:(import.c:65:import_set_state_nolock()) ffff9d0d45330000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789477505.564049:0:14352:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d58070700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1876402802617728:12345-0@lo:38:llog_process_th.0 Request processed in 181us (331us total) trans 0 rc 0/0 00000100:00100000:3.0:1789477505.564056:0:14352:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:3.0:1789477505.564088:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9d0d58073480 x1876402802617728/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789477515 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789477505.564098:0:3309:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1789477505.564106:0:3309:0:(import.c:1133:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 2 00000100:00080000:3.0:1789477505.564113:0:3309:0:(import.c:957:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:3.0:1789477505.564118:0:3309:0:(import.c:1214:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1789477505.564120:0:3309:0:(import.c:65:import_set_state_nolock()) ffff9d0d728f6000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1789477505.564126:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d58073480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3309:1876402802617728:0@lo:38:llog_process_th.0 20000000:01000000:1.0:1789477505.601507:0:14343:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1789477505.601536:0:14343:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:0.0:1789477505.601695:0:14366:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1789477505.601702:0:14366:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1789477505.601737:0:14366:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9d0d50be4c00/0xafddb3c8f9282824 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477505.601760:0:14366:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9d0d50417e00/0xafddb3c8f9282791 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xafddb3c8f928278a expref: 16 pid: 14344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477505.601771:0:14366:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9d0d50be4c00/0xafddb3c8f9282824 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477505.601827:0:14366:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9d0d50417e00/0xafddb3c8f9282791 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xafddb3c8f928278a expref: 16 pid: 14344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477505.601842:0:14366:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9d0d50417e00/0xafddb3c8f9282791 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xafddb3c8f928278a expref: 16 pid: 14344 timeout: 550 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789477505.601860:0:14366:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d6d481500 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14366:1876402802618112:0@lo:104: 00000100:00100000:0.0:1789477505.601936:0:14366:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789477505.601986:0:14366:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d0d4756b900 going to sleep for 11 seconds 00000100:00100000:2.0:1789477505.602124:0:14333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802618112 00000100:00100000:2.0:1789477505.602132:0:14333:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802618112 00000100:00100000:2.0:1789477505.602180:0:14333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789477505.602189:0:14333:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d6d480380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:730ef4b7-dbd8-4cb5-9f31-5e7e04ae8864+3:14366:x1876402802618112:12345-0@lo:104: 00010000:00010000:2.0:1789477505.602200:0:14333:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.123@tcp lock: ffff9d0d50417a00/0xafddb3c8f928278a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xafddb3c8f9282791 expref: -99 pid: 14347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477505.602264:0:14333:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1789477505.602270:0:14333:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d6d480380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:730ef4b7-dbd8-4cb5-9f31-5e7e04ae8864+3:14366:x1876402802618112:12345-0@lo:104: Request processed in 82us (334us total) trans 0 rc 0/0 00000100:00100000:2.0:1789477505.602277:0:14333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:2.0:1789477505.602297:0:14338:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789477505.602303:0:14338:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.123@tcp lock: ffff9d0d50417a00/0xafddb3c8f928278a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xafddb3c8f9282791 expref: -99 pid: 14347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477505.602311:0:14338:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d0d50417a00 already unused, calling callback (ffffffffc1bb3c20) 10000000:00010000:2.0:1789477505.602315:0:14338:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.123@tcp lock: ffff9d0d50417a00/0xafddb3c8f928278a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xafddb3c8f9282791 expref: -99 pid: 14347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477505.602323:0:14338:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.123@tcp lock: ffff9d0d50417a00/0xafddb3c8f928278a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xafddb3c8f9282791 expref: -99 pid: 14347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789477505.602331:0:14338:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.123@tcp lock: ffff9d0d50417a00/0xafddb3c8f928278a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xafddb3c8f9282791 expref: -99 pid: 14347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789477505.602337:0:14338:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1789477505.602360:0:14338:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.123@tcp lock: ffff9d0d50417a00/0xafddb3c8f928278a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xafddb3c8f9282791 expref: -99 pid: 14347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477505.602366:0:14338:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789477505.602384:0:14338:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.123@tcp lock: ffff9d0d50417a00/0xafddb3c8f928278a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xafddb3c8f9282791 expref: -99 pid: 14347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477505.602400:0:14338:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.123@tcp lock: ffff9d0d50417a00/0xafddb3c8f928278a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xafddb3c8f9282791 expref: -99 pid: 14347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477505.602416:0:14338:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789477505.602418:0:14338:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789477505.602420:0:14338:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789477505.602432:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789477505.602442:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d7523f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:730ef4b7-dbd8-4cb5-9f31-5e7e04ae8864:3310:1876402802618240:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789477505.602480:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789477505.602525:0:14335:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802618240 00000100:00100000:2.0:1789477505.602529:0:14335:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802618240 00010000:00010000:2.0:1789477505.602543:0:14335:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9d0d50417e00/0xafddb3c8f9282791 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xafddb3c8f928278a expref: 17 pid: 14344 timeout: 550 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789477505.602795:0:14366:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d6d481500 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14366:1876402802618112:0@lo:104: 00010000:00010000:0.0:1789477505.602814:0:14366:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9d0d50be4c00/0xafddb3c8f9282824 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789477505.602892:0:14335:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789477505.604101:0:14335:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d7523c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:730ef4b7-dbd8-4cb5-9f31-5e7e04ae8864+17:3310:x1876402802618240:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789477505.604131:0:14335:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789477505.604140:0:14335:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9d0d50417e00/0xafddb3c8f9282791 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xafddb3c8f928278a expref: 17 pid: 14344 timeout: 550 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477505.604157:0:14335:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9d0d50417e00/0xafddb3c8f9282791 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xafddb3c8f928278a expref: 17 pid: 14344 timeout: 550 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477505.604176:0:14335:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d0d50417e00/0xafddb3c8f9282791 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xafddb3c8f928278a expref: 17 pid: 14344 timeout: 550 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477505.604192:0:14335:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9d0d50be4c00/0xafddb3c8f9282824 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477505.604215:0:14335:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d0d50be4c00/0xafddb3c8f9282824 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1789477505.604450:0:14335:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.002748326s 00010000:00010000:2.0:1789477505.604457:0:14335:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9d0d50be4c00/0xafddb3c8f9282824 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477505.604475:0:14335:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9d0d50be4c00/0xafddb3c8f9282824 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477505.604482:0:14335:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9d0d50be4c00/0xafddb3c8f9282824 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477505.604490:0:14335:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9d0d50be4c00/0xafddb3c8f9282824 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477505.604496:0:14335:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d0d50be4c00 already unused, calling callback (ffffffffc15972a0) 00010000:00010000:2.0:1789477505.604501:0:14335:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9d0d50be4c00/0xafddb3c8f9282824 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477505.604507:0:14335:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9d0d50be4c00/0xafddb3c8f9282824 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477505.616523:0:14366:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9d0d50be4c00/0xafddb3c8f9282824 lrc: 5/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477505.616545:0:14366:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9d0d50be4c00/0xafddb3c8f9282824 lrc: 5/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477505.625067:0:14335:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9d0d50be4c00/0xafddb3c8f9282824 lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477505.625092:0:14335:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d0d50be4c00/0xafddb3c8f9282824 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477505.625131:0:14335:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789477505.625294:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d7523f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:730ef4b7-dbd8-4cb5-9f31-5e7e04ae8864:3310:1876402802618240:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789477505.626595:0:14335:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d7523c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:730ef4b7-dbd8-4cb5-9f31-5e7e04ae8864+16:3310:x1876402802618240:12345-0@lo:103:ldlm_bl.0 Request processed in 23660us (24078us total) trans 0 rc 0/0 00000100:00100000:0.0:1789477505.626904:0:14343:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d6ec57850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:730ef4b7-dbd8-4cb5-9f31-5e7e04ae8864+16:15036:x1876402802617984:12345-0@lo:253:mount.lustre.0 Request processed in 64707us (64815us total) trans 0 rc 0/0 00000100:00100000:0.0:1789477505.626918:0:14343:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1789477505.627035:0:15036:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d6d482a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:730ef4b7-dbd8-4cb5-9f31-5e7e04ae8864:15036:1876402802617984:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1789477505.627053:0:15036:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:1.0:1789477505.627057:0:15036:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1789477505.627059:0:15036:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1789477505.627060:0:15036:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789477505.627061:0:15036:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789477505.627062:0:15036:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789477505.627063:0:15036:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789477505.627133:0:15036:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1789477505.627136:0:15036:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789477505.627137:0:15036:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1789477505.627152:0:15036:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00000100:00100000:2.0:1789477505.627727:0:14335:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00080000:10000000:0.0:1789477505.632013:0:15036:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:0.0:1789477505.632216:0:15036:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:0.0:1789477505.632405:0:15036:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:0.0:1789477505.632575:0:15036:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:0.0:1789477505.632910:0:15036:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:0.0:1789477505.633084:0:15036:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:1.0:1789477505.639025:0:15036:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934592 00002000:00080000:3.0:1789477505.737894:0:15036:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:3.0:1789477505.737904:0:15036:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:3.0:1789477505.737939:0:15036:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1789477505.738010:0:15036:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.201.123@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1789477505.738023:0:15036:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=48 00000080:00000004:3.0:1789477505.738055:0:15036:0:(super25.c:182:lustre_fill_super()) lustre-ost1/ost1: Mount complete 00010000:00010000:3.0:1789477505.840412:0:14339:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1789477506.735713:0:14347:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1789477506.735725:0:14347:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9d0c43499000 from 7 10000000:01000000:2.0:1789477506.735732:0:14347:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1789477506.735797:0:14347:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.123@tcp lock: ffff9d0d50416600/0xafddb3c8f928282b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477506.735811:0:14347:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.123@tcp lock: ffff9d0d50416600/0xafddb3c8f928282b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477506.735826:0:14347:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.123@tcp lock: ffff9d0d50416600/0xafddb3c8f928282b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789477506.735857:0:14347:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d7523c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:730ef4b7-dbd8-4cb5-9f31-5e7e04ae8864:14347:1876402802618368:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789477506.735948:0:14347:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789477506.736018:0:14347:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d0d5046c900 going to sleep for 11 seconds 00000100:00100000:3.0:1789477506.739423:0:14345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802618368 00000100:00100000:3.0:1789477506.739459:0:14345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802618368 00000100:00100000:3.0:1789477506.739564:0:14345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1789477506.739618:0:14345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d6ec56450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:730ef4b7-dbd8-4cb5-9f31-5e7e04ae8864+15:14347:x1876402802618368:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789477506.739643:0:14345:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789477506.739672:0:14345:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d0d49ecae00/0xafddb3c8f9282832 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xafddb3c8f928282b expref: -99 pid: 14345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477506.739715:0:14345:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d0d49ecae00/0xafddb3c8f9282832 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xafddb3c8f928282b expref: 16 pid: 14345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477506.739729:0:14345:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d0d49ecae00/0xafddb3c8f9282832 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xafddb3c8f928282b expref: 16 pid: 14345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477506.739740:0:14345:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d0d49ecae00, rc 0) 00000100:00100000:3.0:1789477506.740062:0:14345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d6ec56450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:730ef4b7-dbd8-4cb5-9f31-5e7e04ae8864+16:14347:x1876402802618368:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 447us (4111us total) trans 0 rc 0/0 00000100:00100000:3.0:1789477506.740071:0:14345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1789477506.740942:0:14347:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d7523c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:730ef4b7-dbd8-4cb5-9f31-5e7e04ae8864:14347:1876402802618368:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789477506.740984:0:14347:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.123@tcp lock: ffff9d0d50416600/0xafddb3c8f928282b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xafddb3c8f9282832 expref: -99 pid: 14347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477506.740999:0:14347:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.123@tcp lock: ffff9d0d50416600/0xafddb3c8f928282b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xafddb3c8f9282832 expref: -99 pid: 14347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789477506.741105:0:14347:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d7523c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:730ef4b7-dbd8-4cb5-9f31-5e7e04ae8864:14347:1876402802618496:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1789477506.741190:0:14347:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789477506.741260:0:14347:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d0d5046c900 going to sleep for 11 seconds 00000100:00100000:3.0:1789477506.742524:0:14343:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802618496 00000100:00100000:3.0:1789477506.742539:0:14343:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802618496 00000100:00100000:3.0:1789477506.742668:0:14343:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1789477506.742682:0:14343:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d6ec54050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:730ef4b7-dbd8-4cb5-9f31-5e7e04ae8864+16:14347:x1876402802618496:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:3.0:1789477506.742710:0:14343:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1789477506.742739:0:14343:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1789477506.742742:0:14343:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 7 00000100:00100000:3.0:1789477506.742900:0:14343:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d6ec54050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:730ef4b7-dbd8-4cb5-9f31-5e7e04ae8864+16:14347:x1876402802618496:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 221us (1709us total) trans 0 rc 0/0 00000100:00100000:3.0:1789477506.742909:0:14343:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1789477506.743403:0:14347:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d7523c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:730ef4b7-dbd8-4cb5-9f31-5e7e04ae8864:14347:1876402802618496:0@lo:256:ll_cfg_requeue.0 10000000:01000000:0.0:1789477506.743534:0:14347:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.123@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1789477506.743547:0:14347:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.123@tcp lock: ffff9d0d50416600/0xafddb3c8f928282b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xafddb3c8f9282832 expref: -99 pid: 14347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477506.743560:0:14347:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.123@tcp lock: ffff9d0d50416600/0xafddb3c8f928282b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xafddb3c8f9282832 expref: -99 pid: 14347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477506.864596:0:14338:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789477507.888244:0:14339:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789477508.921888:0:14338:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789477509.944098:0:14339:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1789477510.577754:0:12773:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789477510.577762:0:12773:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1789477510.577771:0:12773:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789477510.577774:0:12773:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1789477510.577884:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d58073480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:730ef4b7-dbd8-4cb5-9f31-5e7e04ae8864:3312:1876402802618624:0@lo:400:kworker.0 00000100:00100000:1.0:1789477510.577960:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789477510.578021:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789477510.578028:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d58070380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3312:1876402802618752:0@lo:400:kworker.0 00000100:00100000:1.0:1789477510.578063:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789477510.578112:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d58070000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3310:1876402802618880:0@lo:400:kworker.0 00000100:00100000:1.0:1789477510.578140:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789477510.578171:0:14350:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802618752 00000100:00100000:1.0:1789477510.578177:0:14350:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802618752 00000100:00100000:1.0:1789477510.578209:0:14350:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802618880 00000100:00100000:1.0:1789477510.578210:0:14350:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802618880 00000100:00100000:1.0:1789477510.578227:0:14350:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789477510.578233:0:14350:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d7f700380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1876402802618752:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789477510.578279:0:14350:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d7f700380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1876402802618752:12345-0@lo:400:kworker.0 Request processed in 46us (216us total) trans 0 rc 0/0 00000100:00100000:1.0:1789477510.578285:0:14350:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789477510.578297:0:14350:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1789477510.578301:0:14350:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d7f700a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1876402802618880:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789477510.578317:0:14350:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d7f700a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1876402802618880:12345-0@lo:400:kworker.0 Request processed in 17us (177us total) trans 0 rc 0/0 00000100:00100000:1.0:1789477510.578321:0:14350:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:1.0:1789477510.578359:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9d0d58070000 x1876402802618880/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789477526 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789477510.578383:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d58070000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3310:1876402802618880:0@lo:400:kworker.0 00010000:00080000:1.0:1789477510.578414:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9d0d58070380 x1876402802618752/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789477526 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789477510.578424:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d58070380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3312:1876402802618752:0@lo:400:kworker.0 00000100:00100000:3.0:1789477510.578694:0:14345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802618624 00000100:00100000:3.0:1789477510.578699:0:14345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802618624 00000100:00100000:3.0:1789477510.578732:0:14345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1789477510.578740:0:14345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d6ec57050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:730ef4b7-dbd8-4cb5-9f31-5e7e04ae8864+16:3312:x1876402802618624:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789477510.578781:0:14345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d6ec57050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:730ef4b7-dbd8-4cb5-9f31-5e7e04ae8864+16:3312:x1876402802618624:12345-0@lo:400:kworker.0 Request processed in 42us (821us total) trans 0 rc 0/0 00000100:00100000:3.0:1789477510.578787:0:14345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00080000:3.0:1789477510.578825:0:14346:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789477510.579707:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d58073480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:730ef4b7-dbd8-4cb5-9f31-5e7e04ae8864:3312:1876402802618624:0@lo:400:kworker.0 00010000:00010000:2.0:1789477510.961199:0:14338:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1789477511.409170:0:14385:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1789477511.983889:0:14339:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789477513.010823:0:14338:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1789477513.289443:0:15403:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg123-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:3.0:1789477514.033722:0:14339:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789477514.801027:0:3309:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789477499/real 1789477499] req@ffff9d0d6d483480 x1876402802614400/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789477514 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789477514.801072:0:3309:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9d0d6d483480 x1876402802614400/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789477514 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789477514.801084:0:3309:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789477499/real 1789477499] req@ffff9d0d6d481880 x1876402802614528/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789477514 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789477514.801098:0:3309:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9d0d6d481880 x1876402802614528/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789477514 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1789477514.801122:0:3309:0:(import.c:65:import_set_state_nolock()) ffff9d0d505c1000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1789477514.801144:0:3309:0:(import.c:1512:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1789477514.801149:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d6d483480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3309:1876402802614400:0@lo:8:kworker.0 00000100:00080000:2.0:1789477514.801157:0:3309:0:(import.c:65:import_set_state_nolock()) ffff9d0d4823f000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1789477514.801163:0:3309:0:(import.c:1512:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1789477514.801166:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d6d481880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3309:1876402802614528:0@lo:8:kworker.0 00000100:00080000:3.0:1789477514.811708:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789477514.811717:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1789477514.811722:0:36:0:(import.c:65:import_set_state_nolock()) ffff9d0d505c1000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1789477514.811735:0:36:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 444 00000100:00080000:3.0:1789477514.811742:0:36:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1789477514.811756:0:36:0:(import.c:625:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9d0d505c1000 using connection 192.168.201.123@tcp/0@lo 00000100:00100000:3.0:1789477514.811786:0:36:0:(import.c:827:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9d0d58072d80 x1876402802619136/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1789477514.811805:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789477514.811808:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1789477514.811810:0:36:0:(import.c:65:import_set_state_nolock()) ffff9d0d4823f000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1789477514.811813:0:36:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 444 00000100:00080000:3.0:1789477514.811816:0:36:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1789477514.811830:0:36:0:(import.c:625:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9d0d4823f000 using connection 192.168.201.123@tcp/0@lo 00000100:00100000:3.0:1789477514.811845:0:36:0:(import.c:827:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9d0d58073480 x1876402802619264/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1789477514.811914:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d58072680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:730ef4b7-dbd8-4cb5-9f31-5e7e04ae8864:3311:1876402802619008:0@lo:400:kworker.0 00000100:00100000:3.0:1789477514.812008:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789477514.812092:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d58070380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3312:1876402802619392:0@lo:400:kworker.0 00000100:00100000:3.0:1789477514.812125:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789477514.812152:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789477514.812158:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d58070000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3312:1876402802619520:0@lo:400:kworker.0 00000100:00100000:3.0:1789477514.812181:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789477514.812213:0:14344:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802619008 00000100:00100000:3.0:1789477514.812222:0:14344:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802619008 00000100:00100000:3.0:1789477514.812278:0:14344:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1789477514.812288:0:14344:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d6ec56c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:730ef4b7-dbd8-4cb5-9f31-5e7e04ae8864+16:3311:x1876402802619008:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789477514.820274:0:14350:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802619392 00000100:00100000:3.0:1789477514.820295:0:14350:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802619392 00000100:00100000:3.0:1789477514.820400:0:14350:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802619520 00000100:00100000:3.0:1789477514.820404:0:14350:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802619520 00000100:00100000:3.0:1789477514.820443:0:14350:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1789477514.820455:0:14350:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d58071c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1876402802619392:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789477514.821261:0:14350:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d58071c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1876402802619392:12345-0@lo:400:kworker.0 Request processed in 804us (9130us total) trans 0 rc 0/0 00000100:00100000:3.0:1789477514.821273:0:14350:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1789477514.821315:0:14350:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1789477514.821326:0:14350:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d58073100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1876402802619520:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789477514.821375:0:14350:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d58073100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1876402802619520:12345-0@lo:400:kworker.0 Request processed in 53us (9194us total) trans 0 rc 0/0 00000100:00100000:3.0:1789477514.821399:0:14350:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00080000:3.0:1789477514.821443:0:14346:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1789477514.821487:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9d0d58070000 x1876402802619520/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789477530 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789477514.821508:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d58070000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3312:1876402802619520:0@lo:400:kworker.0 00010000:00080000:3.0:1789477514.821524:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9d0d58070380 x1876402802619392/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789477530 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789477514.821532:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d58070380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3312:1876402802619392:0@lo:400:kworker.0 00000100:00100000:3.0:1789477514.822263:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d58072d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3309:1876402802619136:0@lo:8:kworker.0 00000100:00100000:3.0:1789477514.822342:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789477514.822387:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d58073480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3309:1876402802619264:0@lo:8:kworker.0 00000100:00100000:3.0:1789477514.822411:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789477514.822483:0:15037:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802619136 00000100:00100000:3.0:1789477514.822492:0:15037:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802619136 00000100:00100000:3.0:1789477514.822524:0:15037:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802619264 00000100:00100000:3.0:1789477514.822526:0:15037:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802619264 00000100:00100000:3.0:1789477514.822537:0:15037:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789477514.822543:0:15037:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d58070380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3309:x1876402802619136:12345-0@lo:8:kworker.0 00010000:00080000:3.0:1789477514.822601:0:15037:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 459 last 0 00000020:00000080:3.0:1789477514.822652:0:15037:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xafddb3c8f9282839 00002000:00100000:3.0:1789477514.822673:0:15037:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff9d0d728f4000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113954 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:3.0:1789477514.822677:0:15037:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:3.0:1789477514.822680:0:15037:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:3.0:1789477514.823364:0:15037:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1789477514.823408:0:15037:0:(import.c:65:import_set_state_nolock()) ffff9d0d728f7000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789477514.838075:0:15037:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d58070380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3309:x1876402802619136:12345-0@lo:8:kworker.0 Request processed in 15514us (15716us total) trans 0 rc 0/0 00000100:00100000:3.0:1789477514.838096:0:15037:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789477514.838147:0:15037:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789477514.838156:0:15037:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d58070000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3309:x1876402802619264:12345-0@lo:8:kworker.0 00010000:00020000:3.0:1789477514.838183:0:15037:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00010000:00080000:1.0:1789477514.841807:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9d0d58072d80 x1876402802619136/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1789477534 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789477514.841827:0:3309:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1789477514.841842:0:3309:0:(import.c:1133:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 2 00000100:00080000:1.0:1789477514.841855:0:3309:0:(import.c:957:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:1.0:1789477514.841863:0:3309:0:(import.c:1214:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:1.0:1789477514.841894:0:3309:0:(import.c:65:import_set_state_nolock()) ffff9d0d505c1000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:1.0:1789477514.841924:0:3309:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1789477514.841933:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d58072d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3309:1876402802619136:0@lo:8:kworker.0 00000004:00080000:1.0:1789477514.841970:0:14372:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:0.0:1789477514.842031:0:14373:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x240000400:0x5:0x0] 00000100:00100000:0.0:1789477514.842066:0:14373:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d6d482d80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14373:1876402802619776:0@lo:5:osp-pre-0-0.0 00000100:00100000:0.0:1789477514.842162:0:14373:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789477514.842208:0:14373:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d0d58508b40 going to sleep for 11 seconds 00000100:00100000:0.0:1789477514.842230:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d6d481500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1876402802619648:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789477514.842266:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:1.0:1789477514.843067:0:14372:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 459914487406ns, next at 0ns, rc = 0 00000100:00100000:1.0:1789477514.843142:0:15041:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802619648 00000100:00100000:1.0:1789477514.843152:0:15041:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802619648 00000100:00100000:1.0:1789477514.843218:0:15041:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789477514.843229:0:15041:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d6d481880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3310:x1876402802619648:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789477514.843270:0:15041:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789477514.845981:0:15041:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d6d481880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3310:x1876402802619648:12345-0@lo:13:osp-pre-0-0.0 Request processed in 2737us (3697us total) trans 0 rc 0/0 00000100:00100000:1.0:1789477514.846001:0:15041:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:1.0:1789477514.846054:0:14346:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1789477514.846108:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9d0d6d481500 x1876402802619648/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789477530 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789477514.846138:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d6d481500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1876402802619648:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789477514.846193:0:15039:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:1.0:1789477514.846202:0:15039:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:0.0:1789477514.848376:0:15039:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802619776 00000100:00100000:0.0:1789477514.848394:0:15039:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802619776 00000100:00100000:1.0:1789477514.852165:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789477514.852192:0:15469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d6d482300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:14373:x1876402802619776:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:1.0:1789477514.864963:0:15469:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x240000400 00002000:00080000:1.0:1789477514.864980:0:15469:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -28 00002000:02000040:1.0:1789477514.864987:0:15469:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x240000400:6 to 0x240000400:33) 00000100:00100000:3.0:1789477514.869873:0:15037:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d58070000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3309:x1876402802619264:12345-0@lo:8:kworker.0 Request processed in 31415us (47158us total) trans 0 rc -19/-19 00000100:00100000:3.0:1789477514.869894:0:15037:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789477514.870011:0:14344:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d6ec56c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:730ef4b7-dbd8-4cb5-9f31-5e7e04ae8864+16:3311:x1876402802619008:12345-0@lo:400:kworker.0 Request processed in 57724us (58002us total) trans 0 rc 0/0 00000100:00100000:3.0:1789477514.870022:0:14344:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1789477514.872360:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d58072680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:730ef4b7-dbd8-4cb5-9f31-5e7e04ae8864:3311:1876402802619008:0@lo:400:kworker.0 00000100:00080000:3.0:1789477514.884737:0:3309:0:(import.c:65:import_set_state_nolock()) ffff9d0d4823f000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1789477514.884756:0:3309:0:(import.c:1512:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1789477514.884763:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d58073480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3309:1876402802619264:0@lo:8:kworker.0 00002000:00010000:1.0:1789477514.888366:0:15469:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789477514.888386:0:15469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000034a55d1e/0xafddb3c8f9282840 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477514.888420:0:15469:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x21:0x0].0x0 since=459s v=(0 0) 00010000:00010000:1.0:1789477514.888426:0:15469:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789477514.888434:0:15469:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000034a55d1e/0xafddb3c8f9282840 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477514.888456:0:15469:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000034a55d1e/0xafddb3c8f9282840 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477514.888469:0:15469:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000034a55d1e/0xafddb3c8f9282840 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477514.888478:0:15469:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000034a55d1e/0xafddb3c8f9282840 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477514.888523:0:15469:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1789477514.889073:0:15469:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789477514.889081:0:15469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003981344c/0xafddb3c8f9282847 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477514.889091:0:15469:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x20:0x0].0x0 since=459s v=(0 0) 00010000:00010000:1.0:1789477514.889094:0:15469:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789477514.889098:0:15469:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003981344c/0xafddb3c8f9282847 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477514.889108:0:15469:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003981344c/0xafddb3c8f9282847 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477514.889128:0:15469:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003981344c/0xafddb3c8f9282847 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477514.889136:0:15469:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003981344c/0xafddb3c8f9282847 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477514.889157:0:15469:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1789477514.889173:0:14339:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1789477514.889181:0:14339:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000034a55d1e/0xafddb3c8f9282840 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477514.889190:0:14339:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d0d7f519a00 already unused, calling callback (ffffffffc15972a0) 00010000:00010000:1.0:1789477514.889196:0:14339:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000034a55d1e/0xafddb3c8f9282840 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477514.889205:0:14339:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000034a55d1e/0xafddb3c8f9282840 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477514.889223:0:14339:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000034a55d1e/0xafddb3c8f9282840 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477514.889230:0:14339:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000034a55d1e/0xafddb3c8f9282840 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477514.889251:0:14339:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789477514.889261:0:14339:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003981344c/0xafddb3c8f9282847 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477514.889268:0:14339:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d0d7f518e00 already unused, calling callback (ffffffffc15972a0) 00010000:00010000:1.0:1789477514.889271:0:14339:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003981344c/0xafddb3c8f9282847 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477514.889278:0:14339:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003981344c/0xafddb3c8f9282847 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477514.889289:0:14339:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003981344c/0xafddb3c8f9282847 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477514.889296:0:14339:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003981344c/0xafddb3c8f9282847 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477514.891402:0:14338:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789477514.897355:0:14339:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789477514.897359:0:14339:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789477514.897363:0:14339:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789477514.899850:0:15469:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789477514.899870:0:15469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000aace08ed/0xafddb3c8f928284e lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477514.899896:0:15469:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1f:0x0].0x0 since=459s v=(0 0) 00010000:00010000:1.0:1789477514.899901:0:15469:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789477514.899910:0:15469:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000aace08ed/0xafddb3c8f928284e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477514.899946:0:15469:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000aace08ed/0xafddb3c8f928284e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477514.899959:0:15469:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000aace08ed/0xafddb3c8f928284e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477514.899968:0:15469:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000aace08ed/0xafddb3c8f928284e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477514.899999:0:15469:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789477514.900010:0:14338:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789477514.900019:0:14338:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000aace08ed/0xafddb3c8f928284e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477514.900027:0:14338:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d0d7f518200 already unused, calling callback (ffffffffc15972a0) 00010000:00010000:2.0:1789477514.900033:0:14338:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000aace08ed/0xafddb3c8f928284e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477514.900049:0:14338:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000aace08ed/0xafddb3c8f928284e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477514.900072:0:14338:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000aace08ed/0xafddb3c8f928284e lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477514.900080:0:14338:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000aace08ed/0xafddb3c8f928284e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477514.900100:0:14338:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789477514.900102:0:14338:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789477514.900104:0:14338:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789477514.901532:0:15469:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789477514.901549:0:15469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a8565f92/0xafddb3c8f9282855 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477514.901568:0:15469:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1e:0x0].0x0 since=459s v=(0 0) 00010000:00010000:1.0:1789477514.901573:0:15469:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789477514.902084:0:15469:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a8565f92/0xafddb3c8f9282855 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477514.902102:0:15469:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a8565f92/0xafddb3c8f9282855 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477514.902114:0:15469:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a8565f92/0xafddb3c8f9282855 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477514.902143:0:15469:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a8565f92/0xafddb3c8f9282855 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477514.902171:0:15469:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789477514.904272:0:14339:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789477514.904293:0:14339:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a8565f92/0xafddb3c8f9282855 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477514.907326:0:14339:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d0d7f519c00 already unused, calling callback (ffffffffc15972a0) 00010000:00010000:3.0:1789477514.907338:0:14339:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a8565f92/0xafddb3c8f9282855 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477514.907353:0:14339:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a8565f92/0xafddb3c8f9282855 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477514.907403:0:14339:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a8565f92/0xafddb3c8f9282855 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477514.907411:0:14339:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a8565f92/0xafddb3c8f9282855 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477514.907443:0:14339:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789477514.907446:0:14339:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789477514.907449:0:14339:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789477514.909317:0:15469:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789477514.909334:0:15469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003981344c/0xafddb3c8f928285c lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477514.909356:0:15469:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1d:0x0].0x0 since=459s v=(0 0) 00010000:00010000:1.0:1789477514.909362:0:15469:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789477514.909370:0:15469:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003981344c/0xafddb3c8f928285c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477514.909386:0:15469:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003981344c/0xafddb3c8f928285c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477514.909395:0:15469:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003981344c/0xafddb3c8f928285c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477514.909403:0:15469:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003981344c/0xafddb3c8f928285c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477514.909438:0:15469:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789477514.909460:0:14338:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789477514.909469:0:14338:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003981344c/0xafddb3c8f928285c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477514.909478:0:14338:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d0d7f518e00 already unused, calling callback (ffffffffc15972a0) 00010000:00010000:3.0:1789477514.909483:0:14338:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003981344c/0xafddb3c8f928285c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477514.909494:0:14338:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003981344c/0xafddb3c8f928285c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477514.909513:0:14338:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003981344c/0xafddb3c8f928285c lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477514.909521:0:14338:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003981344c/0xafddb3c8f928285c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477514.909553:0:14338:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789477514.909555:0:14338:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789477514.909557:0:14338:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789477514.910129:0:15469:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789477514.910137:0:15469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000034a55d1e/0xafddb3c8f9282863 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477514.910156:0:15469:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1c:0x0].0x0 since=459s v=(0 0) 00010000:00010000:1.0:1789477514.910160:0:15469:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789477514.910165:0:15469:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000034a55d1e/0xafddb3c8f9282863 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477514.910177:0:15469:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000034a55d1e/0xafddb3c8f9282863 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477514.910186:0:15469:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000034a55d1e/0xafddb3c8f9282863 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477514.910195:0:15469:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000034a55d1e/0xafddb3c8f9282863 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477514.910224:0:15469:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789477514.910339:0:14339:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789477514.910346:0:14339:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000034a55d1e/0xafddb3c8f9282863 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477514.910356:0:14339:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d0d7f519a00 already unused, calling callback (ffffffffc15972a0) 00010000:00010000:3.0:1789477514.910360:0:14339:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000034a55d1e/0xafddb3c8f9282863 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477514.910370:0:14339:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000034a55d1e/0xafddb3c8f9282863 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477514.910383:0:14339:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000034a55d1e/0xafddb3c8f9282863 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477514.910391:0:14339:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000034a55d1e/0xafddb3c8f9282863 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477514.910407:0:14339:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789477514.910409:0:14339:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789477514.910411:0:14339:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789477514.911246:0:15469:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789477514.911259:0:15469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000085790ca8/0xafddb3c8f928286a lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477514.911274:0:15469:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1b:0x0].0x0 since=459s v=(0 0) 00010000:00010000:1.0:1789477514.911278:0:15469:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789477514.911284:0:15469:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000085790ca8/0xafddb3c8f928286a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477514.911309:0:15469:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000085790ca8/0xafddb3c8f928286a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477514.911333:0:15469:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000085790ca8/0xafddb3c8f928286a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477514.911340:0:15469:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000085790ca8/0xafddb3c8f928286a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477514.911361:0:15469:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789477514.911372:0:14338:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789477514.911377:0:14338:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000085790ca8/0xafddb3c8f928286a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477514.911385:0:14338:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d0d7f519e00 already unused, calling callback (ffffffffc15972a0) 00010000:00010000:1.0:1789477514.911390:0:14338:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000085790ca8/0xafddb3c8f928286a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477514.911400:0:14338:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000085790ca8/0xafddb3c8f928286a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477514.911415:0:14338:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000085790ca8/0xafddb3c8f928286a lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477514.911423:0:14338:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000085790ca8/0xafddb3c8f928286a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477514.911439:0:14338:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789477514.911447:0:14338:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789477514.911449:0:14338:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789477514.916453:0:15469:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789477514.916472:0:15469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000069b4af8a/0xafddb3c8f9282871 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477514.916496:0:15469:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1a:0x0].0x0 since=459s v=(0 0) 00010000:00010000:1.0:1789477514.916501:0:15469:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789477514.916509:0:15469:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000069b4af8a/0xafddb3c8f9282871 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477514.916526:0:15469:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000069b4af8a/0xafddb3c8f9282871 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477514.916539:0:15469:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000069b4af8a/0xafddb3c8f9282871 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477514.916549:0:15469:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000069b4af8a/0xafddb3c8f9282871 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477514.917236:0:15469:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789477514.917257:0:14339:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789477514.917265:0:14339:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000069b4af8a/0xafddb3c8f9282871 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477514.917276:0:14339:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d0d7f518800 already unused, calling callback (ffffffffc15972a0) 00010000:00010000:1.0:1789477514.917282:0:14339:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000069b4af8a/0xafddb3c8f9282871 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477514.917317:0:14339:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000069b4af8a/0xafddb3c8f9282871 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477514.917341:0:14339:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000069b4af8a/0xafddb3c8f9282871 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477514.917349:0:14339:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000069b4af8a/0xafddb3c8f9282871 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477514.917374:0:14339:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789477514.917376:0:14339:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789477514.917378:0:14339:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789477514.919493:0:15469:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789477514.919509:0:15469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000003f1ade9/0xafddb3c8f9282878 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477514.919529:0:15469:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x19:0x0].0x0 since=459s v=(0 0) 00010000:00010000:1.0:1789477514.919535:0:15469:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789477514.919542:0:15469:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000003f1ade9/0xafddb3c8f9282878 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477514.919557:0:15469:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000003f1ade9/0xafddb3c8f9282878 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477514.919568:0:15469:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000003f1ade9/0xafddb3c8f9282878 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477514.921840:0:15469:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000003f1ade9/0xafddb3c8f9282878 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477514.921916:0:15469:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1789477514.922648:0:15469:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789477514.922657:0:15469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f75f5d68/0xafddb3c8f928287f lrc: 3/0,1 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477514.922674:0:15469:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x18:0x0].0x0 since=459s v=(0 0) 00010000:00010000:1.0:1789477514.922678:0:15469:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789477514.922685:0:15469:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f75f5d68/0xafddb3c8f928287f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477514.922702:0:15469:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f75f5d68/0xafddb3c8f928287f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477514.922712:0:15469:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f75f5d68/0xafddb3c8f928287f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477514.922719:0:15469:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f75f5d68/0xafddb3c8f928287f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477514.923875:0:14338:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789477514.923888:0:14338:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000003f1ade9/0xafddb3c8f9282878 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477514.923902:0:14338:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d0d7f519800 already unused, calling callback (ffffffffc15972a0) 00010000:00010000:2.0:1789477514.923908:0:14338:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000003f1ade9/0xafddb3c8f9282878 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477514.923919:0:14338:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000003f1ade9/0xafddb3c8f9282878 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477514.923944:0:14338:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000003f1ade9/0xafddb3c8f9282878 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477514.923970:0:14338:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000003f1ade9/0xafddb3c8f9282878 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477514.924053:0:15469:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789477514.924071:0:14339:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789477514.924077:0:14339:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f75f5d68/0xafddb3c8f928287f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477514.924092:0:14339:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d0d7f518400 already unused, calling callback (ffffffffc15972a0) 00010000:00010000:1.0:1789477514.924095:0:14339:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f75f5d68/0xafddb3c8f928287f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477514.924102:0:14339:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f75f5d68/0xafddb3c8f928287f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477514.924114:0:14339:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f75f5d68/0xafddb3c8f928287f lrc: 1/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477514.924121:0:14339:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f75f5d68/0xafddb3c8f928287f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477514.924137:0:14339:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789477514.924139:0:14339:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789477514.924141:0:14339:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789477514.925193:0:15469:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789477514.925205:0:15469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000034a55d1e/0xafddb3c8f9282886 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477514.925223:0:15469:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17:0x0].0x0 since=459s v=(0 0) 00010000:00010000:1.0:1789477514.925229:0:15469:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789477514.925237:0:15469:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000034a55d1e/0xafddb3c8f9282886 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477514.925251:0:15469:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000034a55d1e/0xafddb3c8f9282886 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477514.925270:0:15469:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000034a55d1e/0xafddb3c8f9282886 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477514.925280:0:15469:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000034a55d1e/0xafddb3c8f9282886 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477514.925362:0:15469:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1789477514.925904:0:15469:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789477514.925911:0:15469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000069b4af8a/0xafddb3c8f928288d lrc: 3/0,1 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477514.925921:0:15469:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x16:0x0].0x0 since=459s v=(0 0) 00010000:00010000:1.0:1789477514.925925:0:15469:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789477514.925929:0:15469:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000069b4af8a/0xafddb3c8f928288d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477514.925938:0:15469:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000069b4af8a/0xafddb3c8f928288d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477514.925946:0:15469:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000069b4af8a/0xafddb3c8f928288d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477514.925953:0:15469:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000069b4af8a/0xafddb3c8f928288d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477514.926175:0:14339:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789477514.926183:0:14339:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000034a55d1e/0xafddb3c8f9282886 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477514.926191:0:14339:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d0d7f519a00 already unused, calling callback (ffffffffc15972a0) 00010000:00010000:0.0:1789477514.926196:0:14339:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000034a55d1e/0xafddb3c8f9282886 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477514.926205:0:14339:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000034a55d1e/0xafddb3c8f9282886 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477514.926232:0:14339:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000034a55d1e/0xafddb3c8f9282886 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477514.926240:0:14339:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000034a55d1e/0xafddb3c8f9282886 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477514.926258:0:14339:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789477514.926261:0:14339:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000069b4af8a/0xafddb3c8f928288d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477514.926267:0:14339:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d0d7f518800 already unused, calling callback (ffffffffc15972a0) 00010000:00010000:0.0:1789477514.926270:0:14339:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000069b4af8a/0xafddb3c8f928288d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477514.926278:0:14339:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000069b4af8a/0xafddb3c8f928288d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477514.926287:0:14339:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000069b4af8a/0xafddb3c8f928288d lrc: 2/0,0 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477514.926294:0:14339:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789477514.926295:0:14339:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789477514.926308:0:14339:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789477514.926369:0:15469:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1789477514.926374:0:15469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000069b4af8a/0xafddb3c8f928288d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477514.926721:0:14339:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789477514.927161:0:15469:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789477514.927169:0:15469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000085790ca8/0xafddb3c8f9282894 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477514.927181:0:15469:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x15:0x0].0x0 since=459s v=(0 0) 00010000:00010000:1.0:1789477514.927186:0:15469:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789477514.927191:0:15469:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000085790ca8/0xafddb3c8f9282894 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477514.927204:0:15469:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000085790ca8/0xafddb3c8f9282894 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477514.927213:0:15469:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000085790ca8/0xafddb3c8f9282894 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477514.927221:0:15469:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000085790ca8/0xafddb3c8f9282894 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477514.927242:0:15469:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789477514.927252:0:14339:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789477514.927256:0:14339:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000085790ca8/0xafddb3c8f9282894 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477514.927269:0:14339:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d0d7f519e00 already unused, calling callback (ffffffffc15972a0) 00010000:00010000:1.0:1789477514.927275:0:14339:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000085790ca8/0xafddb3c8f9282894 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477514.927284:0:14339:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000085790ca8/0xafddb3c8f9282894 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477514.927615:0:14338:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789477514.927619:0:14338:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789477514.927621:0:14338:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789477514.930857:0:14339:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000085790ca8/0xafddb3c8f9282894 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477514.930885:0:14339:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000085790ca8/0xafddb3c8f9282894 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477514.930928:0:14339:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789477514.930930:0:14339:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789477514.930933:0:14339:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789477514.932172:0:15469:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789477514.932187:0:15469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003981344c/0xafddb3c8f928289b lrc: 3/0,1 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477514.932207:0:15469:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=460s v=(0 0) 00010000:00010000:1.0:1789477514.932213:0:15469:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789477514.932220:0:15469:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003981344c/0xafddb3c8f928289b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477514.932241:0:15469:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003981344c/0xafddb3c8f928289b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477514.932263:0:15469:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003981344c/0xafddb3c8f928289b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477514.932273:0:15469:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003981344c/0xafddb3c8f928289b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477514.932320:0:15469:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789477514.932343:0:14338:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789477514.932352:0:14338:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003981344c/0xafddb3c8f928289b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477514.932361:0:14338:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d0d7f518e00 already unused, calling callback (ffffffffc15972a0) 00010000:00010000:3.0:1789477514.932367:0:14338:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003981344c/0xafddb3c8f928289b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477514.932377:0:14338:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003981344c/0xafddb3c8f928289b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477514.932397:0:14338:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003981344c/0xafddb3c8f928289b lrc: 1/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477514.932405:0:14338:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003981344c/0xafddb3c8f928289b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477514.932427:0:14338:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789477514.932429:0:14338:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789477514.932431:0:14338:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789477514.933105:0:15469:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789477514.933114:0:15469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a8565f92/0xafddb3c8f92828a2 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477514.933126:0:15469:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x13:0x0].0x0 since=460s v=(0 0) 00010000:00010000:1.0:1789477514.933129:0:15469:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789477514.933135:0:15469:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a8565f92/0xafddb3c8f92828a2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477514.933145:0:15469:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a8565f92/0xafddb3c8f92828a2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477514.933153:0:15469:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a8565f92/0xafddb3c8f92828a2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477514.933160:0:15469:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a8565f92/0xafddb3c8f92828a2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477514.933435:0:15469:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1789477514.934117:0:15469:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789477514.934125:0:15469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000aace08ed/0xafddb3c8f92828a9 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477514.934138:0:15469:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x12:0x0].0x0 since=460s v=(0 0) 00010000:00010000:1.0:1789477514.934142:0:15469:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789477514.934148:0:15469:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000aace08ed/0xafddb3c8f92828a9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477514.934158:0:15469:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000aace08ed/0xafddb3c8f92828a9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477514.934166:0:15469:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000aace08ed/0xafddb3c8f92828a9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477514.934173:0:15469:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000aace08ed/0xafddb3c8f92828a9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477514.936544:0:14339:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789477514.936563:0:14339:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a8565f92/0xafddb3c8f92828a2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477514.936602:0:14339:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d0d7f519c00 already unused, calling callback (ffffffffc15972a0) 00010000:00010000:2.0:1789477514.936608:0:14339:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a8565f92/0xafddb3c8f92828a2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477514.936621:0:14339:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a8565f92/0xafddb3c8f92828a2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477514.936647:0:14339:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a8565f92/0xafddb3c8f92828a2 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477514.936656:0:14339:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a8565f92/0xafddb3c8f92828a2 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477514.936682:0:14339:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789477514.936687:0:14339:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000aace08ed/0xafddb3c8f92828a9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477514.936695:0:14339:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d0d7f518200 already unused, calling callback (ffffffffc15972a0) 00010000:00010000:2.0:1789477514.936707:0:14339:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000aace08ed/0xafddb3c8f92828a9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477514.936715:0:14339:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000aace08ed/0xafddb3c8f92828a9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477514.936727:0:14339:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000aace08ed/0xafddb3c8f92828a9 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477514.936735:0:14339:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789477514.936737:0:14339:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789477514.936740:0:14339:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1789477514.938717:0:5868:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00010000:00010000:1.0:1789477514.940467:0:15469:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1789477514.940484:0:15469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000aace08ed/0xafddb3c8f92828a9 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789477514.941465:0:15469:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789477514.941477:0:15469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f75f5d68/0xafddb3c8f92828b0 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477514.941500:0:15469:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=460s v=(0 0) 00010000:00010000:1.0:1789477514.941505:0:15469:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789477514.941514:0:15469:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f75f5d68/0xafddb3c8f92828b0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477514.941532:0:15469:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f75f5d68/0xafddb3c8f92828b0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477514.941543:0:15469:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f75f5d68/0xafddb3c8f92828b0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477514.941552:0:15469:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f75f5d68/0xafddb3c8f92828b0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477514.941881:0:14338:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789477514.941892:0:14338:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f75f5d68/0xafddb3c8f92828b0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477514.941902:0:14338:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d0d7f518400 already unused, calling callback (ffffffffc15972a0) 00010000:00010000:2.0:1789477514.941908:0:14338:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f75f5d68/0xafddb3c8f92828b0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477514.941919:0:14338:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f75f5d68/0xafddb3c8f92828b0 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477514.941939:0:14338:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f75f5d68/0xafddb3c8f92828b0 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477514.941948:0:14338:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789477514.941957:0:14338:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789477514.941959:0:14338:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789477514.942732:0:15469:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1789477514.942744:0:15469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f75f5d68/0xafddb3c8f92828b0 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477514.942929:0:14339:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789477514.945973:0:15469:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789477514.945990:0:15469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000673fcb45/0xafddb3c8f92828b7 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477514.946017:0:15469:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x10:0x0].0x0 since=460s v=(0 0) 00010000:00010000:0.0:1789477514.946023:0:15469:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789477514.946031:0:15469:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000673fcb45/0xafddb3c8f92828b7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477514.946049:0:15469:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000673fcb45/0xafddb3c8f92828b7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477514.946062:0:15469:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000673fcb45/0xafddb3c8f92828b7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477514.946071:0:15469:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000673fcb45/0xafddb3c8f92828b7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477514.946147:0:15469:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1789477514.946658:0:15469:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789477514.946666:0:15469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000985d5bfd/0xafddb3c8f92828be lrc: 3/0,1 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477514.946676:0:15469:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xf:0x0].0x0 since=460s v=(0 0) 00010000:00010000:0.0:1789477514.946680:0:15469:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789477514.946685:0:15469:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000985d5bfd/0xafddb3c8f92828be lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477514.946696:0:15469:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000985d5bfd/0xafddb3c8f92828be lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477514.946717:0:15469:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000985d5bfd/0xafddb3c8f92828be lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477514.946723:0:15469:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000985d5bfd/0xafddb3c8f92828be lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477514.947017:0:14338:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789477514.947029:0:14338:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000673fcb45/0xafddb3c8f92828b7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477514.947040:0:14338:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d0d50be5200 already unused, calling callback (ffffffffc15972a0) 00010000:00010000:2.0:1789477514.947046:0:14338:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000673fcb45/0xafddb3c8f92828b7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477514.947058:0:14338:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000673fcb45/0xafddb3c8f92828b7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477514.947081:0:14338:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000673fcb45/0xafddb3c8f92828b7 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477514.947090:0:14338:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000673fcb45/0xafddb3c8f92828b7 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477514.947111:0:14338:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789477514.947115:0:14338:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000985d5bfd/0xafddb3c8f92828be lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477514.947123:0:14338:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d0d50be4c00 already unused, calling callback (ffffffffc15972a0) 00010000:00010000:2.0:1789477514.947127:0:14338:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000985d5bfd/0xafddb3c8f92828be lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477514.947149:0:14338:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000985d5bfd/0xafddb3c8f92828be lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477514.947160:0:14338:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000985d5bfd/0xafddb3c8f92828be lrc: 2/0,0 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477514.947168:0:14338:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789477514.947169:0:14338:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789477514.947172:0:14338:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789477514.947241:0:15469:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1789477514.947248:0:15469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000985d5bfd/0xafddb3c8f92828be lrc: 0/0,0 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789477514.947999:0:15469:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789477514.948008:0:15469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d05cf15f/0xafddb3c8f92828c5 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477514.948019:0:15469:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=460s v=(0 0) 00010000:00010000:0.0:1789477514.948023:0:15469:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789477514.948029:0:15469:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d05cf15f/0xafddb3c8f92828c5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477514.948039:0:15469:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d05cf15f/0xafddb3c8f92828c5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477514.948048:0:15469:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d05cf15f/0xafddb3c8f92828c5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477514.948069:0:15469:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d05cf15f/0xafddb3c8f92828c5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477514.948132:0:14339:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789477514.948138:0:14339:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d05cf15f/0xafddb3c8f92828c5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477514.948146:0:14339:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d0d50be4600 already unused, calling callback (ffffffffc15972a0) 00010000:00010000:2.0:1789477514.948151:0:14339:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d05cf15f/0xafddb3c8f92828c5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477514.948161:0:14339:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d05cf15f/0xafddb3c8f92828c5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477514.948176:0:14339:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d05cf15f/0xafddb3c8f92828c5 lrc: 2/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477514.948184:0:14339:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789477514.948185:0:14339:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789477514.948187:0:14339:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789477514.948269:0:15469:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1789477514.948276:0:15469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d05cf15f/0xafddb3c8f92828c5 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789477514.949042:0:15469:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789477514.949052:0:15469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000036b87077/0xafddb3c8f92828cc lrc: 3/0,1 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477514.949063:0:15469:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=460s v=(0 0) 00010000:00010000:0.0:1789477514.949066:0:15469:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789477514.949072:0:15469:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000036b87077/0xafddb3c8f92828cc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477514.949083:0:15469:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000036b87077/0xafddb3c8f92828cc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477514.949091:0:15469:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000036b87077/0xafddb3c8f92828cc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477514.949098:0:15469:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000036b87077/0xafddb3c8f92828cc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477514.949165:0:14338:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789477514.949172:0:14338:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000036b87077/0xafddb3c8f92828cc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477514.949181:0:14338:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d0d50be5000 already unused, calling callback (ffffffffc15972a0) 00010000:00010000:2.0:1789477514.949184:0:14338:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000036b87077/0xafddb3c8f92828cc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477514.949194:0:14338:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000036b87077/0xafddb3c8f92828cc lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477514.949208:0:14338:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000036b87077/0xafddb3c8f92828cc lrc: 2/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477514.949216:0:14338:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789477514.949217:0:14338:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789477514.949219:0:14338:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789477514.949292:0:15469:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1789477514.949307:0:15469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000036b87077/0xafddb3c8f92828cc lrc: 0/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789477514.950021:0:15469:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789477514.950029:0:15469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ef01e22b/0xafddb3c8f92828d3 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477514.950039:0:15469:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc:0x0].0x0 since=460s v=(0 0) 00010000:00010000:0.0:1789477514.950043:0:15469:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789477514.950048:0:15469:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ef01e22b/0xafddb3c8f92828d3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477514.950058:0:15469:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ef01e22b/0xafddb3c8f92828d3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477514.950066:0:15469:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ef01e22b/0xafddb3c8f92828d3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477514.950073:0:15469:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ef01e22b/0xafddb3c8f92828d3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477514.950125:0:14339:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789477514.950131:0:14339:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ef01e22b/0xafddb3c8f92828d3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477514.950139:0:14339:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d0d50be5e00 already unused, calling callback (ffffffffc15972a0) 00010000:00010000:2.0:1789477514.950143:0:14339:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ef01e22b/0xafddb3c8f92828d3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477514.950152:0:14339:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ef01e22b/0xafddb3c8f92828d3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477514.950179:0:14339:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ef01e22b/0xafddb3c8f92828d3 lrc: 2/0,0 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477514.950187:0:14339:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789477514.950189:0:14339:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789477514.950191:0:14339:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789477514.950260:0:15469:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1789477514.950265:0:15469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ef01e22b/0xafddb3c8f92828d3 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789477514.951056:0:15469:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789477514.951065:0:15469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d0bac59c/0xafddb3c8f92828da lrc: 3/0,1 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477514.951077:0:15469:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=460s v=(0 0) 00010000:00010000:0.0:1789477514.951082:0:15469:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789477514.951087:0:15469:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d0bac59c/0xafddb3c8f92828da lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477514.951099:0:15469:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d0bac59c/0xafddb3c8f92828da lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477514.951107:0:15469:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d0bac59c/0xafddb3c8f92828da lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477514.951114:0:15469:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d0bac59c/0xafddb3c8f92828da lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477514.951173:0:14338:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789477514.951181:0:14338:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d0bac59c/0xafddb3c8f92828da lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477514.951189:0:14338:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d0d50be4200 already unused, calling callback (ffffffffc15972a0) 00010000:00010000:2.0:1789477514.951192:0:14338:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d0bac59c/0xafddb3c8f92828da lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477514.951201:0:14338:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d0bac59c/0xafddb3c8f92828da lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477514.951215:0:14338:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d0bac59c/0xafddb3c8f92828da lrc: 2/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477514.951223:0:14338:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789477514.951225:0:14338:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789477514.951227:0:14338:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789477514.951288:0:15469:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1789477514.951293:0:15469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d0bac59c/0xafddb3c8f92828da lrc: 0/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789477514.951986:0:15469:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789477514.951993:0:15469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c2cf8183/0xafddb3c8f92828e1 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477514.952015:0:15469:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=460s v=(0 0) 00010000:00010000:0.0:1789477514.952018:0:15469:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789477514.952023:0:15469:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c2cf8183/0xafddb3c8f92828e1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477514.952034:0:15469:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c2cf8183/0xafddb3c8f92828e1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477514.952043:0:15469:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c2cf8183/0xafddb3c8f92828e1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477514.952050:0:15469:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c2cf8183/0xafddb3c8f92828e1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477514.952105:0:14339:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789477514.952111:0:14339:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c2cf8183/0xafddb3c8f92828e1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477514.952133:0:14339:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d0d50be5c00 already unused, calling callback (ffffffffc15972a0) 00010000:00010000:2.0:1789477514.952136:0:14339:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c2cf8183/0xafddb3c8f92828e1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477514.952145:0:14339:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c2cf8183/0xafddb3c8f92828e1 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477514.952159:0:14339:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c2cf8183/0xafddb3c8f92828e1 lrc: 2/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477514.952167:0:14339:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789477514.952169:0:14339:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789477514.952171:0:14339:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789477514.952244:0:15469:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1789477514.952249:0:15469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c2cf8183/0xafddb3c8f92828e1 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789477514.952740:0:15469:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789477514.952747:0:15469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bc5573ae/0xafddb3c8f92828e8 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477514.952756:0:15469:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x9:0x0].0x0 since=460s v=(0 0) 00010000:00010000:0.0:1789477514.952760:0:15469:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789477514.952764:0:15469:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bc5573ae/0xafddb3c8f92828e8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477514.952997:0:15469:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bc5573ae/0xafddb3c8f92828e8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477514.953006:0:15469:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bc5573ae/0xafddb3c8f92828e8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477514.953014:0:15469:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000bc5573ae/0xafddb3c8f92828e8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477514.953063:0:14338:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789477514.953070:0:14338:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000bc5573ae/0xafddb3c8f92828e8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477514.953077:0:14338:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d0d50be5800 already unused, calling callback (ffffffffc15972a0) 00010000:00010000:2.0:1789477514.953081:0:14338:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000bc5573ae/0xafddb3c8f92828e8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477514.953089:0:14338:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000bc5573ae/0xafddb3c8f92828e8 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477514.953102:0:14338:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000bc5573ae/0xafddb3c8f92828e8 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477514.953115:0:14338:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789477514.953116:0:14338:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789477514.953118:0:14338:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789477514.953180:0:15469:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1789477514.953185:0:15469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bc5573ae/0xafddb3c8f92828e8 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789477514.953671:0:15469:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789477514.953678:0:15469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000155b90f2/0xafddb3c8f92828ef lrc: 3/0,1 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477514.953688:0:15469:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=460s v=(0 0) 00010000:00010000:0.0:1789477514.953692:0:15469:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789477514.953697:0:15469:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000155b90f2/0xafddb3c8f92828ef lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477514.953707:0:15469:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000155b90f2/0xafddb3c8f92828ef lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477514.953727:0:15469:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000155b90f2/0xafddb3c8f92828ef lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477514.953735:0:15469:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000155b90f2/0xafddb3c8f92828ef lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477514.955686:0:14339:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789477514.955704:0:14339:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000155b90f2/0xafddb3c8f92828ef lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477514.955720:0:14339:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d0d50be4a00 already unused, calling callback (ffffffffc15972a0) 00010000:00010000:2.0:1789477514.955725:0:14339:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000155b90f2/0xafddb3c8f92828ef lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477514.955738:0:14339:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000155b90f2/0xafddb3c8f92828ef lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477514.955762:0:14339:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000155b90f2/0xafddb3c8f92828ef lrc: 2/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477514.956874:0:14339:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789477514.956879:0:14339:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789477514.956924:0:15469:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1789477514.956935:0:15469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000155b90f2/0xafddb3c8f92828ef lrc: 0/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789477514.960159:0:15469:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789477514.960178:0:15469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fdefc34f/0xafddb3c8f92828f6 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477514.960200:0:15469:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=460s v=(0 0) 00010000:00010000:0.0:1789477514.960205:0:15469:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789477514.960212:0:15469:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fdefc34f/0xafddb3c8f92828f6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477514.960230:0:15469:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fdefc34f/0xafddb3c8f92828f6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477514.960242:0:15469:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fdefc34f/0xafddb3c8f92828f6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477514.960263:0:15469:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fdefc34f/0xafddb3c8f92828f6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477514.965757:0:14339:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789477514.965779:0:14339:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fdefc34f/0xafddb3c8f92828f6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477514.965795:0:14338:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789477514.966336:0:15469:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1789477514.967184:0:14339:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d0d50be4800 already unused, calling callback (ffffffffc15972a0) 00010000:00010000:3.0:1789477514.967202:0:14339:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fdefc34f/0xafddb3c8f92828f6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477514.967221:0:14339:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fdefc34f/0xafddb3c8f92828f6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477514.967249:0:14339:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fdefc34f/0xafddb3c8f92828f6 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477514.967258:0:14339:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fdefc34f/0xafddb3c8f92828f6 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477514.967283:0:14339:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789477514.967285:0:14339:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789477514.967288:0:14339:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789477514.967416:0:15469:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789477514.967425:0:15469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000050199876/0xafddb3c8f92828fd lrc: 3/0,1 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477514.967440:0:15469:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=460s v=(0 0) 00010000:00010000:0.0:1789477514.967445:0:15469:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789477514.967452:0:15469:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000050199876/0xafddb3c8f92828fd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477514.967466:0:15469:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000050199876/0xafddb3c8f92828fd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477514.967475:0:15469:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000050199876/0xafddb3c8f92828fd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477514.967483:0:15469:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000050199876/0xafddb3c8f92828fd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477514.967512:0:15469:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789477514.968132:0:14339:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789477514.968141:0:14339:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000050199876/0xafddb3c8f92828fd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477514.968150:0:14339:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d0d50be5a00 already unused, calling callback (ffffffffc15972a0) 00010000:00010000:3.0:1789477514.968154:0:14339:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000050199876/0xafddb3c8f92828fd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00080000:0.0:1789477514.968157:0:15469:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x240000400:5 00010000:00010000:3.0:1789477514.968164:0:14339:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000050199876/0xafddb3c8f92828fd lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477514.968177:0:14339:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000050199876/0xafddb3c8f92828fd lrc: 1/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477514.968192:0:14339:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000050199876/0xafddb3c8f92828fd lrc: 0/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477514.968210:0:14339:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789477514.968211:0:14339:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789477514.968213:0:14339:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789477514.968311:0:15469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d6d482300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:14373:x1876402802619776:12345-0@lo:5:osp-pre-0-0.0 Request processed in 116115us (126134us total) trans 0 rc 0/0 00000100:00100000:0.0:1789477514.968334:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789477514.968370:0:14373:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d6d482d80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14373:1876402802619776:0@lo:5:osp-pre-0-0.0 00000004:00080000:3.0:1789477514.968391:0:14373:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x240000400:0x21:0x0] from OST, last_created [0x240000400:0x21:0x0]last_used is [0x240000400:0x5:0x0] 00010000:00010000:2.0:1789477514.968452:0:14338:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789477514.968454:0:14373:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d58073480 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14373:1876402802619904:0@lo:5:osp-pre-0-0.0 00000100:00100000:3.0:1789477514.968501:0:14373:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789477514.968519:0:15039:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802619904 00000100:00100000:0.0:1789477514.968527:0:15039:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802619904 00000100:00100000:3.0:1789477514.968546:0:14373:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d0d48195480 going to sleep for 11 seconds 00000100:00100000:0.0:1789477514.968757:0:15039:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1789477514.968780:0:15039:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d58073800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:14373:x1876402802619904:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:0.0:1789477514.968828:0:15039:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x240000400 at 34 00000100:00100000:0.0:1789477514.977108:0:15039:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d58073800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:14373:x1876402802619904:12345-0@lo:5:osp-pre-0-0.0 Request processed in 8329us (8595us total) trans 8589934593 rc 0/0 00000100:00100000:0.0:1789477514.977125:0:15039:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789477514.977398:0:14373:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d58073480 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14373:1876402802619904:0@lo:5:osp-pre-0-0.0 00000004:00080000:3.0:1789477514.977421:0:14373:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x240000400:0x21:0x0]-[0x240000400:0x41:0x0] 00010000:00010000:3.0:1789477515.055969:0:14339:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789477516.080020:0:14338:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1789477516.353677:0:6730:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934593 is committed 00000001:00100000:1.0:1789477516.353747:0:6730:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00010000:00010000:2.0:1789477517.109902:0:14339:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789477518.129408:0:14338:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789477519.153840:0:14339:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789477520.175747:0:14338:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789477520.303793:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789477520.303825:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d58073b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1876402802620032:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789477520.303923:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789477520.304025:0:15042:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802620032 00000100:00100000:3.0:1789477520.304036:0:15042:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802620032 00000100:00100000:3.0:1789477520.304132:0:15042:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789477520.304145:0:15042:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d58071500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1876402802620032:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789477520.304214:0:15042:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00080000:0.0:1789477520.304246:0:14346:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789477520.304298:0:15042:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d58071500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1876402802620032:12345-0@lo:13:osp-pre-0-0.0 Request processed in 153us (372us total) trans 0 rc 0/0 00000100:00100000:3.0:1789477520.304307:0:15042:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789477520.304365:0:3310:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934593 gen 2 00000100:00100000:0.0:1789477520.304400:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d58073b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1876402802620032:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1789477520.306174:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789477520.306184:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1789477520.306190:0:36:0:(import.c:65:import_set_state_nolock()) ffff9d0d4823f000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1789477520.306211:0:36:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 459 00000100:00080000:2.0:1789477520.306218:0:36:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:2.0:1789477520.306234:0:36:0:(import.c:625:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9d0d4823f000 using connection 192.168.201.123@tcp/0@lo 00000100:00100000:2.0:1789477520.306275:0:36:0:(import.c:827:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9d0d7523f800 x1876402802620288/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1789477520.306368:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789477520.306388:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d7523df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3311:1876402802620544:0@lo:400:kworker.0 00000100:00100000:2.0:1789477520.306470:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789477520.306630:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d7523d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:730ef4b7-dbd8-4cb5-9f31-5e7e04ae8864:3312:1876402802620160:0@lo:400:kworker.0 00000100:00100000:3.0:1789477520.306675:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789477520.306712:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789477520.306719:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d7523ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3312:1876402802620416:0@lo:400:kworker.0 00000100:00100000:3.0:1789477520.306742:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789477520.306775:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d7523f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3309:1876402802620288:0@lo:8:kworker.0 00000100:00100000:3.0:1789477520.306804:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789477520.306845:0:14350:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802620544 00000100:00100000:3.0:1789477520.306855:0:14350:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802620544 00000100:00100000:3.0:1789477520.306921:0:14350:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802620416 00000100:00100000:3.0:1789477520.306924:0:14350:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802620416 00000100:00100000:3.0:1789477520.306944:0:14350:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1789477520.306954:0:14350:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d7523fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1876402802620544:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789477520.307014:0:14350:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d7523fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1876402802620544:12345-0@lo:400:kworker.0 Request processed in 60us (543us total) trans 0 rc 0/0 00000100:00100000:3.0:1789477520.307022:0:14350:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1789477520.307042:0:14350:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1789477520.307049:0:14350:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d58072300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1876402802620416:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789477520.307080:0:14350:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d58072300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1876402802620416:12345-0@lo:400:kworker.0 Request processed in 32us (336us total) trans 0 rc 0/0 00000100:00100000:3.0:1789477520.307086:0:14350:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1789477520.307113:0:15037:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802620288 00000100:00100000:3.0:1789477520.307117:0:15037:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802620288 00000100:00100000:3.0:1789477520.307142:0:15037:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1789477520.307154:0:15037:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d58072a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3309:x1876402802620288:12345-0@lo:8:kworker.0 00010000:00020000:3.0:1789477520.307177:0:15037:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1789477520.309291:0:14343:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802620160 00000100:00100000:2.0:1789477520.309313:0:14343:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802620160 00000100:00100000:2.0:1789477520.309380:0:14343:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1789477520.309393:0:14343:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d6ec55450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:730ef4b7-dbd8-4cb5-9f31-5e7e04ae8864+16:3312:x1876402802620160:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789477520.309507:0:14343:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d6ec55450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:730ef4b7-dbd8-4cb5-9f31-5e7e04ae8864+16:3312:x1876402802620160:12345-0@lo:400:kworker.0 Request processed in 116us (2830us total) trans 0 rc 0/0 00000100:00100000:2.0:1789477520.309515:0:14343:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00010000:00080000:2.0:1789477520.309614:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9d0d7523df80 x1876402802620544/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789477536 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789477520.309632:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d7523df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3311:1876402802620544:0@lo:400:kworker.0 00000100:00080000:1.0:1789477520.314325:0:14346:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1789477520.314468:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9d0d7523ca80 x1876402802620416/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789477536 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789477520.314491:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d7523ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3312:1876402802620416:0@lo:400:kworker.0 00000100:00100000:2.0:1789477520.314508:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d7523d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:730ef4b7-dbd8-4cb5-9f31-5e7e04ae8864:3312:1876402802620160:0@lo:400:kworker.0 00000100:00100000:3.0:1789477520.328953:0:15037:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d58072a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3309:x1876402802620288:12345-0@lo:8:kworker.0 Request processed in 21784us (22134us total) trans 0 rc -19/-19 00000100:00100000:3.0:1789477520.328972:0:15037:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:1.0:1789477520.329520:0:3309:0:(import.c:65:import_set_state_nolock()) ffff9d0d4823f000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1789477520.329530:0:3309:0:(import.c:1512:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1789477520.329535:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d7523f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3309:1876402802620288:0@lo:8:kworker.0 00010000:00010000:1.0:1789477521.199846:0:14339:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1789477521.537628:0:15755:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:0.0:1789477521.537634:0:15755:0:(obd_mount.c:926:lmd_print()) device: lustre-ost2/ost2 00000080:01200004:0.0:1789477521.537824:0:15755:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9d0d47667000 00000020:01000004:0.0:1789477521.537847:0:15755:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-OST0001, type=osd-zfs, lsifl=200002, mountfl=0 00000020:01000004:0.0:1789477521.537876:0:15755:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-zfs) 00000020:00000080:0.0:1789477521.537897:0:15755:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff9d0d514c99b8) 00000020:00000080:0.0:1789477521.537919:0:15755:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type osd-zfs with refcount 2 00100000:10000000:2.0:1789477521.565251:0:15755:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:2.0:1789477521.565732:0:15755:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0001: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:2.0:1789477521.571631:0:15755:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:2.0:1789477521.572083:0:15755:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00100000:10000000:2.0:1789477521.572375:0:15755:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0001: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:2.0:1789477521.572846:0:15755:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled lustre-OST0001 under 349: rc = 0 00100000:10000000:2.0:1789477521.572948:0:15755:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled params under 349: rc = 0 00100000:10000000:2.0:1789477521.573128:0:15755:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled lustre-client under 349: rc = 0 00100000:10000000:2.0:1789477521.573720:0:15755:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x1020000-OST0001 under 615: rc = 0 00100000:10000000:2.0:1789477521.574015:0:15755:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x2020000 under 615: rc = 0 00100000:10000000:2.0:1789477521.574286:0:15755:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x20000 under 615: rc = 0 00100000:10000000:2.0:1789477521.574572:0:15755:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x20000-OST0001 under 615: rc = 0 00100000:10000000:2.0:1789477521.575686:0:15755:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x2020000-OST0001 under 615: rc = 0 00100000:10000000:2.0:1789477521.576063:0:15755:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x1020000 under 615: rc = 0 00000020:00000080:2.0:1789477521.578101:0:15755:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:2.0:1789477521.578124:0:15755:0:(osd_handler.c:1564:osd_obd_connect()) connect #0 00000020:00000080:2.0:1789477521.578146:0:15755:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xafddb3c8f928290b 00000020:01000004:2.0:1789477521.578160:0:15755:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-OST0001 on device lustre-ost2/ost2 00000020:01000004:2.0:1789477521.578204:0:15755:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.201.123@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1789477521.578210:0:15755:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.201.123@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1789477521.578222:0:15755:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-OST0001 00000020:01000004:2.0:1789477521.578262:0:15755:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost2/ost2 10000000:01000000:2.0:1789477521.578266:0:15755:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.201.123@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:3.0:1789477521.602064:0:15755:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.123@tcp ctxt 0 is initialized 00000020:01000004:3.0:1789477521.602120:0:15755:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.201.123@tcp, index=0001, flags=0x20002 00000020:01000004:3.0:1789477521.602126:0:15755:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1789477521.602129:0:15755:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1789477521.602130:0:15755:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789477521.602132:0:15755:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789477521.602133:0:15755:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789477521.602135:0:15755:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789477521.602136:0:15755:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1789477521.602139:0:15755:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789477521.602141:0:15755:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1789477521.602145:0:15755:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020002 00000020:01000004:3.0:1789477521.602148:0:15755:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1789477521.602149:0:15755:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1789477521.602151:0:15755:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789477521.602152:0:15755:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789477521.602153:0:15755:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789477521.602154:0:15755:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789477521.602155:0:15755:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1789477521.602157:0:15755:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789477521.602158:0:15755:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1789477521.607191:0:15755:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:3.0:1789477521.607238:0:15755:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d58071f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:730ef4b7-dbd8-4cb5-9f31-5e7e04ae8864:15755:1876402802620672:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1789477521.607356:0:15755:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789477521.607449:0:15755:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d0d515b4b40 going to sleep for 11 seconds 00000100:00100000:2.0:1789477521.607674:0:14344:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802620672 00000100:00100000:2.0:1789477521.607686:0:14344:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802620672 00000100:00100000:2.0:1789477521.607764:0:14344:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1789477521.607776:0:14344:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d6ec56050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:730ef4b7-dbd8-4cb5-9f31-5e7e04ae8864+16:15755:x1876402802620672:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1789477521.607832:0:14344:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:2.0:1789477521.607836:0:14344:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0001 is running on 0@lo 20000000:01000000:2.0:1789477521.607841:0:14344:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:2.0:1789477521.647128:0:14344:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d6ec56050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:730ef4b7-dbd8-4cb5-9f31-5e7e04ae8864+16:15755:x1876402802620672:12345-0@lo:253:mount.lustre.0 Request processed in 39340us (39757us total) trans 0 rc 0/0 00000100:00100000:2.0:1789477521.647150:0:14344:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1789477521.647195:0:15755:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d58071f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:730ef4b7-dbd8-4cb5-9f31-5e7e04ae8864:15755:1876402802620672:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1789477521.647219:0:15755:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:3.0:1789477521.647230:0:15755:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1789477521.647233:0:15755:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1789477521.647235:0:15755:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789477521.647237:0:15755:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789477521.647239:0:15755:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789477521.647241:0:15755:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789477521.647242:0:15755:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1789477521.647245:0:15755:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789477521.647246:0:15755:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1789477521.647286:0:15755:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9d0d47667000 from lustre-OST0001 10000000:01000000:3.0:1789477521.647323:0:15755:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:3.0:1789477521.647326:0:15755:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:3.0:1789477521.647336:0:15755:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9d0d76164d28 local copy 00010000:00010000:3.0:1789477521.647349:0:15755:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.123@tcp lock: ffff9d0d49ecbe00/0xafddb3c8f92826b1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xafddb3c8f92826b8 expref: -99 pid: 14332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789477521.648360:0:15755:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d6d483480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:730ef4b7-dbd8-4cb5-9f31-5e7e04ae8864:15755:1876402802620800:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789477521.648431:0:15755:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789477521.648496:0:15755:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d0d445316c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789477521.648613:0:14345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802620800 00000100:00100000:3.0:1789477521.648623:0:14345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802620800 00000040:00080000:2.0:1789477521.649329:0:14385:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1789477521.649685:0:14345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1789477521.649702:0:14345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d6ec55c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:730ef4b7-dbd8-4cb5-9f31-5e7e04ae8864+16:15755:x1876402802620800:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789477521.650166:0:14345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d6ec55c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:730ef4b7-dbd8-4cb5-9f31-5e7e04ae8864+16:15755:x1876402802620800:12345-0@lo:501:mount.lustre.0 Request processed in 468us (1733us total) trans 0 rc -2/-2 00000100:00100000:3.0:1789477521.650187:0:14345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1789477521.650266:0:15755:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d6d483480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:730ef4b7-dbd8-4cb5-9f31-5e7e04ae8864:15755:1876402802620800:0@lo:501:mount.lustre.0 10000000:01000000:0.0:1789477521.650290:0:15755:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.201.123@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:0.0:1789477521.650452:0:15755:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.201.123@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:0.0:1789477521.651469:0:15755:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.123@tcp lock: ffff9d0d49ecbe00/0xafddb3c8f92826b1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xafddb3c8f92826b8 expref: -99 pid: 14332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477521.651637:0:15755:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.123@tcp lock: ffff9d0d49ecbe00/0xafddb3c8f92826b1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xafddb3c8f92826b8 expref: -99 pid: 14332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789477521.651747:0:15755:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9d0d47667000 10000000:01000000:0.0:1789477521.651756:0:15755:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1789477521.651764:0:15755:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:0.0:1789477521.651767:0:15755:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1789477521.651772:0:15755:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:0.0:1789477521.651775:0:15755:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:0.0:1789477521.651824:0:15755:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.123@tcp lock: ffff9d0d50be4600/0xafddb3c8f9282912 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477521.651832:0:15755:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.123@tcp lock: ffff9d0d50be4600/0xafddb3c8f9282912 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477521.651844:0:15755:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.123@tcp lock: ffff9d0d50be4600/0xafddb3c8f9282912 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789477521.651872:0:15755:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d6d483480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:730ef4b7-dbd8-4cb5-9f31-5e7e04ae8864:15755:1876402802620928:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1789477521.651945:0:15755:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789477521.655236:0:15755:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d0d445316c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789477521.655873:0:14343:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802620928 00000100:00100000:1.0:1789477521.655888:0:14343:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802620928 00000100:00100000:1.0:1789477521.655967:0:14343:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1789477521.655979:0:14343:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d6ec57c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:730ef4b7-dbd8-4cb5-9f31-5e7e04ae8864+16:15755:x1876402802620928:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789477521.656000:0:14343:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789477521.656026:0:14343:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d0d7f518800/0xafddb3c8f9282919 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xafddb3c8f9282912 expref: -99 pid: 14343 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477521.656065:0:14343:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d0d7f518800/0xafddb3c8f9282919 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xafddb3c8f9282912 expref: 17 pid: 14343 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477521.656078:0:14343:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d0d7f518800/0xafddb3c8f9282919 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xafddb3c8f9282912 expref: 17 pid: 14343 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477521.656090:0:14343:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d0d7f518800, rc 0) 00000100:00100000:1.0:1789477521.656203:0:14343:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d6ec57c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:730ef4b7-dbd8-4cb5-9f31-5e7e04ae8864+17:15755:x1876402802620928:12345-0@lo:101:mount.lustre.0 Request processed in 226us (4257us total) trans 0 rc 0/0 00000100:00100000:1.0:1789477521.656210:0:14343:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1789477521.656664:0:15755:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d6d483480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:730ef4b7-dbd8-4cb5-9f31-5e7e04ae8864:15755:1876402802620928:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789477521.656754:0:15755:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.123@tcp lock: ffff9d0d50be4600/0xafddb3c8f9282912 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xafddb3c8f9282919 expref: -99 pid: 15755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477521.656768:0:15755:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.123@tcp lock: ffff9d0d50be4600/0xafddb3c8f9282912 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xafddb3c8f9282919 expref: -99 pid: 15755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1789477521.659074:0:15755:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:0.0:1789477521.660341:0:15755:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1789477521.660723:0:15755:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:0.0:1789477521.660773:0:15755:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:0.0:1789477521.660807:0:15755:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:0.0:1789477521.660855:0:15755:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:0.0:1789477521.660890:0:15755:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:0.0:1789477521.660919:0:15755:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:0.0:1789477521.660977:0:15755:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:0.0:1789477521.660985:0:15755:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:0.0:1789477521.661100:0:15755:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d6d483480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:730ef4b7-dbd8-4cb5-9f31-5e7e04ae8864:15755:1876402802621056:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789477521.665003:0:15755:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789477521.665123:0:15755:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d0d44531000 going to sleep for 11 seconds 00000100:00100000:1.0:1789477521.674851:0:14343:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802621056 00000100:00100000:1.0:1789477521.674872:0:14343:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802621056 00000100:00100000:1.0:1789477521.674974:0:14343:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1789477521.674989:0:14343:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d6ec57450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:730ef4b7-dbd8-4cb5-9f31-5e7e04ae8864+17:15755:x1876402802621056:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789477521.675748:0:14343:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d6ec57450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:730ef4b7-dbd8-4cb5-9f31-5e7e04ae8864+17:15755:x1876402802621056:12345-0@lo:501:mount.lustre.0 Request processed in 760us (10756us total) trans 0 rc 0/0 00000100:00100000:1.0:1789477521.675760:0:14343:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1789477521.675862:0:15755:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d6d483480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:730ef4b7-dbd8-4cb5-9f31-5e7e04ae8864:15755:1876402802621056:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789477521.675943:0:15755:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d58071f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:730ef4b7-dbd8-4cb5-9f31-5e7e04ae8864:15755:1876402802621184:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1789477521.676006:0:15755:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789477521.676053:0:15755:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d0d7fad2a80 going to sleep for 11 seconds 00000100:00100000:2.0:1789477521.676209:0:14345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802621184 00000100:00100000:2.0:1789477521.676216:0:14345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802621184 00000100:00100000:2.0:1789477521.676277:0:14345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1789477521.676286:0:14345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d6ec55850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:730ef4b7-dbd8-4cb5-9f31-5e7e04ae8864+17:15755:x1876402802621184:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1789477521.676932:0:14345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d6ec55850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:730ef4b7-dbd8-4cb5-9f31-5e7e04ae8864+17:15755:x1876402802621184:12345-0@lo:503:mount.lustre.0 Request processed in 645us (924us total) trans 0 rc 0/0 00000100:00100000:2.0:1789477521.676943:0:14345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1789477521.678798:0:15755:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d58071f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:730ef4b7-dbd8-4cb5-9f31-5e7e04ae8864:15755:1876402802621184:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1789477521.682250:0:15755:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1789477521.682386:0:15755:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d7f703b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:730ef4b7-dbd8-4cb5-9f31-5e7e04ae8864:15755:1876402802621312:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789477521.683786:0:15755:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789477521.683858:0:15755:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d0d46243d80 going to sleep for 11 seconds 00000100:00100000:2.0:1789477521.683882:0:14343:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802621312 00000100:00100000:2.0:1789477521.683894:0:14343:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802621312 00000100:00100000:2.0:1789477521.683970:0:14343:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1789477521.683982:0:14343:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d7c55c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:730ef4b7-dbd8-4cb5-9f31-5e7e04ae8864+17:15755:x1876402802621312:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789477521.684369:0:14343:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d7c55c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:730ef4b7-dbd8-4cb5-9f31-5e7e04ae8864+17:15755:x1876402802621312:12345-0@lo:502:mount.lustre.0 Request processed in 388us (588us total) trans 0 rc 0/0 00000100:00100000:2.0:1789477521.684378:0:14343:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1789477521.684422:0:15755:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d7f703b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:730ef4b7-dbd8-4cb5-9f31-5e7e04ae8864:15755:1876402802621312:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1789477521.686265:0:15755:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:1.0:1789477521.686360:0:15755:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:1.0:1789477521.686389:0:15755:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:1.0:1789477521.686430:0:15755:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:1.0:1789477521.687799:0:15755:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:1.0:1789477521.687883:0:15755:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:1.0:1789477521.687960:0:15755:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:1.0:1789477521.687995:0:15755:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:1.0:1789477521.688039:0:15755:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 120 off9752 00000100:00100000:1.0:1789477521.688108:0:15755:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d7f703b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:730ef4b7-dbd8-4cb5-9f31-5e7e04ae8864:15755:1876402802621440:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789477521.688244:0:15755:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789477521.688309:0:15755:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d0d46243d80 going to sleep for 11 seconds 00000100:00100000:3.0:1789477521.688351:0:14344:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802621440 00000100:00100000:3.0:1789477521.688366:0:14344:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802621440 00000100:00100000:3.0:1789477521.688462:0:14344:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1789477521.688475:0:14344:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d7c55f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:730ef4b7-dbd8-4cb5-9f31-5e7e04ae8864+17:15755:x1876402802621440:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789477521.688774:0:14344:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d7c55f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:730ef4b7-dbd8-4cb5-9f31-5e7e04ae8864+17:15755:x1876402802621440:12345-0@lo:502:mount.lustre.0 Request processed in 300us (531us total) trans 0 rc 0/0 00000100:00100000:3.0:1789477521.688783:0:14344:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1789477521.689671:0:15755:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d7f703b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:730ef4b7-dbd8-4cb5-9f31-5e7e04ae8864:15755:1876402802621440:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1789477521.689987:0:15755:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9976 00000040:00080000:1.0:1789477521.690005:0:15755:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 10 count 11 00000020:01000000:1.0:1789477521.694132:0:15756:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1789477521.694147:0:15756:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-ost2/ost2 00000020:00000080:1.0:1789477521.694156:0:15756:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789477521.694159:0:15756:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-OST0001 add ost 00000020:00000080:1.0:1789477521.694165:0:15756:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1789477521.694199:0:15756:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff9d0d76160000) 00000020:00000080:1.0:1789477521.694231:0:15756:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type obdfilter with refcount 2 00000020:00000080:1.0:1789477521.694238:0:15756:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1789477521.694331:0:15756:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9d0d47667000 from lustre-OST0001, refs=2 00080000:01000000:1.0:1789477521.694341:0:15756:0:(osd_handler.c:1564:osd_obd_connect()) connect #1 00000020:00000080:1.0:1789477521.694349:0:15756:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xafddb3c8f9282927 00010000:00010000:3.0:1789477521.709122:0:15756:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-3 is initialized 00000001:00000004:3.0:1789477521.711735:0:15756:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 4294967324 00080000:10000000:3.0:1789477521.727486:0:15756:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0xb:0x0] (8/8/4) registered 00000020:00000080:0.0:1789477521.736373:0:15756:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:0.0:1789477521.736396:0:15756:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789477521.736541:0:15756:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789477521.736545:0:15756:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-OST0001 add ost 00000020:01000000:2.0:1789477521.736551:0:15756:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789477521.736557:0:15756:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789477521.736559:0:15756:0:(obd_config.c:1563:class_process_config()) marker 22 (0x1) lustre sys.timeout 00000020:00000080:2.0:1789477521.736563:0:15756:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1789477521.736565:0:15756:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1789477521.736569:0:15756:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789477521.736571:0:15756:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789477521.736572:0:15756:0:(obd_config.c:1563:class_process_config()) marker 22 (0x2) lustre sys.timeout 00000020:01000000:2.0:1789477521.736574:0:15756:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789477521.737573:0:15756:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789477521.737587:0:15756:0:(obd_config.c:1563:class_process_config()) marker 26 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1789477521.737596:0:15756:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:2.0:1789477521.737693:0:15756:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789477521.737705:0:15756:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789477521.737707:0:15756:0:(obd_config.c:1563:class_process_config()) marker 26 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1789477521.737710:0:15756:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 11 count 11 00000020:01000000:0.0:1789477521.739639:0:15755:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-10 (rc=0) 10000000:01000000:0.0:1789477521.739691:0:15755:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.123@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:0.0:1789477521.739715:0:15755:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.123@tcp lock: ffff9d0d50be4600/0xafddb3c8f9282912 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xafddb3c8f9282919 expref: -99 pid: 15755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477521.739731:0:15755:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.123@tcp lock: ffff9d0d50be4600/0xafddb3c8f9282912 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xafddb3c8f9282919 expref: -99 pid: 15755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789477521.739741:0:15755:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9d0d47667000 from 1 10000000:01000000:0.0:1789477521.739744:0:15755:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1789477521.739864:0:15755:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.123@tcp lock: ffff9d0d50be4c00/0xafddb3c8f928292e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477521.739874:0:15755:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.123@tcp lock: ffff9d0d50be4c00/0xafddb3c8f928292e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477521.739901:0:15755:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.123@tcp lock: ffff9d0d50be4c00/0xafddb3c8f928292e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789477521.739932:0:15755:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d6d482a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:730ef4b7-dbd8-4cb5-9f31-5e7e04ae8864:15755:1876402802621568:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1789477521.740021:0:15755:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789477521.740076:0:15755:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d0d44531540 going to sleep for 11 seconds 00000100:00100000:0.0:1789477521.740109:0:14345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802621568 00000100:00100000:0.0:1789477521.740118:0:14345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802621568 00000100:00100000:0.0:1789477521.740195:0:14343:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1789477521.740207:0:14343:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d7c55f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:730ef4b7-dbd8-4cb5-9f31-5e7e04ae8864+17:15755:x1876402802621568:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789477521.740224:0:14343:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789477521.740242:0:14343:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d0d50be5000/0xafddb3c8f9282935 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xafddb3c8f928292e expref: -99 pid: 14343 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477521.742708:0:14343:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d0d50be5000/0xafddb3c8f9282935 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xafddb3c8f928292e expref: 18 pid: 14343 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477521.742739:0:14343:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d0d50be5000/0xafddb3c8f9282935 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xafddb3c8f928292e expref: 18 pid: 14343 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477521.742802:0:14343:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d0d50be5000, rc 0) 00000100:00100000:0.0:1789477521.742905:0:14343:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d7c55f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:730ef4b7-dbd8-4cb5-9f31-5e7e04ae8864+18:15755:x1876402802621568:12345-0@lo:101:mount.lustre.0 Request processed in 2698us (2882us total) trans 0 rc 0/0 00000100:00100000:0.0:1789477521.742916:0:14343:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1789477521.743011:0:15755:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d6d482a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:730ef4b7-dbd8-4cb5-9f31-5e7e04ae8864:15755:1876402802621568:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789477521.743036:0:15755:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.123@tcp lock: ffff9d0d50be4c00/0xafddb3c8f928292e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xafddb3c8f9282935 expref: -99 pid: 15755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477521.743060:0:15755:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.123@tcp lock: ffff9d0d50be4c00/0xafddb3c8f928292e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xafddb3c8f9282935 expref: -99 pid: 15755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1789477521.746807:0:15755:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:0.0:1789477521.747484:0:15755:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1789477521.747804:0:15755:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:0.0:1789477521.747847:0:15755:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:0.0:1789477521.747901:0:15755:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:0.0:1789477521.747908:0:15755:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:0.0:1789477521.748009:0:15755:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d6d482a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:730ef4b7-dbd8-4cb5-9f31-5e7e04ae8864:15755:1876402802621696:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789477521.748108:0:15755:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789477521.748168:0:15755:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d0d44531540 going to sleep for 11 seconds 00000100:00100000:3.0:1789477521.748873:0:14344:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802621696 00000100:00100000:3.0:1789477521.748885:0:14344:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802621696 00000100:00100000:3.0:1789477521.748962:0:14344:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1789477521.748975:0:14344:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d7c55c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:730ef4b7-dbd8-4cb5-9f31-5e7e04ae8864+18:15755:x1876402802621696:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789477521.749338:0:14344:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d7c55c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:730ef4b7-dbd8-4cb5-9f31-5e7e04ae8864+18:15755:x1876402802621696:12345-0@lo:501:mount.lustre.0 Request processed in 364us (1228us total) trans 0 rc 0/0 00000100:00100000:3.0:1789477521.749347:0:14344:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1789477521.754573:0:15755:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d6d482a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:730ef4b7-dbd8-4cb5-9f31-5e7e04ae8864:15755:1876402802621696:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789477521.754754:0:15755:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d6d482a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:730ef4b7-dbd8-4cb5-9f31-5e7e04ae8864:15755:1876402802621824:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1789477521.756227:0:15755:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789477521.756339:0:15755:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d0d44531540 going to sleep for 11 seconds 00000100:00100000:3.0:1789477521.764723:0:14345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802621824 00000100:00100000:3.0:1789477521.764746:0:14345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802621824 00000100:00100000:3.0:1789477521.764839:0:14345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1789477521.764852:0:14345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d760dc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:730ef4b7-dbd8-4cb5-9f31-5e7e04ae8864+18:15755:x1876402802621824:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1789477521.770294:0:14345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d760dc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:730ef4b7-dbd8-4cb5-9f31-5e7e04ae8864+18:15755:x1876402802621824:12345-0@lo:503:mount.lustre.0 Request processed in 5432us (14059us total) trans 0 rc 0/0 00000100:00100000:3.0:1789477521.770313:0:14345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1789477521.772261:0:15755:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d6d482a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:730ef4b7-dbd8-4cb5-9f31-5e7e04ae8864:15755:1876402802621824:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1789477521.774855:0:15755:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1789477521.775002:0:15755:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d7f703b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:730ef4b7-dbd8-4cb5-9f31-5e7e04ae8864:15755:1876402802621952:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789477521.775118:0:15755:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789477521.775260:0:15755:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d0d46cd89c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789477521.778924:0:14344:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802621952 00000100:00100000:3.0:1789477521.778948:0:14344:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802621952 00000100:00100000:3.0:1789477521.779045:0:14344:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1789477521.779059:0:14344:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d760df050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:730ef4b7-dbd8-4cb5-9f31-5e7e04ae8864+18:15755:x1876402802621952:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789477521.779905:0:14344:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d760df050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:730ef4b7-dbd8-4cb5-9f31-5e7e04ae8864+18:15755:x1876402802621952:12345-0@lo:502:mount.lustre.0 Request processed in 844us (4783us total) trans 0 rc 0/0 00000100:00100000:3.0:1789477521.779927:0:14344:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1789477521.780062:0:15755:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d7f703b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:730ef4b7-dbd8-4cb5-9f31-5e7e04ae8864:15755:1876402802621952:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1789477521.780413:0:15755:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:1.0:1789477521.780488:0:15755:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:1.0:1789477521.780548:0:15755:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:1.0:1789477521.780621:0:15755:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:1.0:1789477521.780653:0:15755:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:1.0:1789477521.780821:0:15755:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:1.0:1789477521.780864:0:15755:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:1.0:1789477521.780898:0:15755:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000100:00100000:1.0:1789477521.780952:0:15755:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d7f703b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:730ef4b7-dbd8-4cb5-9f31-5e7e04ae8864:15755:1876402802622080:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789477521.781033:0:15755:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789477521.781075:0:15755:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d0d47db4840 going to sleep for 11 seconds 00000100:00100000:3.0:1789477521.781445:0:14345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802622080 00000100:00100000:3.0:1789477521.781455:0:14345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802622080 00000100:00100000:3.0:1789477521.781526:0:14345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1789477521.781535:0:14345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d760dec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:730ef4b7-dbd8-4cb5-9f31-5e7e04ae8864+18:15755:x1876402802622080:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789477521.782061:0:14345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d760dec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:730ef4b7-dbd8-4cb5-9f31-5e7e04ae8864+18:15755:x1876402802622080:12345-0@lo:502:mount.lustre.0 Request processed in 526us (1028us total) trans 0 rc 0/0 00000100:00100000:3.0:1789477521.782069:0:14345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1789477521.784413:0:15755:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d7f703b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:730ef4b7-dbd8-4cb5-9f31-5e7e04ae8864:15755:1876402802622080:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1789477521.784704:0:15755:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:2.0:1789477521.784728:0:15755:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 9 count 10 00000020:01000000:2.0:1789477521.796097:0:15760:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789477521.796116:0:15760:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789477521.796119:0:15760:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1789477521.796127:0:15760:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9d0d47667000 00000020:00000080:2.0:1789477521.796130:0:15760:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1789477521.796140:0:15760:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789477521.796143:0:15760:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789477521.796144:0:15760:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:2.0:1789477521.796147:0:15760:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789477521.796149:0:15760:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789477521.796150:0:15760:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1789477521.796154:0:15760:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9d0d47667000 00000020:00000080:2.0:1789477521.796156:0:15760:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1789477521.796368:0:15760:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789477521.796372:0:15760:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789477521.796374:0:15760:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:2.0:1789477521.796376:0:15760:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789477521.796379:0:15760:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789477521.796380:0:15760:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1789477521.796384:0:15760:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9d0d47667000 00000020:00000080:2.0:1789477521.796386:0:15760:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1789477521.797518:0:15760:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789477521.797530:0:15760:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789477521.797532:0:15760:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:2.0:1789477521.797537:0:15760:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 10 count 10 00000020:01000000:3.0:1789477521.797999:0:15755:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:3.0:1789477521.798040:0:15755:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.123@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1789477521.798064:0:15755:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.123@tcp lock: ffff9d0d50be4c00/0xafddb3c8f928292e lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xafddb3c8f9282935 expref: -99 pid: 15755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477521.798078:0:15755:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.123@tcp lock: ffff9d0d50be4c00/0xafddb3c8f928292e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xafddb3c8f9282935 expref: -99 pid: 15755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789477521.798146:0:15755:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1789477521.798149:0:15755:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9d0d47667000 10000000:01000000:3.0:1789477521.798153:0:15755:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9d0d47667000 10000000:01000000:3.0:1789477521.798158:0:15755:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1789477521.798164:0:15755:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9d0d47667000 from 1 10000000:01000000:3.0:1789477521.798168:0:15755:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1789477521.798225:0:15755:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.123@tcp lock: ffff9d0d49eca200/0xafddb3c8f928293c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477521.798234:0:15755:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.123@tcp lock: ffff9d0d49eca200/0xafddb3c8f928293c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477521.798247:0:15755:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.123@tcp lock: ffff9d0d49eca200/0xafddb3c8f928293c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789477521.798287:0:15755:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d58070a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:730ef4b7-dbd8-4cb5-9f31-5e7e04ae8864:15755:1876402802622208:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1789477521.798385:0:15755:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789477521.798433:0:15755:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d0d50a28000 going to sleep for 11 seconds 00000100:00100000:2.0:1789477521.798548:0:14344:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802622208 00000100:00100000:2.0:1789477521.798558:0:14344:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802622208 00000100:00100000:2.0:1789477521.798660:0:14344:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1789477521.798672:0:14344:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d760dd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:730ef4b7-dbd8-4cb5-9f31-5e7e04ae8864+18:15755:x1876402802622208:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789477521.798688:0:14344:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789477521.798704:0:14344:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d0d50416a00/0xafddb3c8f9282943 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xafddb3c8f928293c expref: -99 pid: 14344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477521.798733:0:14344:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d0d50416a00/0xafddb3c8f9282943 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xafddb3c8f928293c expref: 19 pid: 14344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477521.798746:0:14344:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d0d50416a00/0xafddb3c8f9282943 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xafddb3c8f928293c expref: 19 pid: 14344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477521.798756:0:14344:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d0d50416a00, rc 0) 00000100:00100000:2.0:1789477521.798825:0:14344:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d760dd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:730ef4b7-dbd8-4cb5-9f31-5e7e04ae8864+19:15755:x1876402802622208:12345-0@lo:101:mount.lustre.0 Request processed in 155us (441us total) trans 0 rc 0/0 00000100:00100000:2.0:1789477521.798834:0:14344:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1789477521.798935:0:15755:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d58070a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:730ef4b7-dbd8-4cb5-9f31-5e7e04ae8864:15755:1876402802622208:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789477521.798955:0:15755:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.123@tcp lock: ffff9d0d49eca200/0xafddb3c8f928293c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xafddb3c8f9282943 expref: -99 pid: 15755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477521.798965:0:15755:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.123@tcp lock: ffff9d0d49eca200/0xafddb3c8f928293c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xafddb3c8f9282943 expref: -99 pid: 15755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1789477521.799851:0:15755:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000040:00080000:0.0:1789477521.800286:0:15755:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1789477521.800555:0:15755:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:0.0:1789477521.800635:0:15755:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:0.0:1789477521.800673:0:15755:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:0.0:1789477521.800766:0:15755:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:0.0:1789477521.800809:0:15755:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:0.0:1789477521.800861:0:15755:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:0.0:1789477521.800898:0:15755:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:0.0:1789477521.800937:0:15755:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:0.0:1789477521.800986:0:15755:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:0.0:1789477521.801022:0:15755:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:0.0:1789477521.801053:0:15755:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:0.0:1789477521.801100:0:15755:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:0.0:1789477521.801137:0:15755:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:0.0:1789477521.801194:0:15755:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:0.0:1789477521.801276:0:15755:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:0.0:1789477521.801314:0:15755:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:0.0:1789477521.801348:0:15755:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:0.0:1789477521.801396:0:15755:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:0.0:1789477521.801437:0:15755:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:0.0:1789477521.801473:0:15755:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:0.0:1789477521.801534:0:15755:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:0.0:1789477521.801603:0:15755:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:0.0:1789477521.801649:0:15755:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:0.0:1789477521.801730:0:15755:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:0.0:1789477521.801773:0:15755:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 128 off12440 00000040:00080000:0.0:1789477521.801807:0:15755:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12664 00000040:00080000:0.0:1789477521.801859:0:15755:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12888 00000040:00080000:0.0:1789477521.801888:0:15755:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off12968 00000040:00080000:0.0:1789477521.801920:0:15755:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13192 00000040:00080000:0.0:1789477521.801958:0:15755:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].30, 224 off13416 00000040:00080000:0.0:1789477521.801985:0:15755:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].31, 88 off13504 00000040:00080000:0.0:1789477521.802010:0:15755:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].32, 128 off13632 00000040:00080000:0.0:1789477521.802048:0:15755:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].33, 144 off13776 00000040:00080000:0.0:1789477521.802084:0:15755:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].34, 128 off13904 00000040:00080000:0.0:1789477521.802112:0:15755:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].35, 224 off14128 00000040:00080000:0.0:1789477521.802149:0:15755:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].36, 224 off14352 00000040:00080000:1.0:1789477521.809621:0:15755:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].37, 80 off14432 00000040:00080000:1.0:1789477521.809882:0:15755:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].38, 224 off14656 00000040:00080000:1.0:1789477521.809894:0:15755:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 38 count 39 00000100:00100000:1.0:1789477521.810058:0:15755:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d7f702d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:730ef4b7-dbd8-4cb5-9f31-5e7e04ae8864:15755:1876402802622336:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789477521.810160:0:15755:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789477521.810230:0:15755:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d0d585766c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789477521.810436:0:14345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802622336 00000100:00100000:0.0:1789477521.810446:0:14345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802622336 00000100:00100000:0.0:1789477521.810531:0:14345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1789477521.810542:0:14345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d761b2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:730ef4b7-dbd8-4cb5-9f31-5e7e04ae8864+19:15755:x1876402802622336:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789477521.810945:0:14345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d761b2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:730ef4b7-dbd8-4cb5-9f31-5e7e04ae8864+19:15755:x1876402802622336:12345-0@lo:501:mount.lustre.0 Request processed in 403us (784us total) trans 0 rc 0/0 00000100:00100000:0.0:1789477521.810955:0:14345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1789477521.813279:0:15755:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d7f702d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:730ef4b7-dbd8-4cb5-9f31-5e7e04ae8864:15755:1876402802622336:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789477521.813358:0:15755:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d7f702d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:730ef4b7-dbd8-4cb5-9f31-5e7e04ae8864:15755:1876402802622464:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1789477521.815148:0:15755:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789477521.815230:0:15755:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d0d585766c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789477521.816912:0:14343:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802622464 00000100:00100000:3.0:1789477521.816932:0:14343:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802622464 00000100:00100000:3.0:1789477521.817012:0:14343:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1789477521.817025:0:14343:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d761b1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:730ef4b7-dbd8-4cb5-9f31-5e7e04ae8864+19:15755:x1876402802622464:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1789477521.821348:0:14343:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d761b1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:730ef4b7-dbd8-4cb5-9f31-5e7e04ae8864+19:15755:x1876402802622464:12345-0@lo:503:mount.lustre.0 Request processed in 4310us (6192us total) trans 0 rc 0/0 00000100:00100000:3.0:1789477521.821368:0:14343:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1789477521.822620:0:15755:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d7f702d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:730ef4b7-dbd8-4cb5-9f31-5e7e04ae8864:15755:1876402802622464:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1789477521.823431:0:15755:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1789477521.823546:0:15755:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d58070a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:730ef4b7-dbd8-4cb5-9f31-5e7e04ae8864:15755:1876402802622592:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789477521.823679:0:15755:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789477521.823729:0:15755:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d0d50a5d540 going to sleep for 11 seconds 00000100:00100000:0.0:1789477521.825010:0:14344:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802622592 00000100:00100000:0.0:1789477521.825027:0:14344:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802622592 00000100:00100000:0.0:1789477521.825093:0:14344:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1789477521.825106:0:14344:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d761b3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:730ef4b7-dbd8-4cb5-9f31-5e7e04ae8864+19:15755:x1876402802622592:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789477521.825871:0:14344:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d761b3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:730ef4b7-dbd8-4cb5-9f31-5e7e04ae8864+19:15755:x1876402802622592:12345-0@lo:502:mount.lustre.0 Request processed in 765us (2190us total) trans 0 rc 0/0 00000100:00100000:0.0:1789477521.825881:0:14344:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1789477521.827470:0:15755:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d58070a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:730ef4b7-dbd8-4cb5-9f31-5e7e04ae8864:15755:1876402802622592:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1789477521.828301:0:15755:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:3.0:1789477521.828389:0:15755:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:3.0:1789477521.828426:0:15755:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:3.0:1789477521.828861:0:15755:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:3.0:1789477521.828916:0:15755:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:3.0:1789477521.828977:0:15755:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:3.0:1789477521.829020:0:15755:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:3.0:1789477521.829060:0:15755:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:3.0:1789477521.829126:0:15755:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:3.0:1789477521.829187:0:15755:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:3.0:1789477521.829239:0:15755:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:3.0:1789477521.829297:0:15755:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:3.0:1789477521.829331:0:15755:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:3.0:1789477521.829386:0:15755:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:3.0:1789477521.829438:0:15755:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:3.0:1789477521.833786:0:15755:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:3.0:1789477521.833874:0:15755:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:3.0:1789477521.833996:0:15755:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:3.0:1789477521.834046:0:15755:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:3.0:1789477521.834087:0:15755:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:3.0:1789477521.834143:0:15755:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:3.0:1789477521.834198:0:15755:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:3.0:1789477521.834236:0:15755:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:3.0:1789477521.834304:0:15755:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:3.0:1789477521.834339:0:15755:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 128 off12440 00000040:00080000:3.0:1789477521.834369:0:15755:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12664 00000040:00080000:3.0:1789477521.834419:0:15755:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12888 00000040:00080000:3.0:1789477521.836761:0:15755:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off12968 00000040:00080000:3.0:1789477521.836884:0:15755:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13192 00000040:00080000:3.0:1789477521.836992:0:15755:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13416 00000040:00080000:3.0:1789477521.837031:0:15755:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13504 00000040:00080000:3.0:1789477521.841256:0:15755:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13632 00000040:00080000:3.0:1789477521.841329:0:15755:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13776 00000040:00080000:3.0:1789477521.841429:0:15755:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13904 00000040:00080000:3.0:1789477521.841551:0:15755:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14128 00000040:00080000:3.0:1789477521.841691:0:15755:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14352 00000040:00080000:3.0:1789477521.841732:0:15755:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14432 00000040:00080000:3.0:1789477521.841768:0:15755:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14656 00000040:00080000:3.0:1789477521.841852:0:15755:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14880 00000040:00080000:3.0:1789477521.841894:0:15755:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 120 off15000 00000100:00100000:3.0:1789477521.841967:0:15755:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d58070a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:730ef4b7-dbd8-4cb5-9f31-5e7e04ae8864:15755:1876402802622720:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789477521.842080:0:15755:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789477521.844304:0:15755:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d0d50a5d540 going to sleep for 11 seconds 00000100:00100000:2.0:1789477521.847902:0:14343:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802622720 00000100:00100000:2.0:1789477521.847922:0:14343:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802622720 00000100:00100000:2.0:1789477521.848018:0:14343:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1789477521.848031:0:14343:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d761b1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:730ef4b7-dbd8-4cb5-9f31-5e7e04ae8864+19:15755:x1876402802622720:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789477521.848781:0:14343:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d761b1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:730ef4b7-dbd8-4cb5-9f31-5e7e04ae8864+19:15755:x1876402802622720:12345-0@lo:502:mount.lustre.0 Request processed in 426us (6374us total) trans 0 rc 0/0 00000100:00100000:2.0:1789477521.848794:0:14343:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1789477521.848906:0:15755:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d58070a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:730ef4b7-dbd8-4cb5-9f31-5e7e04ae8864:15755:1876402802622720:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1789477521.849081:0:15755:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 224 off15224 00000040:00080000:2.0:1789477521.849109:0:15755:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 41 count 42 00000020:01000004:1.0:1789477521.851202:0:15765:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:1.0:1789477521.851225:0:15765:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff9d0d584799b8) 00000020:00000080:1.0:1789477521.851253:0:15765:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type lwp with refcount 2 00000020:01000004:1.0:1789477521.851351:0:15765:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9d0d47667000 from lustre-OST0001, refs=3 00000020:01000004:1.0:1789477521.851356:0:15765:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9d0d47667000 from lustre-OST0001, refs=3 00000020:01000004:1.0:1789477521.851359:0:15765:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9d0d47667000 3 00010000:00080000:1.0:1789477521.851401:0:15765:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9d0d5871a800@lustre-MDT0000-lwp-OST0001: add connection 192.168.201.123@tcp at head 00010000:00010000:1.0:1789477521.859197:0:15765:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-5 is initialized 00000020:00000080:1.0:1789477521.866563:0:15765:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:1.0:1789477521.866686:0:15765:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1789477521.866710:0:15765:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0xafddb3c8f9282951 00000100:00080000:1.0:1789477521.866727:0:15765:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1789477521.866744:0:15765:0:(import.c:625:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9d0d5871a800 using connection 192.168.201.123@tcp/0@lo 00000100:00100000:1.0:1789477521.866798:0:15765:0:(import.c:827:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9d0d7f702680 x1876402802622848/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1789477521.866836:0:15765:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1789477521.866906:0:12773:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789477521.866912:0:12773:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1789477521.866917:0:12773:0:(import.c:65:import_set_state_nolock()) ffff9d0d4823f000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1789477521.866923:0:12773:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 465 00000100:00080000:0.0:1789477521.866926:0:12773:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1789477521.866933:0:12773:0:(import.c:625:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9d0d4823f000 using connection 192.168.201.123@tcp/0@lo 00000100:00100000:0.0:1789477521.866949:0:12773:0:(import.c:827:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9d0d6d483b80 x1876402802623104/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1789477521.867011:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d6d482a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1876402802622976:0@lo:400:kworker.0 00000100:00100000:0.0:1789477521.867108:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789477521.867193:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d6d480700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3312:1876402802623232:0@lo:400:kworker.0 00000100:00100000:0.0:1789477521.867222:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789477521.867240:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789477521.867244:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d6d483800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3312:1876402802623360:0@lo:400:kworker.0 00000100:00100000:0.0:1789477521.867269:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789477521.867556:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d7f702680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3309:1876402802622848:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1789477521.867614:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789477521.867649:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d6d483b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3309:1876402802623104:0@lo:8:kworker.0 00000100:00100000:3.0:1789477521.867669:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789477521.867703:0:14350:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802623232 00000100:00100000:3.0:1789477521.867711:0:14350:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802623232 00000100:00100000:3.0:1789477521.867749:0:14350:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802623360 00000100:00100000:3.0:1789477521.867751:0:14350:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802623360 00000100:00100000:3.0:1789477521.867766:0:14350:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802622848 00000100:00100000:3.0:1789477521.867769:0:14350:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802622848 00000100:00100000:3.0:1789477521.867784:0:14350:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1789477521.867793:0:14350:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d6d481180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1876402802623232:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789477521.867854:0:14350:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d6d481180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1876402802623232:12345-0@lo:400:kworker.0 Request processed in 61us (630us total) trans 0 rc 0/0 00000100:00100000:3.0:1789477521.867863:0:14350:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1789477521.867883:0:14350:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1789477521.867889:0:14350:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d6d480a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1876402802623360:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789477521.867917:0:14350:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d6d480a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1876402802623360:12345-0@lo:400:kworker.0 Request processed in 29us (646us total) trans 0 rc 0/0 00000100:00100000:3.0:1789477521.867923:0:14350:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1789477521.867935:0:14350:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789477521.867940:0:14350:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d58071f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3309:x1876402802622848:12345-0@lo:38:llog_process_th.0 00010000:00080000:3.0:1789477521.867964:0:14350:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 466 last 0 00000020:00000080:3.0:1789477521.868010:0:14350:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0xafddb3c8f9282958 00000004:00100000:3.0:1789477521.868031:0:14350:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1789477521.868071:0:14350:0:(import.c:65:import_set_state_nolock()) ffff9d0d482ae800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789477521.868125:0:14350:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d58071f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1876402802622848:12345-0@lo:38:llog_process_th.0 Request processed in 184us (510us total) trans 0 rc 0/0 00000100:00100000:3.0:1789477521.868132:0:14350:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:3.0:1789477521.868188:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9d0d6d483800 x1876402802623360/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789477537 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789477521.868203:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d6d483800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3312:1876402802623360:0@lo:400:kworker.0 00010000:00080000:3.0:1789477521.868217:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9d0d6d480700 x1876402802623232/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789477537 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789477521.868226:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d6d480700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3312:1876402802623232:0@lo:400:kworker.0 00010000:00080000:3.0:1789477521.868260:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9d0d7f702680 x1876402802622848/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789477531 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789477521.868343:0:3309:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:3.0:1789477521.868622:0:3309:0:(import.c:1133:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 2 00000100:00080000:3.0:1789477521.868633:0:3309:0:(import.c:957:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:3.0:1789477521.868638:0:3309:0:(import.c:1214:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1789477521.868641:0:3309:0:(import.c:65:import_set_state_nolock()) ffff9d0d5871a800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1789477521.868648:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d7f702680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3309:1876402802622848:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1789477521.868737:0:15039:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802622976 00000100:00100000:1.0:1789477521.868743:0:15039:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802622976 00000100:00100000:1.0:1789477521.868784:0:15039:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802623104 00000100:00100000:1.0:1789477521.868787:0:15039:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802623104 00000100:00100000:1.0:1789477521.868805:0:15039:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789477521.868812:0:15039:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d6d483100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3311:x1876402802622976:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789477521.868863:0:15039:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d6d483100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3311:x1876402802622976:12345-0@lo:400:kworker.0 Request processed in 52us (1755us total) trans 0 rc 0/0 00000100:00100000:1.0:1789477521.868870:0:15039:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789477521.868883:0:15039:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1789477521.868887:0:15039:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d58073b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3309:x1876402802623104:12345-0@lo:8:kworker.0 00000100:00100000:1.0:1789477521.868922:0:15039:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d58073b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3309:x1876402802623104:12345-0@lo:8:kworker.0 Request processed in 33us (1251us total) trans 0 rc -11/-11 00000100:00100000:1.0:1789477521.868937:0:15039:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1789477521.868971:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d6d482a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1876402802622976:0@lo:400:kworker.0 00000040:00080000:1.0:1789477521.869191:0:15765:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 42 count 42 00000100:00100000:3.0:1789477521.870246:0:3309:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1789477521.870258:0:3309:0:(import.c:65:import_set_state_nolock()) ffff9d0d4823f000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1789477521.870274:0:3309:0:(import.c:1512:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-11) 00000100:00100000:3.0:1789477521.870278:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d6d483b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3309:1876402802623104:0@lo:8:kworker.0 00000020:01000000:0.0:1789477521.870987:0:15755:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:0.0:1789477521.871032:0:15755:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.123@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1789477521.871058:0:15755:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.123@tcp lock: ffff9d0d49eca200/0xafddb3c8f928293c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xafddb3c8f9282943 expref: -99 pid: 15755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477521.871070:0:15755:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.123@tcp lock: ffff9d0d49eca200/0xafddb3c8f928293c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xafddb3c8f9282943 expref: -99 pid: 15755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1789477521.871143:0:15755:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1789477521.871146:0:15755:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1789477521.871147:0:15755:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789477521.871148:0:15755:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789477521.871150:0:15755:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789477521.871152:0:15755:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789477521.871153:0:15755:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1789477521.871156:0:15755:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789477521.871157:0:15755:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1789477521.871162:0:15755:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020002 00000020:01000004:0.0:1789477521.871165:0:15755:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1789477521.871166:0:15755:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1789477521.871167:0:15755:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789477521.871168:0:15755:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789477521.871169:0:15755:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789477521.871170:0:15755:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789477521.871183:0:15755:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1789477521.871184:0:15755:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789477521.871185:0:15755:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1789477521.871222:0:15755:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:0.0:1789477521.871254:0:15755:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d6d480e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:730ef4b7-dbd8-4cb5-9f31-5e7e04ae8864:15755:1876402802623488:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1789477521.871352:0:15755:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789477521.871406:0:14345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802623488 00000100:00100000:0.0:1789477521.871411:0:15755:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d0d44531000 going to sleep for 11 seconds 00000100:00100000:2.0:1789477521.871416:0:14345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802623488 00000100:00100000:2.0:1789477521.871644:0:14345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1789477521.871656:0:14345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d7db7f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:730ef4b7-dbd8-4cb5-9f31-5e7e04ae8864+19:15755:x1876402802623488:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1789477521.871694:0:14345:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:2.0:1789477521.871712:0:14345:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:3.0:1789477521.941629:0:14345:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1789477521.941653:0:14345:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:2.0:1789477521.941712:0:14366:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1789477521.941718:0:14366:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1789477521.941746:0:14366:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9d0d50416400/0xafddb3c8f928295f lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477521.941771:0:14366:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9d0d49ecae00/0xafddb3c8f9282832 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xafddb3c8f928282b expref: 19 pid: 14345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477521.941781:0:14366:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9d0d50416400/0xafddb3c8f928295f lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477521.941834:0:14366:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9d0d49ecae00/0xafddb3c8f9282832 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xafddb3c8f928282b expref: 19 pid: 14345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477521.941852:0:14366:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9d0d49ecae00/0xafddb3c8f9282832 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xafddb3c8f928282b expref: 19 pid: 14345 timeout: 567 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789477521.941870:0:14366:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d7523d880 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14366:1876402802623616:0@lo:104: 00000100:00100000:2.0:1789477521.941953:0:14366:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789477521.942098:0:14366:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d0d50a1e240 going to sleep for 11 seconds 00000100:00100000:3.0:1789477521.944062:0:14334:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802623616 00000100:00100000:3.0:1789477521.944095:0:14334:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802623616 00000100:00100000:3.0:1789477521.944162:0:14334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789477521.944184:0:14334:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d7523ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:730ef4b7-dbd8-4cb5-9f31-5e7e04ae8864+3:14366:x1876402802623616:12345-0@lo:104: 00010000:00010000:3.0:1789477521.944206:0:14334:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.123@tcp lock: ffff9d0d50416600/0xafddb3c8f928282b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xafddb3c8f9282832 expref: -99 pid: 14347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477521.944313:0:14334:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1789477521.944320:0:14334:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d7523ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:730ef4b7-dbd8-4cb5-9f31-5e7e04ae8864+3:14366:x1876402802623616:12345-0@lo:104: Request processed in 148us (2366us total) trans 0 rc 0/0 00000100:00100000:3.0:1789477521.944328:0:14334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1789477521.944440:0:14366:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d7523d880 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14366:1876402802623616:0@lo:104: 00010000:00010000:2.0:1789477521.944468:0:14366:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9d0d50416400/0xafddb3c8f928295f lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477521.944604:0:14338:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789477521.944613:0:14338:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.123@tcp lock: ffff9d0d50416600/0xafddb3c8f928282b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xafddb3c8f9282832 expref: -99 pid: 14347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477521.944622:0:14338:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d0d50416600 already unused, calling callback (ffffffffc1bb3c20) 10000000:00010000:1.0:1789477521.944628:0:14338:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.123@tcp lock: ffff9d0d50416600/0xafddb3c8f928282b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xafddb3c8f9282832 expref: -99 pid: 14347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477521.944637:0:14338:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.123@tcp lock: ffff9d0d50416600/0xafddb3c8f928282b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xafddb3c8f9282832 expref: -99 pid: 14347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789477521.944646:0:14338:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.123@tcp lock: ffff9d0d50416600/0xafddb3c8f928282b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xafddb3c8f9282832 expref: -99 pid: 14347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789477521.944653:0:14338:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1789477521.944700:0:14338:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.123@tcp lock: ffff9d0d50416600/0xafddb3c8f928282b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xafddb3c8f9282832 expref: -99 pid: 14347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477521.944707:0:14338:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789477521.944734:0:14338:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.123@tcp lock: ffff9d0d50416600/0xafddb3c8f928282b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xafddb3c8f9282832 expref: -99 pid: 14347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477521.944741:0:14338:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.123@tcp lock: ffff9d0d50416600/0xafddb3c8f928282b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xafddb3c8f9282832 expref: -99 pid: 14347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477521.944763:0:14338:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789477521.944774:0:14338:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789477521.944776:0:14338:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789477521.944786:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789477521.944804:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d7f701c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:730ef4b7-dbd8-4cb5-9f31-5e7e04ae8864:3311:1876402802623744:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789477521.944854:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789477521.944905:0:14336:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802623744 00000100:00100000:1.0:1789477521.944910:0:14336:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802623744 00010000:00010000:1.0:1789477521.944933:0:14336:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9d0d49ecae00/0xafddb3c8f9282832 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xafddb3c8f928282b expref: 20 pid: 14345 timeout: 567 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789477521.944955:0:14336:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789477521.944961:0:14336:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d7f702300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:730ef4b7-dbd8-4cb5-9f31-5e7e04ae8864+20:3311:x1876402802623744:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789477521.944974:0:14336:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789477521.944981:0:14336:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9d0d49ecae00/0xafddb3c8f9282832 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xafddb3c8f928282b expref: 20 pid: 14345 timeout: 567 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477521.944992:0:14336:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9d0d49ecae00/0xafddb3c8f9282832 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xafddb3c8f928282b expref: 20 pid: 14345 timeout: 567 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477521.945008:0:14336:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d0d49ecae00/0xafddb3c8f9282832 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xafddb3c8f928282b expref: 20 pid: 14345 timeout: 567 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477521.945025:0:14336:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9d0d50416400/0xafddb3c8f928295f lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477521.945034:0:14336:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d0d50416400/0xafddb3c8f928295f lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1789477521.945051:0:14336:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.003334354s 00010000:00010000:1.0:1789477521.945057:0:14336:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9d0d50416400/0xafddb3c8f928295f lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477521.945076:0:14336:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9d0d50416400/0xafddb3c8f928295f lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477521.945084:0:14336:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9d0d50416400/0xafddb3c8f928295f lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477521.945091:0:14336:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9d0d50416400/0xafddb3c8f928295f lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477521.945096:0:14336:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d0d50416400 already unused, calling callback (ffffffffc15972a0) 00010000:00010000:1.0:1789477521.945101:0:14336:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9d0d50416400/0xafddb3c8f928295f lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477521.945110:0:14336:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9d0d50416400/0xafddb3c8f928295f lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477521.945121:0:14336:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9d0d50416400/0xafddb3c8f928295f lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477521.945131:0:14336:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789477521.945161:0:14336:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d7f702300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:730ef4b7-dbd8-4cb5-9f31-5e7e04ae8864+19:3311:x1876402802623744:12345-0@lo:103:ldlm_bl.0 Request processed in 200us (307us total) trans 0 rc 0/0 00000100:00100000:1.0:1789477521.945168:0:14336:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789477521.945208:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d7f701c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:730ef4b7-dbd8-4cb5-9f31-5e7e04ae8864:3311:1876402802623744:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789477521.945376:0:14366:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9d0d50416400/0xafddb3c8f928295f lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477521.945398:0:14366:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9d0d50416400/0xafddb3c8f928295f lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477521.945406:0:14366:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d0d50416400/0xafddb3c8f928295f lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789477521.953808:0:14345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d7db7f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:730ef4b7-dbd8-4cb5-9f31-5e7e04ae8864+18:15755:x1876402802623488:12345-0@lo:253:mount.lustre.0 Request processed in 82140us (82442us total) trans 0 rc 0/0 00000100:00100000:3.0:1789477521.953828:0:14345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1789477521.953979:0:15755:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d6d480e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:730ef4b7-dbd8-4cb5-9f31-5e7e04ae8864:15755:1876402802623488:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1789477521.954000:0:15755:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:0.0:1789477521.954004:0:15755:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1789477521.954006:0:15755:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1789477521.954008:0:15755:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789477521.954009:0:15755:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789477521.954011:0:15755:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789477521.954013:0:15755:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789477521.954014:0:15755:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1789477521.954016:0:15755:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789477521.954018:0:15755:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1789477521.954036:0:15755:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:2.0:1789477521.959113:0:15755:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:2.0:1789477521.959279:0:15755:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:2.0:1789477521.959465:0:15755:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:2.0:1789477521.959645:0:15755:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:2.0:1789477521.959791:0:15755:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:2.0:1789477521.960014:0:15755:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:3.0:1789477521.961555:0:15755:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934592 00002000:00080000:2.0:1789477522.026677:0:15755:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:2.0:1789477522.026692:0:15755:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:2.0:1789477522.026741:0:15755:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1789477522.026822:0:15755:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.201.123@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1789477522.026839:0:15755:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=49 00000080:00000004:2.0:1789477522.026880:0:15755:0:(super25.c:182:lustre_fill_super()) lustre-ost2/ost2: Mount complete 00010000:00010000:1.0:1789477522.226262:0:14339:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1789477523.251261:0:14347:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1789477523.251273:0:14347:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9d0c43499000 from 8 10000000:01000000:0.0:1789477523.251279:0:14347:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1789477523.251350:0:14347:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.123@tcp lock: ffff9d0d50be5800/0xafddb3c8f9282966 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477523.251365:0:14347:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.123@tcp lock: ffff9d0d50be5800/0xafddb3c8f9282966 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477523.251382:0:14347:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.123@tcp lock: ffff9d0d50be5800/0xafddb3c8f9282966 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789477523.251415:0:14347:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d6d480e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:730ef4b7-dbd8-4cb5-9f31-5e7e04ae8864:14347:1876402802623872:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789477523.251517:0:14347:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789477523.251625:0:14347:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d0d510ab840 going to sleep for 11 seconds 00000100:00100000:1.0:1789477523.252926:0:14344:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802623872 00000100:00100000:1.0:1789477523.252944:0:14344:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802623872 00000100:00100000:1.0:1789477523.253013:0:14344:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1789477523.253025:0:14344:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d7db7fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:730ef4b7-dbd8-4cb5-9f31-5e7e04ae8864+18:14347:x1876402802623872:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789477523.253065:0:14344:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789477523.253093:0:14344:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d0d7f519c00/0xafddb3c8f928296d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xafddb3c8f9282966 expref: -99 pid: 14344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477523.253129:0:14344:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d0d7f519c00/0xafddb3c8f928296d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xafddb3c8f9282966 expref: 19 pid: 14344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477523.253142:0:14344:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d0d7f519c00/0xafddb3c8f928296d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xafddb3c8f9282966 expref: 19 pid: 14344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477523.253165:0:14344:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d0d7f519c00, rc 0) 00000100:00100000:1.0:1789477523.253254:0:14344:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d7db7fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:730ef4b7-dbd8-4cb5-9f31-5e7e04ae8864+19:14347:x1876402802623872:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 229us (1736us total) trans 0 rc 0/0 00000100:00100000:1.0:1789477523.253262:0:14344:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00010000:00010000:1.0:1789477523.253343:0:14338:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789477523.254556:0:14347:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d6d480e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:730ef4b7-dbd8-4cb5-9f31-5e7e04ae8864:14347:1876402802623872:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789477523.254621:0:14347:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.123@tcp lock: ffff9d0d50be5800/0xafddb3c8f9282966 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xafddb3c8f928296d expref: -99 pid: 14347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477523.254636:0:14347:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.123@tcp lock: ffff9d0d50be5800/0xafddb3c8f9282966 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xafddb3c8f928296d expref: -99 pid: 14347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789477523.254723:0:14347:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d6d480e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:730ef4b7-dbd8-4cb5-9f31-5e7e04ae8864:14347:1876402802624000:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1789477523.254794:0:14347:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789477523.254851:0:14347:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d0d510ab840 going to sleep for 11 seconds 00000100:00100000:2.0:1789477523.258741:0:14345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802624000 00000100:00100000:2.0:1789477523.258768:0:14345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802624000 00000100:00100000:2.0:1789477523.258982:0:14345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1789477523.258996:0:14345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d7db7cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:730ef4b7-dbd8-4cb5-9f31-5e7e04ae8864+19:14347:x1876402802624000:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1789477523.259033:0:14345:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1789477523.259062:0:14345:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1789477523.259066:0:14345:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 8 00000100:00100000:2.0:1789477523.259255:0:14345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d7db7cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:730ef4b7-dbd8-4cb5-9f31-5e7e04ae8864+19:14347:x1876402802624000:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 261us (4459us total) trans 0 rc 0/0 00000100:00100000:2.0:1789477523.259264:0:14345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1789477523.261528:0:14347:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d6d480e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:730ef4b7-dbd8-4cb5-9f31-5e7e04ae8864:14347:1876402802624000:0@lo:256:ll_cfg_requeue.0 10000000:01000000:0.0:1789477523.261694:0:14347:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.123@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1789477523.261708:0:14347:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.123@tcp lock: ffff9d0d50be5800/0xafddb3c8f9282966 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xafddb3c8f928296d expref: -99 pid: 14347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477523.261721:0:14347:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.123@tcp lock: ffff9d0d50be5800/0xafddb3c8f9282966 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xafddb3c8f928296d expref: -99 pid: 14347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477524.272139:0:14339:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789477525.295783:0:14338:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789477525.423866:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d58073480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1876402802624128:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789477525.423970:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789477525.428637:0:15042:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802624128 00000100:00100000:3.0:1789477525.428661:0:15042:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802624128 00000100:00100000:3.0:1789477525.428774:0:15042:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789477525.428794:0:15042:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d7f701c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1876402802624128:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789477525.428850:0:15042:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789477525.428970:0:15042:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d7f701c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1876402802624128:12345-0@lo:13:osp-pre-0-0.0 Request processed in 184us (5000us total) trans 0 rc 0/0 00000100:00100000:3.0:1789477525.428979:0:15042:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789477525.429068:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d58073480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1876402802624128:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1789477525.429182:0:14346:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1789477526.328807:0:14339:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1789477526.964529:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789477526.964538:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1789477526.964543:0:36:0:(import.c:65:import_set_state_nolock()) ffff9d0d4823f000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1789477526.964567:0:36:0:(import.c:625:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9d0d4823f000 using connection 192.168.201.123@tcp/0@lo 00000100:00100000:3.0:1789477526.964745:0:36:0:(import.c:827:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9d0d58072d80 x1876402802624512/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1789477526.964826:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d58073480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:730ef4b7-dbd8-4cb5-9f31-5e7e04ae8864:3312:1876402802624256:0@lo:400:kworker.0 00000100:00100000:3.0:1789477526.964913:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789477526.964974:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d7bddce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3312:1876402802624896:0@lo:400:kworker.0 00000100:00100000:3.0:1789477526.965003:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789477526.965033:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789477526.965039:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d58072680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1876402802624384:0@lo:400:kworker.0 00000100:00100000:3.0:1789477526.965066:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789477526.965112:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d58072d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3309:1876402802624512:0@lo:8:kworker.0 00000100:00100000:3.0:1789477526.965138:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789477526.965167:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d58070a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3310:1876402802624640:0@lo:400:kworker.0 00000100:00100000:3.0:1789477526.965191:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789477526.965210:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789477526.965215:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d7bddca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3310:1876402802624768:0@lo:400:kworker.0 00000100:00100000:3.0:1789477526.965235:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789477526.965269:0:14343:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802624256 00000100:00100000:3.0:1789477526.965279:0:14343:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802624256 00000100:00100000:3.0:1789477526.965340:0:14343:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1789477526.965352:0:14343:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d7db7c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:730ef4b7-dbd8-4cb5-9f31-5e7e04ae8864+19:3312:x1876402802624256:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789477526.965422:0:14343:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d7db7c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:730ef4b7-dbd8-4cb5-9f31-5e7e04ae8864+19:3312:x1876402802624256:12345-0@lo:400:kworker.0 Request processed in 71us (509us total) trans 0 rc 0/0 00000100:00100000:3.0:1789477526.965430:0:14343:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1789477526.965472:0:14350:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802624896 00000100:00100000:3.0:1789477526.965475:0:14350:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802624896 00000100:00100000:3.0:1789477526.965528:0:14350:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802624640 00000100:00100000:3.0:1789477526.965532:0:14350:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802624640 00000100:00100000:3.0:1789477526.965543:0:14350:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802624768 00000100:00100000:3.0:1789477526.965546:0:14350:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802624768 00000100:00100000:3.0:1789477526.965559:0:14350:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1789477526.965565:0:14350:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d7bdddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1876402802624896:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789477526.965642:0:14350:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d7bdddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1876402802624896:12345-0@lo:400:kworker.0 Request processed in 77us (637us total) trans 0 rc 0/0 00000100:00100000:3.0:1789477526.965648:0:14350:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1789477526.965660:0:14350:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1789477526.965666:0:14350:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d7bdde300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1876402802624640:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789477526.965697:0:14350:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d7bdde300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1876402802624640:12345-0@lo:400:kworker.0 Request processed in 31us (505us total) trans 0 rc 0/0 00000100:00100000:3.0:1789477526.965703:0:14350:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1789477526.965714:0:14350:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1789477526.965720:0:14350:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d7bdddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1876402802624768:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789477526.965748:0:14350:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d7bdddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1876402802624768:12345-0@lo:400:kworker.0 Request processed in 28us (512us total) trans 0 rc 0/0 00000100:00100000:3.0:1789477526.965754:0:14350:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1789477526.965774:0:15039:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802624384 00000100:00100000:3.0:1789477526.965778:0:15039:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802624384 00000100:00100000:3.0:1789477526.965815:0:15039:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802624512 00000100:00100000:3.0:1789477526.965819:0:15039:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802624512 00000100:00100000:3.0:1789477526.965835:0:15039:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789477526.965843:0:15039:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d7bddf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3312:x1876402802624384:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789477526.965876:0:15039:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d7bddf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3312:x1876402802624384:12345-0@lo:400:kworker.0 Request processed in 34us (809us total) trans 0 rc 0/0 00000100:00100000:3.0:1789477526.965892:0:15039:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789477526.965904:0:15039:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1789477526.965909:0:15039:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d7bdded80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3309:x1876402802624512:12345-0@lo:8:kworker.0 00010000:00080000:3.0:1789477526.965942:0:15039:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 472 last 0 00000020:00000080:3.0:1789477526.965987:0:15039:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xafddb3c8f9282974 00002000:00100000:3.0:1789477526.966009:0:15039:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff9d0d6ecf4000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113954 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:3.0:1789477526.966014:0:15039:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:3.0:1789477526.966018:0:15039:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:3.0:1789477526.966528:0:15039:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1789477526.966568:0:15039:0:(import.c:65:import_set_state_nolock()) ffff9d0d6ecf2800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789477526.966676:0:15039:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d7bdded80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3309:x1876402802624512:12345-0@lo:8:kworker.0 Request processed in 764us (1536us total) trans 0 rc 0/0 00000100:00100000:3.0:1789477526.966685:0:15039:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00080000:3.0:1789477526.966732:0:14346:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1789477526.966783:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d0d58072d80 x1876402802624512/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1789477551 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1789477526.966804:0:3309:0:(import.c:1133:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 2 00000100:00080000:3.0:1789477526.966813:0:3309:0:(import.c:957:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:3.0:1789477526.966821:0:3309:0:(import.c:1214:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:3.0:1789477526.966824:0:3309:0:(import.c:65:import_set_state_nolock()) ffff9d0d4823f000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:3.0:1789477526.966844:0:3309:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:3.0:1789477526.966850:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d58072d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3309:1876402802624512:0@lo:8:kworker.0 00000004:00080000:3.0:1789477526.966886:0:14374:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:3.0:1789477526.967353:0:14374:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 472038774144ns, next at 0ns, rc = 0 00010000:00080000:3.0:1789477526.967413:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d0d7bddca80 x1876402802624768/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789477542 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789477526.967435:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d7bddca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3310:1876402802624768:0@lo:400:kworker.0 00010000:00080000:3.0:1789477526.967451:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d0d58070a80 x1876402802624640/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789477542 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789477526.967460:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d58070a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3310:1876402802624640:0@lo:400:kworker.0 00000004:00080000:2.0:1789477526.969903:0:14375:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x280000400:0x6:0x0] 00000100:00100000:2.0:1789477526.969948:0:14375:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d7523df80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14375:1876402802625152:0@lo:5:osp-pre-1-0.0 00000100:00100000:2.0:1789477526.970041:0:14375:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789477526.970075:0:14375:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d0d585f20c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789477526.977739:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d7523d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1876402802625024:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789477526.977861:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789477526.977985:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d58072680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1876402802624384:0@lo:400:kworker.0 00000100:00100000:3.0:1789477526.978002:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d58073480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:730ef4b7-dbd8-4cb5-9f31-5e7e04ae8864:3312:1876402802624256:0@lo:400:kworker.0 00010000:00080000:3.0:1789477526.978024:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d0d7bddce00 x1876402802624896/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789477542 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789477526.978038:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d7bddce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3312:1876402802624896:0@lo:400:kworker.0 00000100:00100000:3.0:1789477526.978101:0:15039:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802625152 00000100:00100000:3.0:1789477526.978110:0:15039:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802625152 00000100:00100000:3.0:1789477526.978201:0:15039:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1789477526.978213:0:15039:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d7523f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:14375:x1876402802625152:12345-0@lo:5:osp-pre-1-0.0 00000100:00100000:1.0:1789477526.979153:0:15042:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802625024 00000100:00100000:1.0:1789477526.979167:0:15042:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802625024 00000100:00100000:1.0:1789477526.979230:0:15042:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789477526.979241:0:15042:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d7bddca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3313:x1876402802625024:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789477526.979280:0:15042:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789477526.979369:0:15042:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d7bddca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3313:x1876402802625024:12345-0@lo:13:osp-pre-1-0.0 Request processed in 130us (1507us total) trans 0 rc 0/0 00000100:00100000:1.0:1789477526.979377:0:15042:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:1.0:1789477526.979458:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d0d7523d880 x1876402802625024/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789477542 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789477526.979482:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d7523d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1876402802625024:0@lo:13:osp-pre-1-0.0 00000100:00080000:1.0:1789477526.986665:0:14346:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00002000:00080000:3.0:1789477526.997399:0:15039:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x280000400 00002000:00080000:3.0:1789477526.997417:0:15039:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -27 00002000:02000040:3.0:1789477526.997424:0:15039:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000400:7 to 0x280000400:33) 00002000:00010000:3.0:1789477527.017264:0:15039:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789477527.017281:0:15039:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dc728632/0xafddb3c8f928297b lrc: 3/0,1 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477527.017300:0:15039:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x21:0x0].0x0 since=472s v=(0 0) 00010000:00010000:3.0:1789477527.017313:0:15039:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789477527.017321:0:15039:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000dc728632/0xafddb3c8f928297b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477527.017344:0:15039:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000dc728632/0xafddb3c8f928297b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477527.017357:0:15039:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dc728632/0xafddb3c8f928297b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477527.017365:0:15039:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000dc728632/0xafddb3c8f928297b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477527.018245:0:15039:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789477527.018272:0:14338:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789477527.018289:0:14338:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000dc728632/0xafddb3c8f928297b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477527.018305:0:14338:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d0d49ecaa00 already unused, calling callback (ffffffffc15972a0) 00010000:00010000:2.0:1789477527.018312:0:14338:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000dc728632/0xafddb3c8f928297b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477527.018325:0:14338:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000dc728632/0xafddb3c8f928297b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477527.018358:0:14338:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000dc728632/0xafddb3c8f928297b lrc: 1/0,0 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477527.018368:0:14338:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000dc728632/0xafddb3c8f928297b lrc: 0/0,0 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477527.018406:0:14338:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789477527.018408:0:14338:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789477527.018410:0:14338:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789477527.020383:0:15039:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789477527.020397:0:15039:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008e88987e/0xafddb3c8f9282982 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477527.020431:0:15039:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x20:0x0].0x0 since=472s v=(0 0) 00010000:00010000:3.0:1789477527.020438:0:15039:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789477527.020445:0:15039:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008e88987e/0xafddb3c8f9282982 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477527.020462:0:15039:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008e88987e/0xafddb3c8f9282982 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477527.020483:0:15039:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008e88987e/0xafddb3c8f9282982 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477527.020502:0:15039:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008e88987e/0xafddb3c8f9282982 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477527.020534:0:15039:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789477527.020686:0:14339:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789477527.020701:0:14339:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008e88987e/0xafddb3c8f9282982 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477527.020731:0:14339:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d0d49ecb600 already unused, calling callback (ffffffffc15972a0) 00010000:00010000:2.0:1789477527.020737:0:14339:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008e88987e/0xafddb3c8f9282982 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477527.020749:0:14339:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008e88987e/0xafddb3c8f9282982 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477527.020771:0:14339:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008e88987e/0xafddb3c8f9282982 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477527.020780:0:14339:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008e88987e/0xafddb3c8f9282982 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477527.022734:0:14339:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789477527.022744:0:14339:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789477527.022747:0:14339:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789477527.024394:0:15039:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789477527.024412:0:15039:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000779be659/0xafddb3c8f9282989 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477527.024430:0:15039:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1f:0x0].0x0 since=472s v=(0 0) 00010000:00010000:3.0:1789477527.024435:0:15039:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789477527.024442:0:15039:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000779be659/0xafddb3c8f9282989 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477527.024456:0:15039:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000779be659/0xafddb3c8f9282989 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477527.024467:0:15039:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000779be659/0xafddb3c8f9282989 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477527.024482:0:15039:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000779be659/0xafddb3c8f9282989 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477527.024507:0:15039:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789477527.024692:0:14338:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789477527.024707:0:14338:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000779be659/0xafddb3c8f9282989 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477527.024723:0:14338:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d0d49eca800 already unused, calling callback (ffffffffc15972a0) 00010000:00010000:2.0:1789477527.024730:0:14338:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000779be659/0xafddb3c8f9282989 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477527.024744:0:14338:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000779be659/0xafddb3c8f9282989 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477527.024783:0:14338:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000779be659/0xafddb3c8f9282989 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477527.024793:0:14338:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000779be659/0xafddb3c8f9282989 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477527.025060:0:14338:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789477527.025064:0:14338:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789477527.025066:0:14338:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789477527.025408:0:15039:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789477527.025418:0:15039:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002a5c7c2f/0xafddb3c8f9282990 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477527.025438:0:15039:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1e:0x0].0x0 since=472s v=(0 0) 00010000:00010000:3.0:1789477527.025443:0:15039:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789477527.025449:0:15039:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002a5c7c2f/0xafddb3c8f9282990 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477527.025462:0:15039:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002a5c7c2f/0xafddb3c8f9282990 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477527.025479:0:15039:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002a5c7c2f/0xafddb3c8f9282990 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477527.025487:0:15039:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002a5c7c2f/0xafddb3c8f9282990 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477527.025510:0:15039:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789477527.025549:0:14339:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789477527.025558:0:14339:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002a5c7c2f/0xafddb3c8f9282990 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477527.025569:0:14339:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d0d49ecb800 already unused, calling callback (ffffffffc15972a0) 00010000:00010000:2.0:1789477527.025573:0:14339:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002a5c7c2f/0xafddb3c8f9282990 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477527.025676:0:14339:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002a5c7c2f/0xafddb3c8f9282990 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477527.025692:0:14339:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002a5c7c2f/0xafddb3c8f9282990 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477527.025699:0:14339:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002a5c7c2f/0xafddb3c8f9282990 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477527.025733:0:14339:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789477527.025735:0:14339:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789477527.025737:0:14339:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789477527.026744:0:15039:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789477527.026754:0:15039:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fb3ea16d/0xafddb3c8f9282997 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477527.026768:0:15039:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1d:0x0].0x0 since=472s v=(0 0) 00010000:00010000:3.0:1789477527.026771:0:15039:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789477527.026777:0:15039:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fb3ea16d/0xafddb3c8f9282997 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477527.026791:0:15039:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fb3ea16d/0xafddb3c8f9282997 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477527.026812:0:15039:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fb3ea16d/0xafddb3c8f9282997 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477527.026819:0:15039:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000fb3ea16d/0xafddb3c8f9282997 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477527.026838:0:15039:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789477527.027741:0:14338:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789477527.027757:0:14338:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000fb3ea16d/0xafddb3c8f9282997 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477527.027773:0:14338:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d0d49eca400 already unused, calling callback (ffffffffc15972a0) 00010000:00010000:2.0:1789477527.027779:0:14338:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000fb3ea16d/0xafddb3c8f9282997 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477527.027792:0:14338:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000fb3ea16d/0xafddb3c8f9282997 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477527.027926:0:14338:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000fb3ea16d/0xafddb3c8f9282997 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477527.027937:0:14338:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fb3ea16d/0xafddb3c8f9282997 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789477527.028067:0:15039:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789477527.028077:0:15039:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000078a540b8/0xafddb3c8f928299e lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477527.028100:0:15039:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1c:0x0].0x0 since=472s v=(0 0) 00010000:00010000:3.0:1789477527.028105:0:15039:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789477527.028110:0:15039:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000078a540b8/0xafddb3c8f928299e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477527.028123:0:15039:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000078a540b8/0xafddb3c8f928299e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477527.028133:0:15039:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000078a540b8/0xafddb3c8f928299e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477527.028141:0:15039:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000078a540b8/0xafddb3c8f928299e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477527.028175:0:15039:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789477527.028192:0:14339:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789477527.028932:0:14338:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789477527.028938:0:14338:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789477527.028940:0:14338:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789477527.029107:0:15039:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789477527.029118:0:15039:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000036f62c55/0xafddb3c8f92829a5 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477527.029129:0:15039:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1b:0x0].0x0 since=472s v=(0 0) 00010000:00010000:3.0:1789477527.029133:0:15039:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789477527.029137:0:15039:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000036f62c55/0xafddb3c8f92829a5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477527.029149:0:15039:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000036f62c55/0xafddb3c8f92829a5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477527.029157:0:15039:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000036f62c55/0xafddb3c8f92829a5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477527.029166:0:15039:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000036f62c55/0xafddb3c8f92829a5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477527.029187:0:15039:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1789477527.029836:0:15039:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789477527.029845:0:15039:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b856517b/0xafddb3c8f92829ac lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477527.029855:0:15039:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1a:0x0].0x0 since=472s v=(0 0) 00010000:00010000:3.0:1789477527.029865:0:15039:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789477527.029870:0:15039:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b856517b/0xafddb3c8f92829ac lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477527.029882:0:15039:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b856517b/0xafddb3c8f92829ac lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477527.029892:0:15039:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b856517b/0xafddb3c8f92829ac lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477527.029899:0:15039:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b856517b/0xafddb3c8f92829ac lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477527.029908:0:15039:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:3.0:1789477527.030913:0:15039:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789477527.030923:0:15039:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d4fea287/0xafddb3c8f92829b3 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477527.030935:0:15039:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x19:0x0].0x0 since=472s v=(0 0) 00010000:00010000:3.0:1789477527.030939:0:15039:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789477527.030945:0:15039:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d4fea287/0xafddb3c8f92829b3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477527.031022:0:15039:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d4fea287/0xafddb3c8f92829b3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477527.031033:0:15039:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d4fea287/0xafddb3c8f92829b3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477527.031049:0:15039:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d4fea287/0xafddb3c8f92829b3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477527.031058:0:15039:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:2.0:1789477527.032736:0:14338:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00002000:00010000:3.0:1789477527.032743:0:15039:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789477527.032762:0:14338:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000036f62c55/0xafddb3c8f92829a5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477527.032763:0:15039:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000088c82219/0xafddb3c8f92829ba lrc: 3/0,1 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477527.032819:0:15039:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18:0x0].0x0 since=472s v=(0 0) 00010000:00010000:3.0:1789477527.032846:0:15039:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789477527.032848:0:14338:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d0d49ecb200 already unused, calling callback (ffffffffc15972a0) 00010000:00010000:2.0:1789477527.032858:0:14338:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000036f62c55/0xafddb3c8f92829a5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477527.032861:0:15039:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000088c82219/0xafddb3c8f92829ba lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477527.032911:0:14338:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000036f62c55/0xafddb3c8f92829a5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477527.032915:0:15039:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000088c82219/0xafddb3c8f92829ba lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477527.032958:0:15039:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000088c82219/0xafddb3c8f92829ba lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477527.032967:0:15039:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000088c82219/0xafddb3c8f92829ba lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477527.032972:0:14338:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000036f62c55/0xafddb3c8f92829a5 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477527.032981:0:15039:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:2.0:1789477527.032984:0:14338:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000036f62c55/0xafddb3c8f92829a5 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477527.033028:0:14338:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1789477527.033033:0:14338:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b856517b/0xafddb3c8f92829ac lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477527.033039:0:14338:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d0d49eca000 already unused, calling callback (ffffffffc15972a0) 00010000:00010000:2.0:1789477527.033042:0:14338:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b856517b/0xafddb3c8f92829ac lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477527.033049:0:14338:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b856517b/0xafddb3c8f92829ac lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477527.033060:0:14338:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b856517b/0xafddb3c8f92829ac lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477527.033077:0:14338:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b856517b/0xafddb3c8f92829ac lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477527.033131:0:14338:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789477527.033135:0:14338:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d4fea287/0xafddb3c8f92829b3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477527.033143:0:14338:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d0d49ecb400 already unused, calling callback (ffffffffc15972a0) 00010000:00010000:2.0:1789477527.033147:0:14338:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d4fea287/0xafddb3c8f92829b3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477527.033156:0:14338:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d4fea287/0xafddb3c8f92829b3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477527.033167:0:14338:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d4fea287/0xafddb3c8f92829b3 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477527.033174:0:14338:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d4fea287/0xafddb3c8f92829b3 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477527.033197:0:14338:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789477527.033202:0:14338:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000088c82219/0xafddb3c8f92829ba lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477527.033208:0:14338:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d0d49ecae00 already unused, calling callback (ffffffffc15972a0) 00010000:00010000:2.0:1789477527.033222:0:14338:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000088c82219/0xafddb3c8f92829ba lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477527.033232:0:14338:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000088c82219/0xafddb3c8f92829ba lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477527.033249:0:14338:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000088c82219/0xafddb3c8f92829ba lrc: 1/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477527.033257:0:14338:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000088c82219/0xafddb3c8f92829ba lrc: 0/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477527.033287:0:14338:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789477527.033290:0:14338:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789477527.033297:0:14338:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789477527.036039:0:15039:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789477527.036057:0:15039:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000055b83ca3/0xafddb3c8f92829c1 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477527.038771:0:15039:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17:0x0].0x0 since=472s v=(0 0) 00010000:00010000:3.0:1789477527.038784:0:15039:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789477527.038795:0:15039:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000055b83ca3/0xafddb3c8f92829c1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477527.038819:0:15039:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000055b83ca3/0xafddb3c8f92829c1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477527.038831:0:15039:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000055b83ca3/0xafddb3c8f92829c1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477527.038838:0:15039:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000055b83ca3/0xafddb3c8f92829c1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477527.038868:0:15039:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1789477527.039746:0:15039:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789477527.039756:0:15039:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bb435faa/0xafddb3c8f92829c8 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477527.039767:0:15039:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x16:0x0].0x0 since=472s v=(0 0) 00010000:00010000:3.0:1789477527.039771:0:15039:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789477527.039775:0:15039:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bb435faa/0xafddb3c8f92829c8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477527.039786:0:15039:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000bb435faa/0xafddb3c8f92829c8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477527.039809:0:15039:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bb435faa/0xafddb3c8f92829c8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477527.039817:0:15039:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000bb435faa/0xafddb3c8f92829c8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477527.039826:0:15039:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:3.0:1789477527.040225:0:15039:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789477527.040232:0:15039:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000001f03059/0xafddb3c8f92829cf lrc: 3/0,1 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477527.040241:0:15039:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x15:0x0].0x0 since=472s v=(0 0) 00010000:00010000:3.0:1789477527.040245:0:15039:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789477527.040249:0:15039:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000001f03059/0xafddb3c8f92829cf lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477527.040261:0:15039:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000001f03059/0xafddb3c8f92829cf lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477527.040269:0:15039:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000001f03059/0xafddb3c8f92829cf lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477527.040277:0:15039:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000001f03059/0xafddb3c8f92829cf lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477527.040298:0:15039:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:3.0:1789477527.041860:0:15039:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789477527.041871:0:15039:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007b2736a8/0xafddb3c8f92829d6 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477527.041885:0:15039:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x14:0x0].0x0 since=472s v=(0 0) 00010000:00010000:3.0:1789477527.041889:0:15039:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789477527.041894:0:15039:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007b2736a8/0xafddb3c8f92829d6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477527.041907:0:15039:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007b2736a8/0xafddb3c8f92829d6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477527.041915:0:15039:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007b2736a8/0xafddb3c8f92829d6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477527.041923:0:15039:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007b2736a8/0xafddb3c8f92829d6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477527.041933:0:15039:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00010000:00010000:2.0:1789477527.042107:0:14338:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:2.0:1789477527.042122:0:14338:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000055b83ca3/0xafddb3c8f92829c1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477527.042138:0:14338:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d0d49ecb000 already unused, calling callback (ffffffffc15972a0) 00010000:00010000:2.0:1789477527.042143:0:14338:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000055b83ca3/0xafddb3c8f92829c1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477527.042156:0:14338:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000055b83ca3/0xafddb3c8f92829c1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477527.042182:0:14338:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000055b83ca3/0xafddb3c8f92829c1 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477527.042202:0:14338:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000055b83ca3/0xafddb3c8f92829c1 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477527.042233:0:14338:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1789477527.042238:0:14338:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000bb435faa/0xafddb3c8f92829c8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477527.042245:0:14338:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d0d41646200 already unused, calling callback (ffffffffc15972a0) 00010000:00010000:2.0:1789477527.042248:0:14338:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000bb435faa/0xafddb3c8f92829c8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477527.042257:0:14338:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000bb435faa/0xafddb3c8f92829c8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477527.042269:0:14338:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000bb435faa/0xafddb3c8f92829c8 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477527.042276:0:14338:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bb435faa/0xafddb3c8f92829c8 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477527.042297:0:14338:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789477527.042301:0:14338:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000001f03059/0xafddb3c8f92829cf lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477527.042309:0:14338:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d0d41646400 already unused, calling callback (ffffffffc15972a0) 00010000:00010000:2.0:1789477527.042321:0:14338:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000001f03059/0xafddb3c8f92829cf lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477527.042329:0:14338:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000001f03059/0xafddb3c8f92829cf lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477527.042340:0:14338:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000001f03059/0xafddb3c8f92829cf lrc: 1/0,0 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477527.042347:0:14338:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000001f03059/0xafddb3c8f92829cf lrc: 0/0,0 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477527.042361:0:14338:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789477527.042365:0:14338:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007b2736a8/0xafddb3c8f92829d6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477527.042371:0:14338:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d0d41646800 already unused, calling callback (ffffffffc15972a0) 00010000:00010000:2.0:1789477527.042374:0:14338:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007b2736a8/0xafddb3c8f92829d6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477527.042381:0:14338:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007b2736a8/0xafddb3c8f92829d6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477527.042389:0:14338:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007b2736a8/0xafddb3c8f92829d6 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477527.042396:0:14338:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007b2736a8/0xafddb3c8f92829d6 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477527.042415:0:14338:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789477527.042417:0:14338:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789477527.042419:0:14338:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789477527.046006:0:15972:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789477527.046031:0:14339:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000078a540b8/0xafddb3c8f928299e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477527.046055:0:14339:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d0d49ecac00 already unused, calling callback (ffffffffc15972a0) 00010000:00010000:2.0:1789477527.046062:0:14339:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000078a540b8/0xafddb3c8f928299e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477527.046076:0:14339:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000078a540b8/0xafddb3c8f928299e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477527.046120:0:14339:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000078a540b8/0xafddb3c8f928299e lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477527.046129:0:14339:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000078a540b8/0xafddb3c8f928299e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789477527.046149:0:15039:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789477527.046167:0:14339:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789477527.046168:0:15039:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000003ce8a7b/0xafddb3c8f92829dd lrc: 3/0,1 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477527.046172:0:14339:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789477527.046176:0:14339:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789477527.046183:0:15972:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789477527.046187:0:15972:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789477527.046191:0:15039:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x13:0x0].0x0 since=472s v=(0 0) 00010000:00010000:3.0:1789477527.046204:0:15039:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789477527.046213:0:15039:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000003ce8a7b/0xafddb3c8f92829dd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477527.046232:0:15039:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000003ce8a7b/0xafddb3c8f92829dd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477527.046244:0:15039:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000003ce8a7b/0xafddb3c8f92829dd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477527.046253:0:15039:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000003ce8a7b/0xafddb3c8f92829dd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477527.046280:0:15039:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789477527.051196:0:14338:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789477527.051232:0:14338:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000003ce8a7b/0xafddb3c8f92829dd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477527.051250:0:14338:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d0d41647400 already unused, calling callback (ffffffffc15972a0) 00010000:00010000:2.0:1789477527.051256:0:14338:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000003ce8a7b/0xafddb3c8f92829dd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477527.051269:0:14338:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000003ce8a7b/0xafddb3c8f92829dd lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477527.051301:0:14338:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000003ce8a7b/0xafddb3c8f92829dd lrc: 1/0,0 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477527.051309:0:14338:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000003ce8a7b/0xafddb3c8f92829dd lrc: 0/0,0 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477527.051502:0:14338:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789477527.051505:0:14338:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789477527.051507:0:14338:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789477527.053173:0:15039:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789477527.053186:0:15039:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005f18bb2f/0xafddb3c8f92829e4 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477527.053202:0:15039:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x12:0x0].0x0 since=472s v=(0 0) 00010000:00010000:3.0:1789477527.053207:0:15039:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789477527.053213:0:15039:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005f18bb2f/0xafddb3c8f92829e4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477527.053229:0:15039:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005f18bb2f/0xafddb3c8f92829e4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477527.053239:0:15039:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005f18bb2f/0xafddb3c8f92829e4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477527.053254:0:15039:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005f18bb2f/0xafddb3c8f92829e4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477527.053282:0:15039:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789477527.053296:0:14339:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789477527.053302:0:14339:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005f18bb2f/0xafddb3c8f92829e4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477527.053309:0:14339:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d0d41646000 already unused, calling callback (ffffffffc15972a0) 00010000:00010000:3.0:1789477527.053314:0:14339:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005f18bb2f/0xafddb3c8f92829e4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477527.053323:0:14339:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005f18bb2f/0xafddb3c8f92829e4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477527.053340:0:14339:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005f18bb2f/0xafddb3c8f92829e4 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477527.053347:0:14339:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005f18bb2f/0xafddb3c8f92829e4 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477527.053365:0:14339:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789477527.053367:0:14339:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789477527.053369:0:14339:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789477527.055675:0:15039:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789477527.055697:0:15039:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000878bb6f2/0xafddb3c8f92829eb lrc: 3/0,1 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477527.055713:0:15039:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x11:0x0].0x0 since=472s v=(0 0) 00010000:00010000:3.0:1789477527.055717:0:15039:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789477527.055724:0:15039:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000878bb6f2/0xafddb3c8f92829eb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477527.055738:0:15039:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000878bb6f2/0xafddb3c8f92829eb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477527.055748:0:15039:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000878bb6f2/0xafddb3c8f92829eb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477527.055756:0:15039:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000878bb6f2/0xafddb3c8f92829eb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477527.057008:0:15039:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789477527.057043:0:15972:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789477527.057052:0:15972:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000878bb6f2/0xafddb3c8f92829eb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477527.057066:0:15972:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d0d41647c00 already unused, calling callback (ffffffffc15972a0) 00010000:00010000:3.0:1789477527.057072:0:15972:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000878bb6f2/0xafddb3c8f92829eb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477527.057094:0:15972:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000878bb6f2/0xafddb3c8f92829eb lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477527.057126:0:15972:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000878bb6f2/0xafddb3c8f92829eb lrc: 1/0,0 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477527.057134:0:15972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000878bb6f2/0xafddb3c8f92829eb lrc: 0/0,0 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477527.057156:0:15972:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789477527.057157:0:15972:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789477527.057159:0:15972:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789477527.058220:0:15039:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789477527.058230:0:15039:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006a13f80c/0xafddb3c8f92829f2 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477527.058244:0:15039:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x10:0x0].0x0 since=472s v=(0 0) 00010000:00010000:3.0:1789477527.058249:0:15039:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789477527.058255:0:15039:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006a13f80c/0xafddb3c8f92829f2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477527.058268:0:15039:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006a13f80c/0xafddb3c8f92829f2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477527.058278:0:15039:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006a13f80c/0xafddb3c8f92829f2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477527.058286:0:15039:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006a13f80c/0xafddb3c8f92829f2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477527.058324:0:15039:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1789477527.059006:0:15039:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789477527.059013:0:15039:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004019a8a4/0xafddb3c8f92829f9 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477527.059023:0:15039:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xf:0x0].0x0 since=472s v=(0 0) 00010000:00010000:3.0:1789477527.059026:0:15039:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789477527.059031:0:15039:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004019a8a4/0xafddb3c8f92829f9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477527.059042:0:15039:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004019a8a4/0xafddb3c8f92829f9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477527.059050:0:15039:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004019a8a4/0xafddb3c8f92829f9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477527.059058:0:15039:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004019a8a4/0xafddb3c8f92829f9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477527.059088:0:15039:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1789477527.059098:0:14338:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1789477527.059105:0:14338:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006a13f80c/0xafddb3c8f92829f2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477527.059114:0:14338:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d0d41647600 already unused, calling callback (ffffffffc15972a0) 00010000:00010000:1.0:1789477527.059119:0:14338:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006a13f80c/0xafddb3c8f92829f2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477527.059128:0:14338:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006a13f80c/0xafddb3c8f92829f2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477527.059146:0:14338:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006a13f80c/0xafddb3c8f92829f2 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477527.059153:0:14338:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006a13f80c/0xafddb3c8f92829f2 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477527.059172:0:14338:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789477527.059175:0:14338:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004019a8a4/0xafddb3c8f92829f9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477527.059182:0:14338:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d0d41646c00 already unused, calling callback (ffffffffc15972a0) 00010000:00010000:1.0:1789477527.059185:0:14338:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004019a8a4/0xafddb3c8f92829f9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477527.059199:0:14338:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004019a8a4/0xafddb3c8f92829f9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477527.059210:0:14338:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004019a8a4/0xafddb3c8f92829f9 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477527.059217:0:14338:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004019a8a4/0xafddb3c8f92829f9 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477527.059231:0:14338:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789477527.059232:0:14338:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789477527.059234:0:14338:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789477527.059481:0:15039:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789477527.059487:0:15039:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b076d081/0xafddb3c8f9282a00 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477527.059495:0:15039:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xe:0x0].0x0 since=472s v=(0 0) 00010000:00010000:3.0:1789477527.059504:0:15039:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789477527.059509:0:15039:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b076d081/0xafddb3c8f9282a00 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477527.059520:0:15039:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b076d081/0xafddb3c8f9282a00 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477527.059528:0:15039:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b076d081/0xafddb3c8f9282a00 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477527.059535:0:15039:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b076d081/0xafddb3c8f9282a00 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477527.059560:0:15039:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1789477527.060186:0:15039:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789477527.060194:0:15039:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003a23395b/0xafddb3c8f9282a07 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477527.060203:0:15039:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xd:0x0].0x0 since=472s v=(0 0) 00010000:00010000:3.0:1789477527.060207:0:15039:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789477527.060212:0:15039:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003a23395b/0xafddb3c8f9282a07 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477527.060222:0:15039:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003a23395b/0xafddb3c8f9282a07 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477527.060230:0:15039:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003a23395b/0xafddb3c8f9282a07 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477527.060246:0:15039:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003a23395b/0xafddb3c8f9282a07 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477527.060260:0:15039:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:3.0:1789477527.060740:0:15039:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789477527.060747:0:15039:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005f18bb2f/0xafddb3c8f9282a0e lrc: 3/0,1 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477527.060757:0:14339:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789477527.060771:0:14339:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b076d081/0xafddb3c8f9282a00 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477527.060784:0:14339:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d0d41646e00 already unused, calling callback (ffffffffc15972a0) 00010000:00010000:2.0:1789477527.060789:0:14339:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b076d081/0xafddb3c8f9282a00 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477527.060817:0:14339:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b076d081/0xafddb3c8f9282a00 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477527.060841:0:14339:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b076d081/0xafddb3c8f9282a00 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477527.060848:0:14339:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b076d081/0xafddb3c8f9282a00 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477527.060871:0:14339:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789477527.060874:0:14339:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003a23395b/0xafddb3c8f9282a07 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477527.060880:0:14339:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d0d41647000 already unused, calling callback (ffffffffc15972a0) 00010000:00010000:2.0:1789477527.060887:0:14339:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003a23395b/0xafddb3c8f9282a07 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477527.060895:0:15039:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc:0x0].0x0 since=472s v=(0 0) 00010000:00010000:2.0:1789477527.060899:0:14339:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003a23395b/0xafddb3c8f9282a07 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477527.060902:0:15039:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789477527.060920:0:15039:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005f18bb2f/0xafddb3c8f9282a0e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477527.060927:0:14339:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003a23395b/0xafddb3c8f9282a07 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477527.060938:0:15039:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005f18bb2f/0xafddb3c8f9282a0e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477527.060941:0:14339:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003a23395b/0xafddb3c8f9282a07 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477527.060978:0:15039:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005f18bb2f/0xafddb3c8f9282a0e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477527.061021:0:15039:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005f18bb2f/0xafddb3c8f9282a0e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477527.061028:0:14339:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789477527.061032:0:14339:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789477527.061037:0:14339:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789477527.061040:0:15039:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1789477527.061041:0:14339:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005f18bb2f/0xafddb3c8f9282a0e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477527.061055:0:14339:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d0d41646000 already unused, calling callback (ffffffffc15972a0) 00010000:00010000:2.0:1789477527.061059:0:14339:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005f18bb2f/0xafddb3c8f9282a0e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477527.061068:0:14339:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005f18bb2f/0xafddb3c8f9282a0e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477527.061092:0:14339:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005f18bb2f/0xafddb3c8f9282a0e lrc: 1/0,0 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477527.061101:0:14339:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005f18bb2f/0xafddb3c8f9282a0e lrc: 0/0,0 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477527.061122:0:14339:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789477527.061124:0:14339:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789477527.061126:0:14339:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789477527.061505:0:15039:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789477527.061512:0:15039:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000025858e8c/0xafddb3c8f9282a15 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477527.061527:0:15039:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xb:0x0].0x0 since=472s v=(0 0) 00010000:00010000:3.0:1789477527.061530:0:15039:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789477527.061535:0:15039:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000025858e8c/0xafddb3c8f9282a15 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477527.061546:0:15039:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000025858e8c/0xafddb3c8f9282a15 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477527.061555:0:15039:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000025858e8c/0xafddb3c8f9282a15 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477527.061563:0:15039:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000025858e8c/0xafddb3c8f9282a15 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477527.061616:0:15039:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789477527.061754:0:14339:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789477527.061762:0:14339:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000025858e8c/0xafddb3c8f9282a15 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477527.061786:0:14339:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d0d41646a00 already unused, calling callback (ffffffffc15972a0) 00010000:00010000:2.0:1789477527.061790:0:14339:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000025858e8c/0xafddb3c8f9282a15 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477527.061810:0:14339:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000025858e8c/0xafddb3c8f9282a15 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477527.061825:0:14339:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000025858e8c/0xafddb3c8f9282a15 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477527.061833:0:14339:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000025858e8c/0xafddb3c8f9282a15 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477527.061853:0:14339:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789477527.061855:0:14339:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789477527.061857:0:14339:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789477527.062458:0:15039:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789477527.062467:0:15039:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002c59c798/0xafddb3c8f9282a1c lrc: 3/0,1 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477527.062479:0:15039:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa:0x0].0x0 since=472s v=(0 0) 00010000:00010000:3.0:1789477527.062483:0:15039:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789477527.062488:0:15039:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002c59c798/0xafddb3c8f9282a1c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477527.062500:0:15039:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002c59c798/0xafddb3c8f9282a1c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477527.062520:0:15039:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002c59c798/0xafddb3c8f9282a1c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477527.062528:0:15039:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002c59c798/0xafddb3c8f9282a1c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477527.062552:0:15039:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789477527.062691:0:14339:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789477527.062700:0:14339:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002c59c798/0xafddb3c8f9282a1c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477527.062712:0:14339:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d0d41647a00 already unused, calling callback (ffffffffc15972a0) 00010000:00010000:2.0:1789477527.062716:0:14339:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002c59c798/0xafddb3c8f9282a1c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477527.062727:0:14339:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002c59c798/0xafddb3c8f9282a1c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477527.062753:0:14339:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002c59c798/0xafddb3c8f9282a1c lrc: 1/0,0 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477527.062761:0:14339:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002c59c798/0xafddb3c8f9282a1c lrc: 0/0,0 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477527.062782:0:14339:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789477527.062784:0:14339:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789477527.062786:0:14339:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789477527.063253:0:15039:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789477527.063261:0:15039:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006c968605/0xafddb3c8f9282a23 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477527.063272:0:15039:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x9:0x0].0x0 since=472s v=(0 0) 00010000:00010000:3.0:1789477527.063276:0:15039:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789477527.063280:0:15039:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006c968605/0xafddb3c8f9282a23 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477527.063291:0:15039:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006c968605/0xafddb3c8f9282a23 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477527.063299:0:15039:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006c968605/0xafddb3c8f9282a23 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477527.063307:0:15039:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006c968605/0xafddb3c8f9282a23 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477527.063335:0:15039:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1789477527.063903:0:15039:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789477527.063910:0:15039:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000003ce8a7b/0xafddb3c8f9282a2a lrc: 3/0,1 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477527.063920:0:15039:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x8:0x0].0x0 since=472s v=(0 0) 00010000:00010000:3.0:1789477527.063923:0:15039:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789477527.063928:0:15039:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000003ce8a7b/0xafddb3c8f9282a2a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477527.063938:0:15039:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000003ce8a7b/0xafddb3c8f9282a2a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477527.063947:0:15039:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000003ce8a7b/0xafddb3c8f9282a2a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477527.063954:0:15039:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000003ce8a7b/0xafddb3c8f9282a2a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477527.063961:0:15039:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1789477527.064330:0:14338:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1789477527.064338:0:14338:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006c968605/0xafddb3c8f9282a23 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477527.064346:0:14338:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d0d41647800 already unused, calling callback (ffffffffc15972a0) 00002000:00010000:3.0:1789477527.064350:0:15039:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789477527.064351:0:14338:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006c968605/0xafddb3c8f9282a23 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477527.064355:0:15039:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007b2736a8/0xafddb3c8f9282a31 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477527.064361:0:14338:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006c968605/0xafddb3c8f9282a23 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477527.064363:0:15039:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7:0x0].0x0 since=472s v=(0 0) 00010000:00010000:3.0:1789477527.064370:0:15039:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789477527.064374:0:15039:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007b2736a8/0xafddb3c8f9282a31 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477527.064378:0:14338:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006c968605/0xafddb3c8f9282a23 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477527.064384:0:15039:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007b2736a8/0xafddb3c8f9282a31 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477527.064393:0:15039:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007b2736a8/0xafddb3c8f9282a31 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477527.064395:0:14338:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006c968605/0xafddb3c8f9282a23 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477527.064400:0:15039:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007b2736a8/0xafddb3c8f9282a31 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477527.064407:0:15039:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1789477527.064417:0:14338:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1789477527.064421:0:14338:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000003ce8a7b/0xafddb3c8f9282a2a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477527.064427:0:14338:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d0d41647400 already unused, calling callback (ffffffffc15972a0) 00010000:00010000:1.0:1789477527.064430:0:14338:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000003ce8a7b/0xafddb3c8f9282a2a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477527.064437:0:14338:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000003ce8a7b/0xafddb3c8f9282a2a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477527.064448:0:14338:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000003ce8a7b/0xafddb3c8f9282a2a lrc: 1/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477527.064455:0:14338:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000003ce8a7b/0xafddb3c8f9282a2a lrc: 0/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477527.064478:0:14338:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789477527.064482:0:14338:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007b2736a8/0xafddb3c8f9282a31 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477527.064489:0:14338:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d0d41646800 already unused, calling callback (ffffffffc15972a0) 00010000:00010000:1.0:1789477527.064498:0:14338:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007b2736a8/0xafddb3c8f9282a31 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477527.064506:0:14338:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007b2736a8/0xafddb3c8f9282a31 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477527.064517:0:14338:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007b2736a8/0xafddb3c8f9282a31 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477527.064524:0:14338:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007b2736a8/0xafddb3c8f9282a31 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477527.064537:0:14338:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789477527.064539:0:14338:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789477527.064541:0:14338:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789477527.064548:0:15972:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:3.0:1789477527.064567:0:15039:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x280000400:6 00000100:00100000:3.0:1789477527.064699:0:15039:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d7523f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:14375:x1876402802625152:12345-0@lo:5:osp-pre-1-0.0 Request processed in 86484us (94653us total) trans 0 rc 0/0 00000100:00100000:3.0:1789477527.064710:0:15039:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1789477527.064792:0:14375:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d7523df80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14375:1876402802625152:0@lo:5:osp-pre-1-0.0 00000004:00080000:2.0:1789477527.064837:0:14375:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x280000400:0x21:0x0] from OST, last_created [0x280000400:0x21:0x0]last_used is [0x280000400:0x6:0x0] 00000100:00100000:2.0:1789477527.064910:0:14375:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d7523df80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14375:1876402802625280:0@lo:5:osp-pre-1-0.0 00000100:00100000:2.0:1789477527.064971:0:14375:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789477527.065027:0:15037:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802625280 00000100:00100000:2.0:1789477527.065037:0:14375:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d0d50800180 going to sleep for 11 seconds 00000100:00100000:3.0:1789477527.065039:0:15037:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802625280 00010000:00010000:2.0:1789477527.065069:0:14339:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789477527.065120:0:15037:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1789477527.065132:0:15037:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d7523c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:14375:x1876402802625280:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:3.0:1789477527.065176:0:15037:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x280000400 at 34 00000100:00100000:3.0:1789477527.070532:0:15037:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d7523c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:14375:x1876402802625280:12345-0@lo:5:osp-pre-1-0.0 Request processed in 5394us (5553us total) trans 8589934593 rc 0/0 00000100:00100000:3.0:1789477527.070546:0:15037:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1789477527.074927:0:14375:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d7523df80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14375:1876402802625280:0@lo:5:osp-pre-1-0.0 00000004:00080000:2.0:1789477527.074956:0:14375:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x280000400:0x21:0x0]-[0x280000400:0x41:0x0] 00000004:00080000:1.0:1789477527.083339:0:5868:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00010000:00010000:2.0:1789477527.343990:0:14338:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1789477527.625617:0:7678:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934593 is committed 00000001:00100000:0.0:1789477527.625734:0:7678:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00010000:00010000:3.0:1789477528.368680:0:15972:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789477529.395085:0:14339:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1789477530.030504:0:16112:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg123-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:0.0:1789477530.418032:0:14338:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789477530.545149:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789477530.545183:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d7bddce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1876402802625408:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789477530.545293:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789477530.547065:0:15042:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802625408 00000100:00100000:3.0:1789477530.547085:0:15042:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802625408 00000100:00100000:3.0:1789477530.547217:0:15042:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1789477530.547233:0:15042:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d7f703480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1876402802625408:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789477530.547292:0:15042:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789477530.547622:0:15042:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d7f703480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1876402802625408:12345-0@lo:13:osp-pre-0-0.0 Request processed in 394us (2327us total) trans 0 rc 0/0 00000100:00100000:3.0:1789477530.547631:0:15042:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1789477530.547763:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d7bddce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1876402802625408:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1789477530.549472:0:14346:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1789477531.443783:0:15972:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1789477531.899031:0:14385:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1789477532.080109:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d6d480e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1876402802625536:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789477532.080225:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789477532.080284:0:15041:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802625536 00000100:00100000:2.0:1789477532.080296:0:15041:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802625536 00000100:00080000:1.0:1789477532.080343:0:14346:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789477532.080425:0:15041:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1789477532.080441:0:15041:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d7f701f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1876402802625536:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789477532.080509:0:15041:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789477532.080632:0:15041:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d7f701f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1876402802625536:12345-0@lo:13:osp-pre-1-0.0 Request processed in 195us (406us total) trans 0 rc 0/0 00000100:00100000:2.0:1789477532.080640:0:15041:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1789477532.080725:0:3311:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934593 gen 2 00000100:00100000:1.0:1789477532.080766:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d6d480e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1876402802625536:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789477532.092039:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d6d482680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:730ef4b7-dbd8-4cb5-9f31-5e7e04ae8864:3312:1876402802625664:0@lo:400:kworker.0 00000100:00100000:0.0:1789477532.092040:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d6d480e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1876402802625792:0@lo:400:kworker.0 00000100:00100000:1.0:1789477532.100675:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d6d483b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3310:1876402802625920:0@lo:400:kworker.0 00000100:00100000:3.0:1789477532.101759:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789477532.101836:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d6d480700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3312:1876402802626176:0@lo:400:kworker.0 00000100:00100000:3.0:1789477532.101872:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789477532.101904:0:14350:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802626176 00000100:00100000:3.0:1789477532.101913:0:14350:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802626176 00000100:00100000:3.0:1789477532.101977:0:14350:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1789477532.102002:0:14350:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d7bddc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1876402802626176:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789477532.102060:0:14350:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d7bddc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1876402802626176:12345-0@lo:400:kworker.0 Request processed in 74us (187us total) trans 0 rc 0/0 00000100:00100000:3.0:1789477532.102068:0:14350:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00080000:3.0:1789477532.102114:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d0d6d480700 x1876402802626176/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789477548 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789477532.102129:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d6d480700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3312:1876402802626176:0@lo:400:kworker.0 00000100:00100000:2.0:1789477532.103655:0:14344:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802625664 00000100:00100000:2.0:1789477532.103671:0:14344:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802625664 00000100:00100000:2.0:1789477532.103742:0:14344:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1789477532.103843:0:14344:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d7db7e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:730ef4b7-dbd8-4cb5-9f31-5e7e04ae8864+19:3312:x1876402802625664:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789477532.103945:0:14344:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d7db7e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:730ef4b7-dbd8-4cb5-9f31-5e7e04ae8864+19:3312:x1876402802625664:12345-0@lo:400:kworker.0 Request processed in 105us (2201us total) trans 0 rc 0/0 00000100:00100000:2.0:1789477532.103952:0:14344:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1789477532.104043:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d6d482a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3311:1876402802626048:0@lo:400:kworker.0 00000100:00100000:2.0:1789477532.104082:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789477532.104307:0:14351:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802626048 00000100:00100000:3.0:1789477532.104313:0:14351:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802626048 00000100:00100000:0.0:1789477532.104355:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789477532.104370:0:14351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1789477532.104379:0:14351:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d7523f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1876402802626048:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789477532.104683:0:14351:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d7523f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1876402802626048:12345-0@lo:400:kworker.0 Request processed in 304us (598us total) trans 0 rc 0/0 00000100:00100000:3.0:1789477532.104691:0:14351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1789477532.104934:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d6d482680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:730ef4b7-dbd8-4cb5-9f31-5e7e04ae8864:3312:1876402802625664:0@lo:400:kworker.0 00000100:00100000:1.0:1789477532.106159:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1789477532.106229:0:14346:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789477532.106252:0:15038:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802625792 00000100:00100000:1.0:1789477532.106262:0:15038:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802625792 00000100:00100000:1.0:1789477532.106335:0:15038:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789477532.106347:0:15038:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d6d483800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3313:x1876402802625792:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789477532.106419:0:15038:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d6d483800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3313:x1876402802625792:12345-0@lo:400:kworker.0 Request processed in 76us (2065us total) trans 0 rc 0/0 00000100:00100000:1.0:1789477532.106427:0:15038:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:1.0:1789477532.106446:0:14346:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789477532.106482:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d6d480e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1876402802625792:0@lo:400:kworker.0 00000100:00100000:2.0:1789477532.106661:0:14352:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802625920 00000100:00100000:2.0:1789477532.106667:0:14352:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802625920 00000100:00100000:2.0:1789477532.106702:0:14352:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1789477532.106710:0:14352:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d7f701500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1876402802625920:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789477532.106753:0:14352:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d7f701500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1876402802625920:12345-0@lo:400:kworker.0 Request processed in 44us (600us total) trans 0 rc 0/0 00000100:00100000:2.0:1789477532.106760:0:14352:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00010000:00080000:1.0:1789477532.106856:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d0d6d483b80 x1876402802625920/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789477548 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789477532.106869:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d6d483b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3310:1876402802625920:0@lo:400:kworker.0 00010000:00080000:0.0:1789477532.109120:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d0d6d482a00 x1876402802626048/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789477548 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789477532.109219:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d6d482a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3311:1876402802626048:0@lo:400:kworker.0 00010000:00010000:2.0:1789477532.471038:0:14339:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789477532.472283:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:3.0:1789477532.472392:0:14345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783756288 00000100:00100000:3.0:1789477532.472407:0:14345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783756288 00000100:00100000:3.0:1789477532.472523:0:14345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 77 00000100:00100000:3.0:1789477532.472534:0:14345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d7db7e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0+-99:2351:x1876402783756288:12345-192.168.201.23@tcp:250:mount.lustre.0 00010000:00080000:3.0:1789477532.472605:0:14345:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from 41935ab2-fae2-41da-aaaf-b7b0ee59bf6c@192.168.201.23@tcp t0 exp 0000000000000000 cur 477 last 0 00000020:00000080:3.0:1789477532.472656:0:14345:0:(genops.c:1385:class_connect()) connect: client 41935ab2-fae2-41da-aaaf-b7b0ee59bf6c, cookie 0xafddb3c8f9282a38 00000100:00080000:3.0:1789477532.472839:0:14345:0:(import.c:65:import_set_state_nolock()) ffff9d0d6ecf7000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789477532.472929:0:14345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d7db7e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:41935ab2-fae2-41da-aaaf-b7b0ee59bf6c+5:2351:x1876402783756288:12345-192.168.201.23@tcp:250:mount.lustre.0 Request processed in 395us (655us total) trans 0 rc 0/0 00000100:00100000:3.0:1789477532.472938:0:14345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 77 00000100:00100000:2.0:1789477532.482857:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:3.0:1789477532.484088:0:14343:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783756416 00000100:00100000:3.0:1789477532.484109:0:14343:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783756416 00000100:00100000:3.0:1789477532.484197:0:14343:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 78 00000100:00100000:3.0:1789477532.484210:0:14343:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d7db7d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:41935ab2-fae2-41da-aaaf-b7b0ee59bf6c+5:13738:x1876402783756416:12345-192.168.201.23@tcp:101:mount.lustre.0 00010000:00010000:3.0:1789477532.484235:0:14343:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789477532.484260:0:14343:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d0d41646400/0xafddb3c8f9282a3f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0xa90d500d7b8f2e6a expref: -99 pid: 14343 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477532.484298:0:14343:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d0d41646400/0xafddb3c8f9282a3f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2e6a expref: 6 pid: 14343 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477532.484334:0:14343:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d0d41646400/0xafddb3c8f9282a3f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2e6a expref: 6 pid: 14343 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477532.484345:0:14343:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d0d41646400, rc 0) 00000100:00100000:3.0:1789477532.484439:0:14343:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d7db7d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:41935ab2-fae2-41da-aaaf-b7b0ee59bf6c+6:13738:x1876402783756416:12345-192.168.201.23@tcp:101:mount.lustre.0 Request processed in 232us (1597us total) trans 0 rc 0/0 00000100:00100000:3.0:1789477532.484447:0:14343:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 78 00000100:00100000:0.0:1789477532.495518:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:3.0:1789477532.495750:0:14345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783756544 00000100:00100000:3.0:1789477532.495764:0:14345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783756544 00000100:00100000:3.0:1789477532.495844:0:14345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 79 00000100:00100000:3.0:1789477532.495856:0:14345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d7db7d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:41935ab2-fae2-41da-aaaf-b7b0ee59bf6c+6:13738:x1876402783756544:12345-192.168.201.23@tcp:501:mount.lustre.0 00000100:00100000:3.0:1789477532.497297:0:14345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d7db7d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:41935ab2-fae2-41da-aaaf-b7b0ee59bf6c+6:13738:x1876402783756544:12345-192.168.201.23@tcp:501:mount.lustre.0 Request processed in 1431us (1783us total) trans 0 rc -2/-2 00000100:00100000:3.0:1789477532.497320:0:14345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 79 00000100:00100000:1.0:1789477532.508151:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:2.0:1789477532.515816:0:14344:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783756672 00000100:00100000:2.0:1789477532.515841:0:14344:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783756672 00000100:00100000:2.0:1789477532.515930:0:14344:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 80 00000100:00100000:2.0:1789477532.515944:0:14344:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d7db7c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:41935ab2-fae2-41da-aaaf-b7b0ee59bf6c+6:13738:x1876402783756672:12345-192.168.201.23@tcp:101:mount.lustre.0 00010000:00010000:2.0:1789477532.516001:0:14344:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789477532.516028:0:14344:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d0d50416600/0xafddb3c8f9282a46 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xa90d500d7b8f2e71 expref: -99 pid: 14344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477532.516067:0:14344:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d0d50416600/0xafddb3c8f9282a46 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2e71 expref: 7 pid: 14344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477532.516079:0:14344:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d0d50416600/0xafddb3c8f9282a46 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2e71 expref: 7 pid: 14344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477532.516090:0:14344:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d0d50416600, rc 0) 00000100:00100000:2.0:1789477532.516188:0:14344:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d7db7c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:41935ab2-fae2-41da-aaaf-b7b0ee59bf6c+7:13738:x1876402783756672:12345-192.168.201.23@tcp:101:mount.lustre.0 Request processed in 246us (8053us total) trans 0 rc 0/0 00000100:00100000:2.0:1789477532.516196:0:14344:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 80 00000100:00100000:2.0:1789477532.523148:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:3.0:1789477532.523350:0:14345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783756800 00000100:00100000:3.0:1789477532.523364:0:14345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783756800 00000100:00100000:3.0:1789477532.523435:0:14345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 81 00000100:00100000:3.0:1789477532.523448:0:14345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d7db7e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:41935ab2-fae2-41da-aaaf-b7b0ee59bf6c+7:13738:x1876402783756800:12345-192.168.201.23@tcp:501:mount.lustre.0 00000100:00100000:3.0:1789477532.524103:0:14345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d7db7e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:41935ab2-fae2-41da-aaaf-b7b0ee59bf6c+8:13738:x1876402783756800:12345-192.168.201.23@tcp:501:mount.lustre.0 Request processed in 655us (976us total) trans 0 rc 0/0 00000100:00100000:3.0:1789477532.524113:0:14345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 81 00000100:00100000:0.0:1789477532.529117:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:2.0:1789477532.529239:0:14344:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783756928 00000100:00100000:2.0:1789477532.529252:0:14344:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783756928 00000100:00100000:2.0:1789477532.529324:0:14344:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 82 00000100:00100000:2.0:1789477532.529337:0:14344:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d7db7dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:41935ab2-fae2-41da-aaaf-b7b0ee59bf6c+8:13738:x1876402783756928:12345-192.168.201.23@tcp:503:mount.lustre.0 00000100:00100000:2.0:1789477532.529773:0:14344:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d7db7dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:41935ab2-fae2-41da-aaaf-b7b0ee59bf6c+8:13738:x1876402783756928:12345-192.168.201.23@tcp:503:mount.lustre.0 Request processed in 437us (670us total) trans 0 rc 0/0 00000100:00100000:2.0:1789477532.529782:0:14344:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 82 00000100:00100000:1.0:1789477532.532769:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:0.0:1789477532.533092:0:14343:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783757056 00000100:00100000:0.0:1789477532.533107:0:14343:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783757056 00000100:00100000:0.0:1789477532.533179:0:14343:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 83 00000100:00100000:0.0:1789477532.533192:0:14343:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d7db7d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:41935ab2-fae2-41da-aaaf-b7b0ee59bf6c+8:13757:x1876402783757056:12345-192.168.201.23@tcp:502:llog_process_th.0 00000100:00100000:0.0:1789477532.533682:0:14343:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d7db7d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:41935ab2-fae2-41da-aaaf-b7b0ee59bf6c+8:13757:x1876402783757056:12345-192.168.201.23@tcp:502:llog_process_th.0 Request processed in 491us (926us total) trans 0 rc 0/0 00000100:00100000:0.0:1789477532.533693:0:14343:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 83 00000100:00100000:0.0:1789477532.556971:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:3.0:1789477532.557085:0:14345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783757184 00000100:00100000:3.0:1789477532.557101:0:14345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783757184 00000100:00100000:3.0:1789477532.557176:0:14345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 84 00000100:00100000:3.0:1789477532.557189:0:14345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d7db7f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:41935ab2-fae2-41da-aaaf-b7b0ee59bf6c+8:13757:x1876402783757184:12345-192.168.201.23@tcp:502:llog_process_th.0 00000100:00100000:3.0:1789477532.557609:0:14345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d7db7f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:41935ab2-fae2-41da-aaaf-b7b0ee59bf6c+8:13757:x1876402783757184:12345-192.168.201.23@tcp:502:llog_process_th.0 Request processed in 419us (649us total) trans 0 rc 0/0 00000100:00100000:3.0:1789477532.557619:0:14345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 84 00000100:00100000:1.0:1789477532.569111:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:2.0:1789477532.569435:0:14344:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783757312 00000100:00100000:2.0:1789477532.569448:0:14344:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783757312 00000100:00100000:2.0:1789477532.569529:0:14344:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 85 00000100:00100000:2.0:1789477532.569542:0:14344:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d7db7f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:41935ab2-fae2-41da-aaaf-b7b0ee59bf6c+8:13738:x1876402783757312:12345-192.168.201.23@tcp:101:mount.lustre.0 00010000:00010000:2.0:1789477532.569565:0:14344:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789477532.569654:0:14344:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d0d50416400/0xafddb3c8f9282a4d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xa90d500d7b8f2e9b expref: -99 pid: 14344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477532.569691:0:14344:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d0d50416400/0xafddb3c8f9282a4d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2e9b expref: 9 pid: 14344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477532.569705:0:14344:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d0d50416400/0xafddb3c8f9282a4d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2e9b expref: 9 pid: 14344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477532.569716:0:14344:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d0d50416400, rc 0) 00000100:00100000:2.0:1789477532.569786:0:14344:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d7db7f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:41935ab2-fae2-41da-aaaf-b7b0ee59bf6c+9:13738:x1876402783757312:12345-192.168.201.23@tcp:101:mount.lustre.0 Request processed in 246us (692us total) trans 0 rc 0/0 00000100:00100000:2.0:1789477532.569794:0:14344:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 85 00000100:00100000:1.0:1789477532.577012:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:0.0:1789477532.577696:0:14343:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783757440 00000100:00100000:0.0:1789477532.577712:0:14343:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783757440 00000100:00100000:1.0:1789477532.577912:0:14343:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 86 00000100:00100000:1.0:1789477532.577925:0:14343:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d6cd23450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:41935ab2-fae2-41da-aaaf-b7b0ee59bf6c+9:13738:x1876402783757440:12345-192.168.201.23@tcp:256:mount.lustre.0 20000000:01000000:1.0:1789477532.577960:0:14343:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:1.0:1789477532.578001:0:14343:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:1.0:1789477532.578006:0:14343:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:1.0:1789477532.578016:0:14343:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:1.0:1789477532.578019:0:14343:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 8 00000100:00100000:1.0:1789477532.582376:0:14343:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d6cd23450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:41935ab2-fae2-41da-aaaf-b7b0ee59bf6c+9:13738:x1876402783757440:12345-192.168.201.23@tcp:256:mount.lustre.0 Request processed in 4435us (5360us total) trans 0 rc 0/0 00000100:00100000:1.0:1789477532.582396:0:14343:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 86 00000100:00100000:0.0:1789477532.587039:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:3.0:1789477532.587151:0:14345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783757568 00000100:00100000:3.0:1789477532.587166:0:14345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783757568 00000100:00100000:3.0:1789477532.587239:0:14345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 87 00000100:00100000:3.0:1789477532.587253:0:14345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d7b09b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:41935ab2-fae2-41da-aaaf-b7b0ee59bf6c+9:13738:x1876402783757568:12345-192.168.201.23@tcp:101:mount.lustre.0 00010000:00010000:3.0:1789477532.587275:0:14345:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789477532.587457:0:14345:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d0d41647c00/0xafddb3c8f9282a54 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xa90d500d7b8f2ea2 expref: -99 pid: 14345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477532.587508:0:14345:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d0d41647c00/0xafddb3c8f9282a54 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2ea2 expref: 10 pid: 14345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477532.587522:0:14345:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d0d41647c00/0xafddb3c8f9282a54 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2ea2 expref: 10 pid: 14345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477532.587533:0:14345:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d0d41647c00, rc 0) 00000100:00100000:3.0:1789477532.587744:0:14345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d7b09b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:41935ab2-fae2-41da-aaaf-b7b0ee59bf6c+10:13738:x1876402783757568:12345-192.168.201.23@tcp:101:mount.lustre.0 Request processed in 492us (719us total) trans 0 rc 0/0 00000100:00100000:3.0:1789477532.587753:0:14345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 87 00000100:00100000:2.0:1789477532.596833:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:1.0:1789477532.597010:0:14343:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783757696 00000100:00100000:1.0:1789477532.597025:0:14343:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783757696 00000100:00100000:1.0:1789477532.597102:0:14343:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 88 00000100:00100000:1.0:1789477532.597116:0:14343:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d7b09a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:41935ab2-fae2-41da-aaaf-b7b0ee59bf6c+10:13738:x1876402783757696:12345-192.168.201.23@tcp:501:mount.lustre.0 00000100:00100000:1.0:1789477532.597847:0:14343:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d7b09a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:41935ab2-fae2-41da-aaaf-b7b0ee59bf6c+10:13738:x1876402783757696:12345-192.168.201.23@tcp:501:mount.lustre.0 Request processed in 731us (1028us total) trans 0 rc 0/0 00000100:00100000:1.0:1789477532.597856:0:14343:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 88 00000100:00100000:0.0:1789477532.614628:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:3.0:1789477532.615026:0:14345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783757824 00000100:00100000:3.0:1789477532.615041:0:14345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783757824 00000100:00100000:3.0:1789477532.615129:0:14345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 89 00000100:00100000:3.0:1789477532.615143:0:14345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d7b098c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:41935ab2-fae2-41da-aaaf-b7b0ee59bf6c+10:13738:x1876402783757824:12345-192.168.201.23@tcp:503:mount.lustre.0 00000100:00100000:3.0:1789477532.615882:0:14345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d7b098c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:41935ab2-fae2-41da-aaaf-b7b0ee59bf6c+10:13738:x1876402783757824:12345-192.168.201.23@tcp:503:mount.lustre.0 Request processed in 737us (1313us total) trans 0 rc 0/0 00000100:00100000:3.0:1789477532.615902:0:14345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 89 00000100:00100000:2.0:1789477532.626854:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:1.0:1789477532.626997:0:14343:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783757952 00000100:00100000:1.0:1789477532.627012:0:14343:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783757952 00000100:00100000:1.0:1789477532.627085:0:14343:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 90 00000100:00100000:1.0:1789477532.627103:0:14343:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d7b09a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:41935ab2-fae2-41da-aaaf-b7b0ee59bf6c+10:13761:x1876402783757952:12345-192.168.201.23@tcp:502:llog_process_th.0 00000100:00100000:1.0:1789477532.627514:0:14343:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d7b09a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:41935ab2-fae2-41da-aaaf-b7b0ee59bf6c+10:13761:x1876402783757952:12345-192.168.201.23@tcp:502:llog_process_th.0 Request processed in 412us (676us total) trans 0 rc 0/0 00000100:00100000:1.0:1789477532.627525:0:14343:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 90 00000100:00100000:2.0:1789477532.640719:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:0.0:1789477532.640846:0:14345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783758080 00000100:00100000:0.0:1789477532.640860:0:14345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783758080 00000100:00100000:0.0:1789477532.640933:0:14345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 91 00000100:00100000:0.0:1789477532.640945:0:14345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d7b098450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:41935ab2-fae2-41da-aaaf-b7b0ee59bf6c+10:13761:x1876402783758080:12345-192.168.201.23@tcp:502:llog_process_th.0 00000100:00100000:0.0:1789477532.641308:0:14345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d7b098450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:41935ab2-fae2-41da-aaaf-b7b0ee59bf6c+10:13761:x1876402783758080:12345-192.168.201.23@tcp:502:llog_process_th.0 Request processed in 357us (597us total) trans 0 rc 0/0 00000100:00100000:0.0:1789477532.641318:0:14345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 91 00000100:00100000:0.0:1789477532.644996:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:3.0:1789477532.652227:0:14350:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783758208 00000100:00100000:3.0:1789477532.652252:0:14350:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783758208 00000100:00100000:3.0:1789477532.652339:0:14350:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 4 00000100:00100000:3.0:1789477532.652351:0:14350:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d6d482a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2351:x1876402783758208:12345-192.168.201.23@tcp:38:mount.lustre.0 00010000:00080000:3.0:1789477532.652394:0:14350:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from d98042a3-6618-44a7-81f9-5553c982b325@192.168.201.23@tcp t0 exp 0000000000000000 cur 477 last 0 00000020:00000080:3.0:1789477532.652466:0:14350:0:(genops.c:1385:class_connect()) connect: client d98042a3-6618-44a7-81f9-5553c982b325, cookie 0xafddb3c8f9282a5b 00000004:00100000:3.0:1789477532.652510:0:14350:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000001:00000004:3.0:1789477532.652517:0:14350:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000100:00080000:3.0:1789477532.732709:0:14350:0:(import.c:65:import_set_state_nolock()) ffff9d0d6ecf6000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789477532.732922:0:14350:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d6d482a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d98042a3-6618-44a7-81f9-5553c982b325+6:2351:x1876402783758208:12345-192.168.201.23@tcp:38:mount.lustre.0 Request processed in 80563us (87943us total) trans 0 rc 0/0 00000100:00100000:3.0:1789477532.732936:0:14350:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 4 00000100:00100000:2.0:1789477532.740535:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:2.0:1789477532.740874:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:1.0:1789477532.743259:0:14351:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783758464 00000100:00100000:1.0:1789477532.743283:0:14351:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783758464 00000100:00100000:1.0:1789477532.743412:0:14351:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783758336 00000100:00100000:1.0:1789477532.743416:0:14351:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783758336 00000100:00100000:1.0:1789477532.743442:0:14351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 5 00000100:00100000:1.0:1789477532.743455:0:14351:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d7523c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d98042a3-6618-44a7-81f9-5553c982b325+7:13738:x1876402783758464:12345-192.168.201.23@tcp:41:mount.lustre.0 00000004:00000024:1.0:1789477532.743517:0:14351:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:1.0:1789477532.743687:0:14351:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d7523c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d98042a3-6618-44a7-81f9-5553c982b325+7:13738:x1876402783758464:12345-192.168.201.23@tcp:41:mount.lustre.0 Request processed in 233us (3166us total) trans 0 rc 0/0 00000100:00100000:1.0:1789477532.743696:0:14351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 5 00000100:00100000:1.0:1789477532.743717:0:14351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 6 00000100:00100000:1.0:1789477532.743725:0:14351:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d7523dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d98042a3-6618-44a7-81f9-5553c982b325+6:0:x1876402783758336:12345-192.168.201.23@tcp:41:mount.lustre.0 00000004:00000024:1.0:1789477532.743737:0:14351:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:1.0:1789477532.743759:0:14351:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d7523dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d98042a3-6618-44a7-81f9-5553c982b325+6:0:x1876402783758336:12345-192.168.201.23@tcp:41:mount.lustre.0 Request processed in 35us (2887us total) trans 0 rc 0/0 00000100:00100000:1.0:1789477532.743766:0:14351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 6 00000100:00080000:2.0:1789477532.743928:0:14346:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789477532.747451:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:3.0:1789477532.747634:0:14351:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783758592 00000100:00100000:3.0:1789477532.747648:0:14351:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783758592 00000100:00100000:3.0:1789477532.747718:0:14351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 7 00000100:00100000:3.0:1789477532.747730:0:14351:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d7f701180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d98042a3-6618-44a7-81f9-5553c982b325+6:13738:x1876402783758592:12345-192.168.201.23@tcp:40:mount.lustre.0 00000100:00100000:3.0:1789477532.747841:0:14351:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d7f701180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d98042a3-6618-44a7-81f9-5553c982b325+6:13738:x1876402783758592:12345-192.168.201.23@tcp:40:mount.lustre.0 Request processed in 112us (408us total) trans 0 rc 0/0 00000100:00100000:3.0:1789477532.747850:0:14351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 7 00000100:00100000:1.0:1789477532.750770:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:1.0:1789477532.750821:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:1.0:1789477532.750850:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:0.0:1789477532.750946:0:15469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783758720 00000100:00100000:0.0:1789477532.750959:0:15469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783758720 00000100:00100000:0.0:1789477532.751023:0:15469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783758848 00000100:00100000:0.0:1789477532.751027:0:15469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783758848 00000100:00100000:0.0:1789477532.751050:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 9 00000100:00100000:0.0:1789477532.751079:0:15469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d7f701880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2351:x1876402783758720:12345-192.168.201.23@tcp:8:mount.lustre.0 00010000:00080000:0.0:1789477532.751121:0:15469:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from d98042a3-6618-44a7-81f9-5553c982b325@192.168.201.23@tcp t0 exp 0000000000000000 cur 477 last 0 00000020:00000080:0.0:1789477532.751159:0:15469:0:(genops.c:1385:class_connect()) connect: client d98042a3-6618-44a7-81f9-5553c982b325, cookie 0xafddb3c8f9282a62 00002000:00100000:0.0:1789477532.751175:0:15469:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli d98042a3-6618-44a7-81f9-5553c982b325/ffff9d0d7f836800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113954 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1789477532.751207:0:15469:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:0.0:1789477532.751682:0:15469:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1789477532.751722:0:15469:0:(import.c:65:import_set_state_nolock()) ffff9d0d7f836000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789477532.751810:0:15469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d7f701880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d98042a3-6618-44a7-81f9-5553c982b325+6:2351:x1876402783758720:12345-192.168.201.23@tcp:8:mount.lustre.0 Request processed in 731us (987us total) trans 0 rc 0/0 00000100:00100000:0.0:1789477532.751819:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 9 00000100:00100000:0.0:1789477532.751845:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 10 00000100:00100000:0.0:1789477532.751851:0:15469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d7f703100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2351:x1876402783758848:12345-192.168.201.23@tcp:8:mount.lustre.0 00010000:00080000:0.0:1789477532.751869:0:15469:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from d98042a3-6618-44a7-81f9-5553c982b325@192.168.201.23@tcp t0 exp 0000000000000000 cur 477 last 0 00000020:00000080:0.0:1789477532.751890:0:15469:0:(genops.c:1385:class_connect()) connect: client d98042a3-6618-44a7-81f9-5553c982b325, cookie 0xafddb3c8f9282a69 00002000:00100000:0.0:1789477532.751897:0:15469:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli d98042a3-6618-44a7-81f9-5553c982b325/ffff9d0d7f835000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113954 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1789477532.751904:0:15469:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:0.0:1789477532.752155:0:15469:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1789477532.752171:0:15469:0:(import.c:65:import_set_state_nolock()) ffff9d0d7f834800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789477532.752196:0:15469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d7f703100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d98042a3-6618-44a7-81f9-5553c982b325+6:2351:x1876402783758848:12345-192.168.201.23@tcp:8:mount.lustre.0 Request processed in 344us (1346us total) trans 0 rc 0/0 00000100:00100000:0.0:1789477532.752203:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 10 00000100:00100000:2.0:1789477532.752417:0:14353:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783758976 00000100:00100000:2.0:1789477532.752425:0:14353:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783758976 00000100:00100000:2.0:1789477532.752479:0:14353:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 0 00000100:00100000:2.0:1789477532.752488:0:14353:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d7f700e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d98042a3-6618-44a7-81f9-5553c982b325+6:13738:x1876402783758976:12345-192.168.201.23@tcp:33:mount.lustre.0 00000004:00080000:2.0:1789477532.753222:0:14353:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 658us 00000004:00200000:2.0:1789477532.808867:0:14353:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000100:00100000:2.0:1789477532.809144:0:14353:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d7f700e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d98042a3-6618-44a7-81f9-5553c982b325+6:13738:x1876402783758976:12345-192.168.201.23@tcp:33:mount.lustre.0 Request processed in 56647us (58379us total) trans 0 rc 0/0 00000100:00100000:2.0:1789477532.809156:0:14353:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 0 00000100:00100000:1.0:1789477532.977330:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:3.0:1789477532.977484:0:14352:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783759104 00000100:00100000:3.0:1789477532.977507:0:14352:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783759104 00000100:00100000:3.0:1789477532.977662:0:14352:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 8 00000100:00100000:3.0:1789477532.977673:0:14352:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d7f702680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d98042a3-6618-44a7-81f9-5553c982b325+6:13782:x1876402783759104:12345-192.168.201.23@tcp:101:mkdir.0 00010000:00010000:3.0:1789477532.977699:0:14352:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789477532.977753:0:14352:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d41646200/0xafddb3c8f9282a70 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa90d500d7b8f2ecc expref: -99 pid: 14352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477532.977843:0:14352:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d41646800/0xafddb3c8f9282a77 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14352 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477532.977860:0:14352:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d41646800/0xafddb3c8f9282a77 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14352 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477532.977878:0:14352:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d41646800/0xafddb3c8f9282a77 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14352 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789477532.978137:0:14352:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:3.0:1789477532.978142:0:14352:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 3 stripe count 1 MDT count 1 00000004:00010000:3.0:1789477532.978266:0:14352:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d41646800/0xafddb3c8f9282a77 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14352 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477532.978314:0:14352:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d41646200/0xafddb3c8f9282a70 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2ecc expref: 8 pid: 14352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477532.978337:0:14352:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d41646800/0xafddb3c8f9282a77 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2ecc expref: 7 pid: 14352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477532.978348:0:14352:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9d0d5b3c3900) 00010000:00010000:3.0:1789477532.978351:0:14352:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789477532.978355:0:14352:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d0d41646800, rc 0) 00000100:00100000:3.0:1789477532.978446:0:14352:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d7f702680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d98042a3-6618-44a7-81f9-5553c982b325+7:13782:x1876402783759104:12345-192.168.201.23@tcp:101:mkdir.0 Request processed in 774us (1142us total) trans 0 rc 0/0 00000100:00100000:3.0:1789477532.978455:0:14352:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 8 00010000:00010000:0.0:1789477533.487979:0:14338:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789477534.512063:0:15972:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789477534.924031:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:0.0:1789477534.924135:0:14350:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783759232 00000100:00100000:0.0:1789477534.924151:0:14350:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783759232 00000100:00100000:0.0:1789477534.924280:0:14350:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 9 00000100:00100000:0.0:1789477534.924294:0:14350:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d7f702d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d98042a3-6618-44a7-81f9-5553c982b325+7:13834:x1876402783759232:12345-192.168.201.23@tcp:41:lfs.0 00000004:00000024:0.0:1789477534.924354:0:14350:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1789477534.924489:0:14350:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d7f702d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d98042a3-6618-44a7-81f9-5553c982b325+7:13834:x1876402783759232:12345-192.168.201.23@tcp:41:lfs.0 Request processed in 198us (473us total) trans 0 rc 0/0 00000100:00100000:0.0:1789477534.924499:0:14350:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 9 00000100:00080000:2.0:1789477534.924958:0:14346:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789477534.930996:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:3.0:1789477534.931195:0:15042:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783759360 00000100:00100000:3.0:1789477534.931212:0:15042:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783759360 00000100:00100000:3.0:1789477534.931386:0:15042:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 6 00000100:00100000:3.0:1789477534.931401:0:15042:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d7f703b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:d98042a3-6618-44a7-81f9-5553c982b325+6:13834:x1876402783759360:12345-192.168.201.23@tcp:13:lfs.0 00002000:00000024:3.0:1789477534.931464:0:15042:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789477534.931634:0:15042:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d7f703b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:d98042a3-6618-44a7-81f9-5553c982b325+6:13834:x1876402783759360:12345-192.168.201.23@tcp:13:lfs.0 Request processed in 236us (652us total) trans 0 rc 0/0 00000100:00100000:3.0:1789477534.932607:0:15042:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 6 00000100:00080000:2.0:1789477534.933001:0:14346:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789477534.935156:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:1.0:1789477534.935617:0:15041:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783759488 00000100:00100000:1.0:1789477534.935632:0:15041:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783759488 00000100:00100000:1.0:1789477534.935731:0:15041:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 7 00000100:00100000:1.0:1789477534.935746:0:15041:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d7bddc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:d98042a3-6618-44a7-81f9-5553c982b325+6:13834:x1876402783759488:12345-192.168.201.23@tcp:13:lfs.0 00002000:00000024:1.0:1789477534.935795:0:15041:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789477534.935930:0:15041:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d7bddc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:d98042a3-6618-44a7-81f9-5553c982b325+6:13834:x1876402783759488:12345-192.168.201.23@tcp:13:lfs.0 Request processed in 188us (788us total) trans 0 rc 0/0 00000100:00100000:1.0:1789477534.935949:0:15041:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 7 00000100:00080000:2.0:1789477534.937131:0:14346:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789477535.124638:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:2.0:1789477535.132146:0:14344:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783759616 00000100:00100000:2.0:1789477535.132171:0:14344:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783759616 00000100:00100000:2.0:1789477535.132278:0:14344:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 92 00000100:00100000:2.0:1789477535.132291:0:14344:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d6ec5d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:41935ab2-fae2-41da-aaaf-b7b0ee59bf6c+10:13868:x1876402783759616:12345-192.168.201.23@tcp:101:mount.lustre.0 00010000:00010000:2.0:1789477535.132315:0:14344:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789477535.132337:0:14344:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d0d50417e00/0xafddb3c8f9282a7e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0xa90d500d7b8f2ed3 expref: -99 pid: 14344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477535.132374:0:14344:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d0d50417e00/0xafddb3c8f9282a7e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2ed3 expref: 11 pid: 14344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477535.132386:0:14344:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d0d50417e00/0xafddb3c8f9282a7e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2ed3 expref: 11 pid: 14344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477535.132397:0:14344:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d0d50417e00, rc 0) 00000100:00100000:2.0:1789477535.132498:0:14344:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d6ec5d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:41935ab2-fae2-41da-aaaf-b7b0ee59bf6c+11:13868:x1876402783759616:12345-192.168.201.23@tcp:101:mount.lustre.0 Request processed in 209us (7938us total) trans 0 rc 0/0 00000100:00100000:2.0:1789477535.132506:0:14344:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 92 00000100:00100000:0.0:1789477535.142377:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:1.0:1789477535.143801:0:14343:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783759744 00000100:00100000:1.0:1789477535.143826:0:14343:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783759744 00000100:00100000:1.0:1789477535.143956:0:14343:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 93 00000100:00100000:1.0:1789477535.143971:0:14343:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d6ec5d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:41935ab2-fae2-41da-aaaf-b7b0ee59bf6c+11:13868:x1876402783759744:12345-192.168.201.23@tcp:501:mount.lustre.0 00000100:00100000:1.0:1789477535.144367:0:14343:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d6ec5d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:41935ab2-fae2-41da-aaaf-b7b0ee59bf6c+11:13868:x1876402783759744:12345-192.168.201.23@tcp:501:mount.lustre.0 Request processed in 399us (2005us total) trans 0 rc 0/0 00000100:00100000:1.0:1789477535.144376:0:14343:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 93 00000100:00100000:1.0:1789477535.153992:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:3.0:1789477535.154256:0:14345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783759872 00000100:00100000:3.0:1789477535.154270:0:14345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783759872 00000100:00100000:3.0:1789477535.154400:0:14345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 94 00000100:00100000:3.0:1789477535.154415:0:14345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d6ec5c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:41935ab2-fae2-41da-aaaf-b7b0ee59bf6c+11:13868:x1876402783759872:12345-192.168.201.23@tcp:503:mount.lustre.0 00000100:00100000:3.0:1789477535.154785:0:14345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d6ec5c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:41935ab2-fae2-41da-aaaf-b7b0ee59bf6c+11:13868:x1876402783759872:12345-192.168.201.23@tcp:503:mount.lustre.0 Request processed in 372us (864us total) trans 0 rc 0/0 00000100:00100000:3.0:1789477535.154794:0:14345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 94 00000100:00100000:0.0:1789477535.159457:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:2.0:1789477535.159640:0:14344:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783760000 00000100:00100000:2.0:1789477535.159658:0:14344:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783760000 00000100:00100000:2.0:1789477535.159737:0:14344:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 95 00000100:00100000:2.0:1789477535.159751:0:14344:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d6ec5e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:41935ab2-fae2-41da-aaaf-b7b0ee59bf6c+11:13874:x1876402783760000:12345-192.168.201.23@tcp:502:llog_process_th.0 00000100:00100000:2.0:1789477535.160117:0:14344:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d6ec5e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:41935ab2-fae2-41da-aaaf-b7b0ee59bf6c+11:13874:x1876402783760000:12345-192.168.201.23@tcp:502:llog_process_th.0 Request processed in 367us (685us total) trans 0 rc 0/0 00000100:00100000:2.0:1789477535.160126:0:14344:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 95 00000100:00100000:0.0:1789477535.174275:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:3.0:1789477535.174433:0:14345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783760128 00000100:00100000:3.0:1789477535.174457:0:14345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783760128 00000100:00100000:3.0:1789477535.174536:0:14345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 96 00000100:00100000:3.0:1789477535.174547:0:14345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d6ec5cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:41935ab2-fae2-41da-aaaf-b7b0ee59bf6c+11:13874:x1876402783760128:12345-192.168.201.23@tcp:502:llog_process_th.0 00000100:00100000:3.0:1789477535.174989:0:14345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d6ec5cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:41935ab2-fae2-41da-aaaf-b7b0ee59bf6c+11:13874:x1876402783760128:12345-192.168.201.23@tcp:502:llog_process_th.0 Request processed in 441us (739us total) trans 0 rc 0/0 00000100:00100000:3.0:1789477535.174998:0:14345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 96 00000100:00100000:3.0:1789477535.182331:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:1.0:1789477535.186977:0:14343:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783760256 00000100:00100000:1.0:1789477535.187000:0:14343:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783760256 00000100:00100000:1.0:1789477535.187098:0:14343:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 97 00000100:00100000:1.0:1789477535.187111:0:14343:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d6ec5c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:41935ab2-fae2-41da-aaaf-b7b0ee59bf6c+11:13868:x1876402783760256:12345-192.168.201.23@tcp:101:mount.lustre.0 00010000:00010000:1.0:1789477535.187135:0:14343:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789477535.187158:0:14343:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d0d7f519a00/0xafddb3c8f9282a85 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xa90d500d7b8f2efd expref: -99 pid: 14343 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477535.187197:0:14343:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d0d7f519a00/0xafddb3c8f9282a85 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2efd expref: 12 pid: 14343 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477535.187211:0:14343:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d0d7f519a00/0xafddb3c8f9282a85 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2efd expref: 12 pid: 14343 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477535.187223:0:14343:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d0d7f519a00, rc 0) 00000100:00100000:1.0:1789477535.187560:0:14343:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d6ec5c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:41935ab2-fae2-41da-aaaf-b7b0ee59bf6c+12:13868:x1876402783760256:12345-192.168.201.23@tcp:101:mount.lustre.0 Request processed in 449us (5241us total) trans 0 rc 0/0 00000100:00100000:1.0:1789477535.187568:0:14343:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 97 00000100:00100000:0.0:1789477535.193261:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:2.0:1789477535.193377:0:14344:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783760384 00000100:00100000:2.0:1789477535.193400:0:14344:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783760384 00000100:00100000:2.0:1789477535.193476:0:14344:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 98 00000100:00100000:2.0:1789477535.193500:0:14344:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d6ec5f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:41935ab2-fae2-41da-aaaf-b7b0ee59bf6c+12:13868:x1876402783760384:12345-192.168.201.23@tcp:256:mount.lustre.0 20000000:01000000:2.0:1789477535.193538:0:14344:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:2.0:1789477535.193570:0:14344:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:2.0:1789477535.193575:0:14344:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:2.0:1789477535.193621:0:14344:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:2.0:1789477535.193624:0:14344:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 8 00000100:00100000:2.0:1789477535.196004:0:14344:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d6ec5f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:41935ab2-fae2-41da-aaaf-b7b0ee59bf6c+12:13868:x1876402783760384:12345-192.168.201.23@tcp:256:mount.lustre.0 Request processed in 2500us (2740us total) trans 0 rc 0/0 00000100:00100000:2.0:1789477535.196023:0:14344:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 98 00000100:00100000:1.0:1789477535.198674:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:3.0:1789477535.198738:0:14343:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783760512 00000100:00100000:3.0:1789477535.198752:0:14343:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783760512 00000100:00100000:3.0:1789477535.198838:0:14343:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 99 00000100:00100000:2.0:1789477535.198958:0:14343:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d6ec5e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:41935ab2-fae2-41da-aaaf-b7b0ee59bf6c+12:13868:x1876402783760512:12345-192.168.201.23@tcp:101:mount.lustre.0 00010000:00010000:2.0:1789477535.198981:0:14343:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789477535.199002:0:14343:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d0d50416000/0xafddb3c8f9282a8c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xa90d500d7b8f2f04 expref: -99 pid: 14343 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477535.199033:0:14343:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d0d50416000/0xafddb3c8f9282a8c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2f04 expref: 13 pid: 14343 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477535.199041:0:14343:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d0d50416000/0xafddb3c8f9282a8c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2f04 expref: 13 pid: 14343 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477535.199049:0:14343:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d0d50416000, rc 0) 00000100:00100000:2.0:1789477535.199109:0:14343:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d6ec5e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:41935ab2-fae2-41da-aaaf-b7b0ee59bf6c+13:13868:x1876402783760512:12345-192.168.201.23@tcp:101:mount.lustre.0 Request processed in 262us (452us total) trans 0 rc 0/0 00000100:00100000:2.0:1789477535.199116:0:14343:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 99 00000100:00100000:0.0:1789477535.201376:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:2.0:1789477535.201713:0:14344:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783760640 00000100:00100000:2.0:1789477535.201743:0:14344:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783760640 00000100:00100000:2.0:1789477535.201809:0:14344:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 100 00000100:00100000:2.0:1789477535.201823:0:14344:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d6ec5c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:41935ab2-fae2-41da-aaaf-b7b0ee59bf6c+13:13868:x1876402783760640:12345-192.168.201.23@tcp:501:mount.lustre.0 00000100:00100000:2.0:1789477535.202223:0:14344:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d6ec5c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:41935ab2-fae2-41da-aaaf-b7b0ee59bf6c+13:13868:x1876402783760640:12345-192.168.201.23@tcp:501:mount.lustre.0 Request processed in 401us (860us total) trans 0 rc 0/0 00000100:00100000:2.0:1789477535.202232:0:14344:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 100 00000100:00100000:0.0:1789477535.204539:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:2.0:1789477535.204673:0:14343:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783760768 00000100:00100000:2.0:1789477535.204687:0:14343:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783760768 00000100:00100000:2.0:1789477535.204755:0:14343:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 101 00000100:00100000:2.0:1789477535.204767:0:14343:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d6ec5f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:41935ab2-fae2-41da-aaaf-b7b0ee59bf6c+13:13868:x1876402783760768:12345-192.168.201.23@tcp:503:mount.lustre.0 00000100:00100000:2.0:1789477535.205160:0:14343:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d6ec5f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:41935ab2-fae2-41da-aaaf-b7b0ee59bf6c+13:13868:x1876402783760768:12345-192.168.201.23@tcp:503:mount.lustre.0 Request processed in 394us (632us total) trans 0 rc 0/0 00000100:00100000:2.0:1789477535.205170:0:14343:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 101 00000100:00100000:1.0:1789477535.207187:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:0.0:1789477535.207358:0:14345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783760896 00000100:00100000:0.0:1789477535.207369:0:14345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783760896 00000100:00100000:0.0:1789477535.207764:0:14345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 102 00000100:00100000:0.0:1789477535.207775:0:14345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d6ec5ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:41935ab2-fae2-41da-aaaf-b7b0ee59bf6c+13:13878:x1876402783760896:12345-192.168.201.23@tcp:502:llog_process_th.0 00000100:00100000:0.0:1789477535.208072:0:14345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d6ec5ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:41935ab2-fae2-41da-aaaf-b7b0ee59bf6c+13:13878:x1876402783760896:12345-192.168.201.23@tcp:502:llog_process_th.0 Request processed in 297us (897us total) trans 0 rc 0/0 00000100:00100000:0.0:1789477535.208081:0:14345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 102 00000100:00100000:0.0:1789477535.209878:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:2.0:1789477535.213713:0:14343:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783761024 00000100:00100000:2.0:1789477535.213738:0:14343:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783761024 00000100:00100000:2.0:1789477535.213917:0:14343:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 103 00000100:00100000:2.0:1789477535.213964:0:14343:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d6ec5d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:41935ab2-fae2-41da-aaaf-b7b0ee59bf6c+13:13878:x1876402783761024:12345-192.168.201.23@tcp:502:llog_process_th.0 00000100:00100000:2.0:1789477535.214378:0:14343:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d6ec5d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:41935ab2-fae2-41da-aaaf-b7b0ee59bf6c+13:13878:x1876402783761024:12345-192.168.201.23@tcp:502:llog_process_th.0 Request processed in 448us (4511us total) trans 0 rc 0/0 00000100:00100000:2.0:1789477535.214389:0:14343:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 103 00000100:00100000:1.0:1789477535.218537:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:1.0:1789477535.218654:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:1.0:1789477535.218674:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:1.0:1789477535.218720:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:1.0:1789477535.218761:0:15038:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783761664 00000100:00100000:1.0:1789477535.218775:0:15038:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783761664 00000100:00100000:1.0:1789477535.218841:0:15038:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783761792 00000100:00100000:1.0:1789477535.218845:0:15038:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783761792 00000100:00100000:1.0:1789477535.218872:0:15038:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 3 00000100:00100000:1.0:1789477535.218884:0:15038:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d7f702a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d98042a3-6618-44a7-81f9-5553c982b325+6:2353:x1876402783761664:12345-192.168.201.23@tcp:400:kworker.0 00000100:00100000:1.0:1789477535.218997:0:15038:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d7f702a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d98042a3-6618-44a7-81f9-5553c982b325+6:2353:x1876402783761664:12345-192.168.201.23@tcp:400:kworker.0 Request processed in 115us (343us total) trans 0 rc 0/0 00000100:00100000:0.0:1789477535.218997:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 4 00000100:00100000:1.0:1789477535.219007:0:15038:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 3 00000100:00100000:0.0:1789477535.219009:0:15469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d7f703800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d98042a3-6618-44a7-81f9-5553c982b325+6:2352:x1876402783761792:12345-192.168.201.23@tcp:400:kworker.0 00000100:00100000:0.0:1789477535.219038:0:15469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d7f703800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d98042a3-6618-44a7-81f9-5553c982b325+6:2352:x1876402783761792:12345-192.168.201.23@tcp:400:kworker.0 Request processed in 33us (319us total) trans 0 rc 0/0 00000100:00100000:0.0:1789477535.219055:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 4 00000100:00100000:3.0:1789477535.219533:0:14352:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783761152 00000100:00100000:3.0:1789477535.219540:0:14352:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783761152 00000100:00100000:3.0:1789477535.219608:0:14352:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783761536 00000100:00100000:3.0:1789477535.219613:0:14352:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783761536 00000100:00100000:3.0:1789477535.219640:0:14352:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 17 00000100:00100000:0.0:1789477535.219702:0:14352:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d7f700700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d98042a3-6618-44a7-81f9-5553c982b325+7:2352:x1876402783761536:12345-192.168.201.23@tcp:400:kworker.0 00000100:00100000:0.0:1789477535.219768:0:14352:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d7f700700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d98042a3-6618-44a7-81f9-5553c982b325+7:2352:x1876402783761536:12345-192.168.201.23@tcp:400:kworker.0 Request processed in 119us (1092us total) trans 0 rc 0/0 00000100:00100000:0.0:1789477535.219776:0:14352:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 17 00000100:00100000:0.0:1789477535.219793:0:14352:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 10 00000100:00100000:0.0:1789477535.219797:0:14352:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d7f700000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2351:x1876402783761152:12345-192.168.201.23@tcp:38:mount.lustre.0 00010000:00080000:0.0:1789477535.219833:0:14352:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from 43ab5f84-4c5e-451f-a8c7-1cb9f9e2bde0@192.168.201.23@tcp t0 exp 0000000000000000 cur 480 last 0 00000020:00000080:0.0:1789477535.219891:0:14352:0:(genops.c:1385:class_connect()) connect: client 43ab5f84-4c5e-451f-a8c7-1cb9f9e2bde0, cookie 0xafddb3c8f9282a93 00000004:00100000:0.0:1789477535.219948:0:14352:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:0.0:1789477535.220133:0:14352:0:(import.c:65:import_set_state_nolock()) ffff9d0d754ca800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789477535.220170:0:14352:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d7f700000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:43ab5f84-4c5e-451f-a8c7-1cb9f9e2bde0+6:2351:x1876402783761152:12345-192.168.201.23@tcp:38:mount.lustre.0 Request processed in 371us (1652us total) trans 0 rc 0/0 00000100:00100000:0.0:1789477535.220178:0:14352:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 10 00000100:00100000:1.0:1789477535.225008:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:1.0:1789477535.225069:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:2.0:1789477535.225231:0:14350:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783761408 00000100:00100000:2.0:1789477535.225244:0:14350:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783761408 00000100:00100000:2.0:1789477535.225335:0:14350:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783761280 00000100:00100000:2.0:1789477535.225339:0:14350:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783761280 00000100:00100000:2.0:1789477535.225357:0:14350:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 11 00000100:00100000:2.0:1789477535.225369:0:14350:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d75285180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:43ab5f84-4c5e-451f-a8c7-1cb9f9e2bde0+7:13868:x1876402783761408:12345-192.168.201.23@tcp:41:mount.lustre.0 00000004:00000024:2.0:1789477535.225460:0:14350:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:2.0:1789477535.225642:0:14350:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d75285180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:43ab5f84-4c5e-451f-a8c7-1cb9f9e2bde0+7:13868:x1876402783761408:12345-192.168.201.23@tcp:41:mount.lustre.0 Request processed in 273us (649us total) trans 0 rc 0/0 00000100:00100000:2.0:1789477535.225651:0:14350:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 11 00000100:00100000:2.0:1789477535.225672:0:14350:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 12 00000100:00100000:2.0:1789477535.225678:0:14350:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d75286300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:43ab5f84-4c5e-451f-a8c7-1cb9f9e2bde0+6:0:x1876402783761280:12345-192.168.201.23@tcp:41:mount.lustre.0 00000004:00000024:2.0:1789477535.225690:0:14350:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:2.0:1789477535.225713:0:14350:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d75286300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:43ab5f84-4c5e-451f-a8c7-1cb9f9e2bde0+6:0:x1876402783761280:12345-192.168.201.23@tcp:41:mount.lustre.0 Request processed in 35us (644us total) trans 0 rc 0/0 00000100:00100000:2.0:1789477535.225718:0:14350:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 12 00000100:00080000:1.0:1789477535.225777:0:14346:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789477535.228988:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:0.0:1789477535.230067:0:14352:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783761920 00000100:00100000:0.0:1789477535.230085:0:14352:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783761920 00000100:00100000:0.0:1789477535.230194:0:14352:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 13 00000100:00100000:0.0:1789477535.230208:0:14352:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d7bddf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:43ab5f84-4c5e-451f-a8c7-1cb9f9e2bde0+6:13868:x1876402783761920:12345-192.168.201.23@tcp:40:mount.lustre.0 00000100:00100000:0.0:1789477535.230351:0:14352:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d7bddf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:43ab5f84-4c5e-451f-a8c7-1cb9f9e2bde0+6:13868:x1876402783761920:12345-192.168.201.23@tcp:40:mount.lustre.0 Request processed in 145us (1378us total) trans 0 rc 0/0 00000100:00100000:0.0:1789477535.230359:0:14352:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 13 00000100:00100000:0.0:1789477535.233799:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:0.0:1789477535.233827:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:0.0:1789477535.233880:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:3.0:1789477535.233903:0:15037:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783762048 00000100:00100000:3.0:1789477535.233916:0:15037:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783762048 00000100:00100000:3.0:1789477535.233985:0:15037:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783762176 00000100:00100000:3.0:1789477535.233990:0:15037:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783762176 00000100:00100000:1.0:1789477535.233998:0:15038:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 11 00000100:00100000:3.0:1789477535.234021:0:15037:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 12 00000100:00100000:3.0:1789477535.234029:0:15037:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d6d482d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2351:x1876402783762176:12345-192.168.201.23@tcp:8:mount.lustre.0 00000100:00100000:2.0:1789477535.234068:0:14354:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783762304 00010000:00080000:3.0:1789477535.234073:0:15037:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 43ab5f84-4c5e-451f-a8c7-1cb9f9e2bde0@192.168.201.23@tcp t0 exp 0000000000000000 cur 480 last 0 00000100:00100000:2.0:1789477535.234073:0:14354:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783762304 00000100:00100000:2.0:1789477535.234110:0:14354:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 1 00000100:00100000:2.0:1789477535.234118:0:14354:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d6d481500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:43ab5f84-4c5e-451f-a8c7-1cb9f9e2bde0+6:13868:x1876402783762304:12345-192.168.201.23@tcp:33:mount.lustre.0 00000020:00000080:3.0:1789477535.234124:0:15037:0:(genops.c:1385:class_connect()) connect: client 43ab5f84-4c5e-451f-a8c7-1cb9f9e2bde0, cookie 0xafddb3c8f9282a9a 00002000:00100000:3.0:1789477535.234141:0:15037:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 43ab5f84-4c5e-451f-a8c7-1cb9f9e2bde0/ffff9d0d622ff800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113954 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1789477535.234157:0:15037:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:3.0:1789477535.234308:0:15037:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1789477535.234346:0:15037:0:(import.c:65:import_set_state_nolock()) ffff9d0d622f8000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789477535.234444:0:15037:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d6d482d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:43ab5f84-4c5e-451f-a8c7-1cb9f9e2bde0+6:2351:x1876402783762176:12345-192.168.201.23@tcp:8:mount.lustre.0 Request processed in 414us (613us total) trans 0 rc 0/0 00000100:00100000:3.0:1789477535.234452:0:15037:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 12 00000100:00100000:1.0:1789477535.234553:0:15038:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d6d483480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2351:x1876402783762048:12345-192.168.201.23@tcp:8:mount.lustre.0 00010000:00080000:1.0:1789477535.234605:0:15038:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 43ab5f84-4c5e-451f-a8c7-1cb9f9e2bde0@192.168.201.23@tcp t0 exp 0000000000000000 cur 480 last 0 00000020:00000080:1.0:1789477535.234625:0:15038:0:(genops.c:1385:class_connect()) connect: client 43ab5f84-4c5e-451f-a8c7-1cb9f9e2bde0, cookie 0xafddb3c8f9282aa1 00002000:00100000:1.0:1789477535.234630:0:15038:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 43ab5f84-4c5e-451f-a8c7-1cb9f9e2bde0/ffff9d0d7c676800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113954 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1789477535.234637:0:15038:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:1.0:1789477535.234707:0:15038:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1789477535.234724:0:15038:0:(import.c:65:import_set_state_nolock()) ffff9d0d7c677000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789477535.236331:0:15038:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d6d483480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:43ab5f84-4c5e-451f-a8c7-1cb9f9e2bde0+6:2351:x1876402783762048:12345-192.168.201.23@tcp:8:mount.lustre.0 Request processed in 1767us (2532us total) trans 0 rc 0/0 00000100:00100000:1.0:1789477535.236345:0:15038:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 11 00000004:00200000:2.0:1789477535.238593:0:14354:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000100:00100000:2.0:1789477535.238860:0:14354:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d6d481500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:43ab5f84-4c5e-451f-a8c7-1cb9f9e2bde0+6:13868:x1876402783762304:12345-192.168.201.23@tcp:33:mount.lustre.0 Request processed in 4734us (4970us total) trans 0 rc 0/0 00000100:00100000:2.0:1789477535.238874:0:14354:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 1 00000100:00100000:0.0:1789477535.404683:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:3.0:1789477535.404823:0:14351:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783762432 00000100:00100000:3.0:1789477535.404840:0:14351:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783762432 00000100:00100000:3.0:1789477535.404972:0:14351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 14 00000100:00100000:3.0:1789477535.404987:0:14351:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d6d483b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:43ab5f84-4c5e-451f-a8c7-1cb9f9e2bde0+6:13899:x1876402783762432:12345-192.168.201.23@tcp:101:mkdir.0 00010000:00010000:3.0:1789477535.405019:0:14351:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789477535.405065:0:14351:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d41646200/0xafddb3c8f9282aa8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa90d500d7b8f2f2e expref: -99 pid: 14351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477535.405155:0:14351:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d41647400/0xafddb3c8f9282aaf lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477535.405173:0:14351:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d41647400/0xafddb3c8f9282aaf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477535.405191:0:14351:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d41647400/0xafddb3c8f9282aaf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14351 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789477535.405476:0:14351:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:3.0:1789477535.405480:0:14351:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 3 stripe count 1 MDT count 1 00000004:00010000:2.0:1789477535.406055:0:14351:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d41647400/0xafddb3c8f9282aaf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477535.406100:0:14351:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d41646200/0xafddb3c8f9282aa8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2f2e expref: 8 pid: 14351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477535.406127:0:14351:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d41647400/0xafddb3c8f9282aaf lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2f2e expref: 7 pid: 14351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477535.406151:0:14351:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9d0d5b3c3900) 00010000:00010000:2.0:1789477535.406154:0:14351:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789477535.406159:0:14351:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d0d41647400, rc 0) 00000100:00100000:2.0:1789477535.406342:0:14351:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d6d483b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:43ab5f84-4c5e-451f-a8c7-1cb9f9e2bde0+7:13899:x1876402783762432:12345-192.168.201.23@tcp:101:mkdir.0 Request processed in 1357us (1678us total) trans 0 rc 0/0 00000100:00100000:2.0:1789477535.406352:0:14351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 14 00010000:00010000:2.0:1789477535.538356:0:14339:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789477535.664327:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d7bddf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1876402802626304:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789477535.664445:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789477535.664671:0:15041:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802626304 00000100:00100000:3.0:1789477535.664683:0:15041:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802626304 00000100:00100000:3.0:1789477535.664771:0:15041:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1789477535.664785:0:15041:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d75285500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1876402802626304:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789477535.664818:0:15041:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789477535.664899:0:15041:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d75285500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1876402802626304:12345-0@lo:13:osp-pre-0-0.0 Request processed in 117us (453us total) trans 0 rc 0/0 00000100:00100000:3.0:1789477535.664907:0:15041:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1789477535.664982:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d7bddf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1876402802626304:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1789477535.665169:0:14346:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1789477536.565750:0:14338:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1789477536.779689:0:6730:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of d98042a3-6618-44a7-81f9-5553c982b325 00000001:00100000:1.0:1789477536.779711:0:6730:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 43ab5f84-4c5e-451f-a8c7-1cb9f9e2bde0 00000100:00100000:2.0:1789477537.200343:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d7523e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1876402802626560:0@lo:400:kworker.0 00000100:00100000:2.0:1789477537.200469:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789477537.200554:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d7523df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3311:1876402802627072:0@lo:400:kworker.0 00000100:00100000:2.0:1789477537.200625:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789477537.200662:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1789477537.200669:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d7523ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:730ef4b7-dbd8-4cb5-9f31-5e7e04ae8864:3311:1876402802626432:0@lo:400:kworker.0 00000100:00100000:2.0:1789477537.200701:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789477537.200724:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d7523e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3311:1876402802626944:0@lo:400:kworker.0 00000100:00100000:2.0:1789477537.200753:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789477537.200783:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d7523ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1876402802626688:0@lo:400:kworker.0 00000100:00100000:2.0:1789477537.200809:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789477537.200831:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789477537.200836:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d7523d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3312:1876402802626816:0@lo:400:kworker.0 00000100:00100000:2.0:1789477537.200865:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789477537.200920:0:15039:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802626560 00000100:00100000:2.0:1789477537.200932:0:15039:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802626560 00000100:00100000:2.0:1789477537.201004:0:15039:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802626688 00000100:00100000:2.0:1789477537.201027:0:15039:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802626688 00000100:00100000:2.0:1789477537.201060:0:15039:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1789477537.201071:0:15039:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d7523d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3311:x1876402802626560:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789477537.201133:0:15039:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d7523d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3311:x1876402802626560:12345-0@lo:400:kworker.0 Request processed in 63us (665us total) trans 0 rc 0/0 00000100:00100000:2.0:1789477537.201142:0:15039:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1789477537.201163:0:15039:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1789477537.201170:0:15039:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d7c64d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3312:x1876402802626688:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789477537.201204:0:15039:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d7c64d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3312:x1876402802626688:12345-0@lo:400:kworker.0 Request processed in 35us (394us total) trans 0 rc 0/0 00000100:00100000:2.0:1789477537.201211:0:15039:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1789477537.201232:0:14350:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802627072 00000100:00100000:2.0:1789477537.201237:0:14350:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802627072 00000100:00100000:2.0:1789477537.201261:0:14350:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802626944 00000100:00100000:2.0:1789477537.201265:0:14350:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802626944 00000100:00100000:2.0:1789477537.201277:0:14350:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802626816 00000100:00100000:2.0:1789477537.201280:0:14350:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802626816 00000100:00100000:2.0:1789477537.201294:0:14350:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1789477537.201300:0:14350:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d7c64ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1876402802627072:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789477537.201332:0:14350:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d7c64ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1876402802627072:12345-0@lo:400:kworker.0 Request processed in 32us (707us total) trans 0 rc 0/0 00000100:00100000:2.0:1789477537.201339:0:14350:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1789477537.201350:0:14350:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1789477537.201356:0:14350:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d7c64e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1876402802626944:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789477537.201381:0:14350:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d7c64e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1876402802626944:12345-0@lo:400:kworker.0 Request processed in 25us (627us total) trans 0 rc 0/0 00000100:00100000:2.0:1789477537.201387:0:14350:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1789477537.201405:0:14350:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1789477537.201410:0:14350:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d7c64df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1876402802626816:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789477537.201441:0:14350:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d7c64df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1876402802626816:12345-0@lo:400:kworker.0 Request processed in 30us (579us total) trans 0 rc 0/0 00000100:00100000:2.0:1789477537.201446:0:14350:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00080000:2.0:1789477537.201480:0:14346:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789477537.201486:0:14346:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789477537.201488:0:14346:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789477537.201543:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d7523d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3312:1876402802626816:0@lo:400:kworker.0 00000100:00100000:2.0:1789477537.201557:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d7523ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1876402802626688:0@lo:400:kworker.0 00000100:00100000:2.0:1789477537.201654:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d7523e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3311:1876402802626944:0@lo:400:kworker.0 00000100:00100000:2.0:1789477537.201666:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d7523e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1876402802626560:0@lo:400:kworker.0 00000100:00100000:2.0:1789477537.201677:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d7523df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3311:1876402802627072:0@lo:400:kworker.0 00000100:00100000:0.0:1789477537.201958:0:14345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802626432 00000100:00100000:0.0:1789477537.201964:0:14345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802626432 00000100:00100000:0.0:1789477537.202011:0:14345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1789477537.202019:0:14345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d6ec5e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:730ef4b7-dbd8-4cb5-9f31-5e7e04ae8864+19:3311:x1876402802626432:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789477537.202073:0:14345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d6ec5e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:730ef4b7-dbd8-4cb5-9f31-5e7e04ae8864+19:3311:x1876402802626432:12345-0@lo:400:kworker.0 Request processed in 55us (1370us total) trans 0 rc 0/0 00000100:00100000:0.0:1789477537.202079:0:14345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1789477537.205004:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d7523ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:730ef4b7-dbd8-4cb5-9f31-5e7e04ae8864:3311:1876402802626432:0@lo:400:kworker.0 00000100:00100000:3.0:1789477537.208883:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d6d480e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1876402802627200:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789477537.208994:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789477537.209122:0:15041:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802627200 00000100:00100000:0.0:1789477537.209135:0:15041:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802627200 00000100:00100000:0.0:1789477537.209201:0:15041:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1789477537.209212:0:15041:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d7bddf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1876402802627200:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789477537.209260:0:15041:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789477537.209318:0:15041:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d7bddf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1876402802627200:12345-0@lo:13:osp-pre-1-0.0 Request processed in 108us (324us total) trans 0 rc 0/0 00000100:00100000:0.0:1789477537.209326:0:15041:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1789477537.209438:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d6d480e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1876402802627200:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1789477537.583937:0:15972:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1789477537.825630:0:5868:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 43ab5f84-4c5e-451f-a8c7-1cb9f9e2bde0 00000001:00100000:1.0:1789477537.825656:0:5868:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of d98042a3-6618-44a7-81f9-5553c982b325 00000001:00100000:0.0:1789477537.861103:0:7678:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of d98042a3-6618-44a7-81f9-5553c982b325 00000001:00100000:0.0:1789477537.861200:0:7678:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 43ab5f84-4c5e-451f-a8c7-1cb9f9e2bde0 00000001:02000400:0.0:1789477538.539510:0:16316:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:3.0:1789477538.607832:0:14339:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789477539.632476:0:14338:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789477540.330437:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:3.0:1789477540.330480:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:3.0:1789477540.330512:0:14343:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783762560 00000100:00100000:3.0:1789477540.330523:0:14343:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783762560 00000100:00100000:3.0:1789477540.330592:0:14343:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 105 00000100:00100000:3.0:1789477540.330603:0:14343:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d6ec5dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:41935ab2-fae2-41da-aaaf-b7b0ee59bf6c+13:2353:x1876402783762560:12345-192.168.201.23@tcp:400:kworker.0 00000100:00100000:3.0:1789477540.330683:0:14343:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d6ec5dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:41935ab2-fae2-41da-aaaf-b7b0ee59bf6c+13:2353:x1876402783762560:12345-192.168.201.23@tcp:400:kworker.0 Request processed in 83us (257us total) trans 0 rc 0/0 00000100:00100000:3.0:1789477540.330691:0:14343:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 105 00000100:00100000:3.0:1789477540.330725:0:14350:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783762688 00000100:00100000:3.0:1789477540.330729:0:14350:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783762688 00000100:00100000:3.0:1789477540.330768:0:14350:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 21 00000100:00100000:3.0:1789477540.330775:0:14350:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d7bddd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d98042a3-6618-44a7-81f9-5553c982b325+6:2353:x1876402783762688:12345-192.168.201.23@tcp:400:kworker.0 00000100:00100000:3.0:1789477540.330807:0:14350:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d7bddd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d98042a3-6618-44a7-81f9-5553c982b325+6:2353:x1876402783762688:12345-192.168.201.23@tcp:400:kworker.0 Request processed in 32us (326us total) trans 0 rc 0/0 00000100:00100000:3.0:1789477540.330814:0:14350:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 21 00000100:00080000:3.0:1789477540.330954:0:14346:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789477540.349076:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:1.0:1789477540.349109:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:1.0:1789477540.349159:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:1.0:1789477540.353680:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:1.0:1789477540.353720:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:3.0:1789477540.357423:0:15469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783762944 00000100:00100000:3.0:1789477540.357440:0:15469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783762944 00000100:00100000:3.0:1789477540.357527:0:15469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783763200 00000100:00100000:3.0:1789477540.357532:0:15469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783763200 00000100:00100000:3.0:1789477540.357548:0:15469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783762816 00000100:00100000:3.0:1789477540.357552:0:15469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783762816 00000100:00100000:3.0:1789477540.357573:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 7 00000100:00100000:3.0:1789477540.357602:0:15469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d75286d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d98042a3-6618-44a7-81f9-5553c982b325+5:2352:x1876402783762944:12345-192.168.201.23@tcp:400:kworker.0 00000100:00100000:3.0:1789477540.357686:0:15469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d75286d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d98042a3-6618-44a7-81f9-5553c982b325+5:2352:x1876402783762944:12345-192.168.201.23@tcp:400:kworker.0 Request processed in 86us (8625us total) trans 0 rc 0/0 00000100:00100000:3.0:1789477540.357714:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 7 00000100:00100000:3.0:1789477540.357733:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 8 00000100:00100000:3.0:1789477540.357740:0:15469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d75284380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:43ab5f84-4c5e-451f-a8c7-1cb9f9e2bde0+5:2352:x1876402783763200:12345-192.168.201.23@tcp:400:kworker.0 00000100:00100000:3.0:1789477540.357766:0:15469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d75284380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:43ab5f84-4c5e-451f-a8c7-1cb9f9e2bde0+5:2352:x1876402783763200:12345-192.168.201.23@tcp:400:kworker.0 Request processed in 27us (8656us total) trans 0 rc 0/0 00000100:00100000:3.0:1789477540.357773:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 8 00000100:00100000:3.0:1789477540.357784:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 9 00000100:00100000:3.0:1789477540.357791:0:15469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d75284000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d98042a3-6618-44a7-81f9-5553c982b325+5:2352:x1876402783762816:12345-192.168.201.23@tcp:400:kworker.0 00000100:00100000:3.0:1789477540.357816:0:15469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d75284000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d98042a3-6618-44a7-81f9-5553c982b325+5:2352:x1876402783762816:12345-192.168.201.23@tcp:400:kworker.0 Request processed in 27us (8658us total) trans 0 rc 0/0 00000100:00100000:3.0:1789477540.357822:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 9 00000100:00080000:3.0:1789477540.357859:0:14346:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789477540.357863:0:14346:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789477540.360574:0:15469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783763328 00000100:00100000:3.0:1789477540.360605:0:15469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783763328 00000100:00100000:3.0:1789477540.360676:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 10 00000100:00100000:3.0:1789477540.360687:0:15469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d75284a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:43ab5f84-4c5e-451f-a8c7-1cb9f9e2bde0+5:2352:x1876402783763328:12345-192.168.201.23@tcp:400:kworker.0 00000100:00100000:3.0:1789477540.360768:0:15469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d75284a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:43ab5f84-4c5e-451f-a8c7-1cb9f9e2bde0+5:2352:x1876402783763328:12345-192.168.201.23@tcp:400:kworker.0 Request processed in 83us (7047us total) trans 0 rc 0/0 00000100:00100000:3.0:1789477540.360774:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 10 00000100:00080000:3.0:1789477540.360903:0:14346:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789477540.361343:0:14351:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783763072 00000100:00100000:2.0:1789477540.361348:0:14351:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783763072 00000100:00100000:2.0:1789477540.361377:0:14351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 22 00000100:00100000:2.0:1789477540.361382:0:14351:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d75285880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:43ab5f84-4c5e-451f-a8c7-1cb9f9e2bde0+6:2352:x1876402783763072:12345-192.168.201.23@tcp:400:kworker.0 00000100:00100000:2.0:1789477540.361413:0:14351:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d75285880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:43ab5f84-4c5e-451f-a8c7-1cb9f9e2bde0+6:2352:x1876402783763072:12345-192.168.201.23@tcp:400:kworker.0 Request processed in 31us (7747us total) trans 0 rc 0/0 00000100:00100000:2.0:1789477540.361417:0:14351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 22 00000100:00080000:3.0:1789477540.362232:0:14346:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1789477540.664914:0:15972:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789477540.784735:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789477540.784766:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d7bddc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1876402802627328:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789477540.784886:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789477540.785780:0:15041:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802627328 00000100:00100000:0.0:1789477540.785790:0:15041:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802627328 00000100:00100000:0.0:1789477540.785879:0:15041:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1789477540.785890:0:15041:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d7bddfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1876402802627328:12345-0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1789477540.785919:0:14346:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00000024:0.0:1789477540.785932:0:15041:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789477540.786014:0:15041:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d7bddfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1876402802627328:12345-0@lo:13:osp-pre-0-0.0 Request processed in 126us (1129us total) trans 0 rc 0/0 00000100:00100000:0.0:1789477540.786032:0:15041:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1789477540.786068:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d7bddc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1876402802627328:0@lo:13:osp-pre-0-0.0 00000040:00080000:3.0:1789477541.104554:0:14385:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1789477541.681853:0:14339:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789477542.322298:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789477542.322349:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d6d482680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1876402802627456:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789477542.322456:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789477542.323226:0:15041:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802627456 00000100:00100000:0.0:1789477542.323240:0:15041:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802627456 00000100:00100000:0.0:1789477542.323344:0:15041:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1789477542.323358:0:15041:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d7bddc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1876402802627456:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789477542.323410:0:15041:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789477542.323492:0:15041:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d7bddc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1876402802627456:12345-0@lo:13:osp-pre-1-0.0 Request processed in 136us (1035us total) trans 0 rc 0/0 00000100:00100000:0.0:1789477542.323500:0:15041:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00080000:3.0:1789477542.323893:0:14346:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789477542.323963:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d6d482680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1876402802627456:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789477542.334417:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d6d480e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3313:1876402802627840:0@lo:400:kworker.0 00000100:00100000:0.0:1789477542.334519:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789477542.334592:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789477542.334599:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d6d482680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1876402802627712:0@lo:400:kworker.0 00000100:00100000:0.0:1789477542.334629:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789477542.334676:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d7c1f8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3310:1876402802627968:0@lo:400:kworker.0 00000100:00100000:0.0:1789477542.334702:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789477542.334733:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1789477542.334739:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d6d480700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:730ef4b7-dbd8-4cb5-9f31-5e7e04ae8864:3310:1876402802627584:0@lo:400:kworker.0 00000100:00100000:0.0:1789477542.334774:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789477542.334801:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d7c1faa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3310:1876402802628096:0@lo:400:kworker.0 00000100:00100000:0.0:1789477542.334844:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789477542.334877:0:14344:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802627584 00000100:00100000:0.0:1789477542.334889:0:14344:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802627584 00000100:00100000:0.0:1789477542.334967:0:14344:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1789477542.334977:0:14344:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d6ec5fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:730ef4b7-dbd8-4cb5-9f31-5e7e04ae8864+19:3310:x1876402802627584:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789477542.335053:0:14344:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d6ec5fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:730ef4b7-dbd8-4cb5-9f31-5e7e04ae8864+19:3310:x1876402802627584:12345-0@lo:400:kworker.0 Request processed in 76us (277us total) trans 0 rc 0/0 00000100:00100000:0.0:1789477542.335061:0:14344:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1789477542.335124:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d6d480700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:730ef4b7-dbd8-4cb5-9f31-5e7e04ae8864:3310:1876402802627584:0@lo:400:kworker.0 00000100:00100000:2.0:1789477542.335534:0:14351:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802627840 00000100:00100000:2.0:1789477542.335540:0:14351:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802627840 00000100:00100000:2.0:1789477542.335628:0:14351:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802627968 00000100:00100000:2.0:1789477542.335632:0:14351:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802627968 00000100:00100000:2.0:1789477542.335661:0:14351:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802628096 00000100:00100000:2.0:1789477542.335664:0:14351:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802628096 00000100:00100000:2.0:1789477542.335678:0:14351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1789477542.335685:0:14351:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d7c1f9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1876402802627840:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789477542.335743:0:14351:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d7c1f9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1876402802627840:12345-0@lo:400:kworker.0 Request processed in 59us (1225us total) trans 0 rc 0/0 00000100:00100000:2.0:1789477542.335751:0:14351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1789477542.335766:0:14351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1789477542.335773:0:14351:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d7c1f8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1876402802627968:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789477542.335818:0:14351:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d7c1f8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1876402802627968:12345-0@lo:400:kworker.0 Request processed in 33us (1101us total) trans 0 rc 0/0 00000100:00100000:2.0:1789477542.335825:0:14351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1789477542.335838:0:14351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1789477542.335844:0:14351:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d7c1f9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1876402802628096:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789477542.335872:0:14351:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d7c1f9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1876402802628096:12345-0@lo:400:kworker.0 Request processed in 28us (1027us total) trans 0 rc 0/0 00000100:00100000:2.0:1789477542.335878:0:14351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1789477542.335911:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d6d480e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3313:1876402802627840:0@lo:400:kworker.0 00000100:00080000:1.0:1789477542.335995:0:14346:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789477542.337223:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d7c1faa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3310:1876402802628096:0@lo:400:kworker.0 00000100:00100000:0.0:1789477542.337243:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d7c1f8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3310:1876402802627968:0@lo:400:kworker.0 00000100:00100000:2.0:1789477542.339699:0:15469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802627712 00000100:00100000:2.0:1789477542.339724:0:15469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802627712 00000100:00100000:2.0:1789477542.339832:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1789477542.339846:0:15469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d7c1fb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3313:x1876402802627712:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789477542.339982:0:15469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d7c1fb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3313:x1876402802627712:12345-0@lo:400:kworker.0 Request processed in 138us (5350us total) trans 0 rc 0/0 00000100:00100000:2.0:1789477542.340008:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1789477542.340071:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d6d482680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1876402802627712:0@lo:400:kworker.0 00000100:00080000:0.0:1789477542.341445:0:14346:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1789477542.710201:0:14338:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1789477542.795318:0:16465:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffe6f6fae50 20000000:00000080:2.0:1789477542.795344:0:16465:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9d0d503bdc00 uarg=0000000000000000 20000000:01000000:2.0:1789477542.795390:0:16465:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:2.0:1789477542.795398:0:16465:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:2.0:1789477542.795404:0:16465:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:1.0:1789477542.798040:0:16466:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 10 20000000:00000400:2.0:1789477542.798343:0:16465:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:2.0:1789477542.815779:0:16465:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1789477542.815839:0:16465:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9d0d50417200/0xafddb3c8f9282ab6 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477542.815858:0:16465:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9d0d50be5400/0xafddb3c8f92827ad lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xafddb3c8f92827a6 expref: 18 pid: 14343 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477542.815867:0:16465:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9d0d50be5600/0xafddb3c8f92827fa lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xafddb3c8f92827f3 expref: 18 pid: 14344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477542.815875:0:16465:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9d0d50be5000/0xafddb3c8f9282935 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xafddb3c8f928292e expref: 18 pid: 14343 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477542.815885:0:16465:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9d0d41647c00/0xafddb3c8f9282a54 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2ea2 expref: 12 pid: 14345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477542.815893:0:16465:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9d0d50416000/0xafddb3c8f9282a8c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2f04 expref: 12 pid: 14343 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477542.815901:0:16465:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9d0d50417200/0xafddb3c8f9282ab6 lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 16465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477542.815959:0:16465:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9d0d50416000/0xafddb3c8f9282a8c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2f04 expref: 12 pid: 14343 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477542.815976:0:16465:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9d0d50416000/0xafddb3c8f9282a8c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2f04 expref: 12 pid: 14343 timeout: 587 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789477542.815992:0:16465:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d7c64e300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16465:1876402802628224:192.168.201.23@tcp:104: 00010000:00010000:2.0:1789477542.816110:0:16465:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9d0d41647c00/0xafddb3c8f9282a54 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2ea2 expref: 12 pid: 14345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477542.816120:0:16465:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9d0d41647c00/0xafddb3c8f9282a54 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2ea2 expref: 12 pid: 14345 timeout: 587 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789477542.816129:0:16465:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d7c64ed80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16465:1876402802628352:192.168.201.23@tcp:104: 00010000:00010000:2.0:1789477542.816161:0:16465:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9d0d50be5000/0xafddb3c8f9282935 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xafddb3c8f928292e expref: 18 pid: 14343 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477542.816170:0:16465:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9d0d50be5000/0xafddb3c8f9282935 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xafddb3c8f928292e expref: 18 pid: 14343 timeout: 587 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789477542.816180:0:16465:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d7c64ce00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16465:1876402802628480:0@lo:104: 00000100:00100000:2.0:1789477542.816220:0:16465:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789477542.816265:0:16465:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9d0d50be5600/0xafddb3c8f92827fa lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xafddb3c8f92827f3 expref: 18 pid: 14344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477542.816273:0:16465:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9d0d50be5600/0xafddb3c8f92827fa lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xafddb3c8f92827f3 expref: 18 pid: 14344 timeout: 587 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789477542.816293:0:16465:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d7c64f100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16465:1876402802628608:0@lo:104: 00000100:00100000:2.0:1789477542.816317:0:16465:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789477542.816360:0:14334:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802628480 00000100:00100000:2.0:1789477542.816368:0:14334:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802628480 00000100:00100000:2.0:1789477542.816408:0:14334:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802628608 00000100:00100000:2.0:1789477542.816411:0:14334:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802628608 00000100:00100000:2.0:1789477542.816426:0:14334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1789477542.816434:0:14334:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d7c64d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:730ef4b7-dbd8-4cb5-9f31-5e7e04ae8864+4:16465:x1876402802628480:12345-0@lo:104: 00010000:00010000:2.0:1789477542.816448:0:14334:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.123@tcp lock: ffff9d0d50be4c00/0xafddb3c8f928292e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xafddb3c8f9282935 expref: -99 pid: 15755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477542.816493:0:14334:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1789477542.816499:0:14334:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d7c64d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:730ef4b7-dbd8-4cb5-9f31-5e7e04ae8864+4:16465:x1876402802628480:12345-0@lo:104: Request processed in 66us (279us total) trans 0 rc 0/0 00000100:00100000:2.0:1789477542.816507:0:14334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1789477542.816524:0:14334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1789477542.816530:0:14334:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d7c64dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:730ef4b7-dbd8-4cb5-9f31-5e7e04ae8864+3:16465:x1876402802628608:12345-0@lo:104: 00010000:00010000:2.0:1789477542.816538:0:14334:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.123@tcp lock: ffff9d0d50416200/0xafddb3c8f92827f3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xafddb3c8f92827fa expref: -99 pid: 15036 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477542.816566:0:14334:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1789477542.816571:0:14334:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d7c64dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:730ef4b7-dbd8-4cb5-9f31-5e7e04ae8864+3:16465:x1876402802628608:12345-0@lo:104: Request processed in 42us (255us total) trans 0 rc 0/0 00000100:00100000:2.0:1789477542.816604:0:14334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00010000:2.0:1789477542.816635:0:16465:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9d0d50be5400/0xafddb3c8f92827ad lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xafddb3c8f92827a6 expref: 18 pid: 14343 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477542.816654:0:16465:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9d0d50be5400/0xafddb3c8f92827ad lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xafddb3c8f92827a6 expref: 18 pid: 14343 timeout: 587 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789477542.816663:0:16465:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d7c64ea00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16465:1876402802628736:0@lo:104: 00000100:00100000:2.0:1789477542.816691:0:16465:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789477542.816718:0:14334:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1789477542.816727:0:14334:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802628736 00000100:00100000:2.0:1789477542.816731:0:14334:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802628736 00000100:00100000:2.0:1789477542.816748:0:14334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1789477542.816753:0:14334:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d5801b850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:730ef4b7-dbd8-4cb5-9f31-5e7e04ae8864+3:16465:x1876402802628736:12345-0@lo:104: 00010000:00010000:2.0:1789477542.816762:0:14334:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.123@tcp lock: ffff9d0d50be4000/0xafddb3c8f92827a6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xafddb3c8f92827ad expref: -99 pid: 14347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477542.816793:0:14334:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00010000:00010000:1.0:1789477542.817759:0:14339:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1789477542.817775:0:14339:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.123@tcp lock: ffff9d0d50be4c00/0xafddb3c8f928292e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xafddb3c8f9282935 expref: -99 pid: 15755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477542.817787:0:14339:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d0d50be4c00 already unused, calling callback (ffffffffc1bb3c20) 10000000:00010000:1.0:1789477542.817792:0:14339:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.123@tcp lock: ffff9d0d50be4c00/0xafddb3c8f928292e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xafddb3c8f9282935 expref: -99 pid: 15755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477542.817816:0:14339:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.123@tcp lock: ffff9d0d50be4c00/0xafddb3c8f928292e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xafddb3c8f9282935 expref: -99 pid: 15755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789477542.817824:0:14339:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.123@tcp lock: ffff9d0d50be4c00/0xafddb3c8f928292e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xafddb3c8f9282935 expref: -99 pid: 15755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789477542.817849:0:14339:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1789477542.817906:0:14339:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.123@tcp lock: ffff9d0d50be4c00/0xafddb3c8f928292e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xafddb3c8f9282935 expref: -99 pid: 15755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477542.817914:0:14339:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789477542.817945:0:14339:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.123@tcp lock: ffff9d0d50be4c00/0xafddb3c8f928292e lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xafddb3c8f9282935 expref: -99 pid: 15755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477542.817961:0:14339:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.123@tcp lock: ffff9d0d50be4c00/0xafddb3c8f928292e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xafddb3c8f9282935 expref: -99 pid: 15755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477542.817978:0:14339:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1789477542.817982:0:14339:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.123@tcp lock: ffff9d0d50416200/0xafddb3c8f92827f3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xafddb3c8f92827fa expref: -99 pid: 15036 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477542.817988:0:14339:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d0d50416200 already unused, calling callback (ffffffffc1bb3c20) 10000000:00010000:1.0:1789477542.817991:0:14339:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.123@tcp lock: ffff9d0d50416200/0xafddb3c8f92827f3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xafddb3c8f92827fa expref: -99 pid: 15036 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477542.817997:0:14339:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.123@tcp lock: ffff9d0d50416200/0xafddb3c8f92827f3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xafddb3c8f92827fa expref: -99 pid: 15036 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789477542.818004:0:14339:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.123@tcp lock: ffff9d0d50416200/0xafddb3c8f92827f3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xafddb3c8f92827fa expref: -99 pid: 15036 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789477542.818009:0:14339:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1789477542.818025:0:14339:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.123@tcp lock: ffff9d0d50416200/0xafddb3c8f92827f3 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xafddb3c8f92827fa expref: -99 pid: 15036 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477542.818032:0:14339:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789477542.818045:0:14339:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.123@tcp lock: ffff9d0d50416200/0xafddb3c8f92827f3 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xafddb3c8f92827fa expref: -99 pid: 15036 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477542.818052:0:14339:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.123@tcp lock: ffff9d0d50416200/0xafddb3c8f92827f3 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xafddb3c8f92827fa expref: -99 pid: 15036 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477542.818063:0:14339:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789477542.818066:0:14339:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.123@tcp lock: ffff9d0d50be4000/0xafddb3c8f92827a6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xafddb3c8f92827ad expref: -99 pid: 14347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477542.818073:0:14339:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d0d50be4000 already unused, calling callback (ffffffffc1bb3c20) 10000000:00010000:1.0:1789477542.818076:0:14339:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.123@tcp lock: ffff9d0d50be4000/0xafddb3c8f92827a6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xafddb3c8f92827ad expref: -99 pid: 14347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477542.818083:0:14339:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.123@tcp lock: ffff9d0d50be4000/0xafddb3c8f92827a6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xafddb3c8f92827ad expref: -99 pid: 14347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789477542.818090:0:14339:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.123@tcp lock: ffff9d0d50be4000/0xafddb3c8f92827a6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xafddb3c8f92827ad expref: -99 pid: 14347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789477542.818095:0:14339:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1789477542.818109:0:14339:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.123@tcp lock: ffff9d0d50be4000/0xafddb3c8f92827a6 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xafddb3c8f92827ad expref: -99 pid: 14347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477542.818115:0:14339:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789477542.818132:0:14339:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.123@tcp lock: ffff9d0d50be4000/0xafddb3c8f92827a6 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xafddb3c8f92827ad expref: -99 pid: 14347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477542.818138:0:14339:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.123@tcp lock: ffff9d0d50be4000/0xafddb3c8f92827a6 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xafddb3c8f92827ad expref: -99 pid: 14347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477542.818162:0:14339:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789477542.818164:0:14339:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789477542.818165:0:14339:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789477542.818188:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d75284700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:730ef4b7-dbd8-4cb5-9f31-5e7e04ae8864:3312:1876402802628864:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789477542.818256:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789477542.818310:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789477542.818316:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d75284e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:730ef4b7-dbd8-4cb5-9f31-5e7e04ae8864:3312:1876402802628992:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789477542.818341:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789477542.818381:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789477542.818394:0:14334:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d5801b850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:730ef4b7-dbd8-4cb5-9f31-5e7e04ae8864+3:16465:x1876402802628736:12345-0@lo:104: Request processed in 1624us (1686us total) trans 0 rc 0/0 00000100:00100000:1.0:1789477542.818394:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d75286680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:730ef4b7-dbd8-4cb5-9f31-5e7e04ae8864:3311:1876402802629120:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789477542.818418:0:14334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1789477542.818440:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789477542.818486:0:14336:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802628864 00000100:00100000:1.0:1789477542.818494:0:14336:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802628864 00010000:00010000:2.0:1789477542.818505:0:14338:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789477542.818532:0:14336:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9d0d50be5000/0xafddb3c8f9282935 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xafddb3c8f928292e expref: 19 pid: 14343 timeout: 587 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789477542.818547:0:16465:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d0d58576180 going to sleep for 11 seconds 00000100:00100000:1.0:1789477542.818561:0:14336:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802628992 00000100:00100000:1.0:1789477542.818566:0:14336:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802628992 00010000:00010000:3.0:1789477542.818689:0:15972:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789477542.818979:0:14335:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802629120 00000100:00100000:3.0:1789477542.818986:0:14335:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802629120 00010000:00010000:3.0:1789477542.819007:0:14335:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9d0d50be5400/0xafddb3c8f92827ad lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xafddb3c8f92827a6 expref: 21 pid: 14343 timeout: 587 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789477542.819026:0:14335:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1789477542.819035:0:14335:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d75287100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:730ef4b7-dbd8-4cb5-9f31-5e7e04ae8864+21:3312:x1876402802628864:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789477542.819052:0:14335:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789477542.819058:0:14335:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9d0d50be5000/0xafddb3c8f9282935 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xafddb3c8f928292e expref: 21 pid: 14343 timeout: 587 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477542.819068:0:14335:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9d0d50be5000/0xafddb3c8f9282935 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xafddb3c8f928292e expref: 21 pid: 14343 timeout: 587 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477542.819089:0:14335:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789477542.819139:0:14335:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d75287100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:730ef4b7-dbd8-4cb5-9f31-5e7e04ae8864+21:3312:x1876402802628864:12345-0@lo:103:ldlm_bl.0 Request processed in 104us (882us total) trans 0 rc 0/0 00000100:00100000:3.0:1789477542.819146:0:14335:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1789477542.819176:0:14335:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1789477542.819183:0:14335:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d47782850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:730ef4b7-dbd8-4cb5-9f31-5e7e04ae8864+20:3311:x1876402802629120:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789477542.819191:0:14335:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789477542.819196:0:14335:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9d0d50be5400/0xafddb3c8f92827ad lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xafddb3c8f92827a6 expref: 20 pid: 14343 timeout: 587 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477542.819205:0:14335:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9d0d50be5400/0xafddb3c8f92827ad lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xafddb3c8f92827a6 expref: 20 pid: 14343 timeout: 587 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477542.819215:0:14335:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789477542.819243:0:14335:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d47782850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:730ef4b7-dbd8-4cb5-9f31-5e7e04ae8864+20:3311:x1876402802629120:12345-0@lo:103:ldlm_bl.0 Request processed in 60us (807us total) trans 0 rc 0/0 00000100:00100000:3.0:1789477542.819249:0:14335:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1789477542.819302:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d75284700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:730ef4b7-dbd8-4cb5-9f31-5e7e04ae8864:3312:1876402802628864:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789477542.819566:0:14336:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9d0d50be5600/0xafddb3c8f92827fa lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xafddb3c8f92827f3 expref: 19 pid: 14344 timeout: 587 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789477542.819617:0:14336:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1789477542.819625:0:14336:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d75285c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:730ef4b7-dbd8-4cb5-9f31-5e7e04ae8864+19:3312:x1876402802628992:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789477542.819633:0:14336:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789477542.819637:0:14336:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9d0d50be5600/0xafddb3c8f92827fa lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xafddb3c8f92827f3 expref: 19 pid: 14344 timeout: 587 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477542.819658:0:14336:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9d0d50be5600/0xafddb3c8f92827fa lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xafddb3c8f92827f3 expref: 19 pid: 14344 timeout: 587 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477542.819668:0:14336:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789477542.819703:0:14336:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d75285c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:730ef4b7-dbd8-4cb5-9f31-5e7e04ae8864+19:3312:x1876402802628992:12345-0@lo:103:ldlm_bl.0 Request processed in 79us (1362us total) trans 0 rc 0/0 00000100:00100000:1.0:1789477542.819710:0:14336:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1789477542.819783:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d75286680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:730ef4b7-dbd8-4cb5-9f31-5e7e04ae8864:3311:1876402802629120:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789477542.819819:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d75284e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:730ef4b7-dbd8-4cb5-9f31-5e7e04ae8864:3312:1876402802628992:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789477542.824220:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:3.0:1789477542.824274:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00010000:00010000:2.0:1789477542.824301:0:16465:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d0d50be5000/0xafddb3c8f9282935 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xafddb3c8f928292e expref: 18 pid: 14343 timeout: 587 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789477542.824325:0:16465:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d7c64ce00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16465:1876402802628480:0@lo:104: 00010000:00010000:2.0:1789477542.824360:0:16465:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d0d50be5600/0xafddb3c8f92827fa lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xafddb3c8f92827f3 expref: 17 pid: 14344 timeout: 587 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789477542.824370:0:16465:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d7c64f100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16465:1876402802628608:0@lo:104: 00010000:00010000:2.0:1789477542.824416:0:16465:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d0d50be5400/0xafddb3c8f92827ad lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xafddb3c8f92827a6 expref: 16 pid: 14343 timeout: 587 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789477542.824426:0:16465:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d7c64ea00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16465:1876402802628736:0@lo:104: 00000100:00100000:2.0:1789477542.824447:0:16465:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d7c64e300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16465:1876402802628224:192.168.201.23@tcp:104: 00000100:00100000:2.0:1789477542.824461:0:16465:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d7c64ed80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16465:1876402802628352:192.168.201.23@tcp:104: 00010000:00010000:2.0:1789477542.824509:0:16465:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9d0d50417200/0xafddb3c8f9282ab6 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 16465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789477542.825384:0:14336:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783763456 00000100:00100000:0.0:1789477542.825399:0:14336:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783763456 00010000:00010000:0.0:1789477542.825455:0:14336:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9d0d50416000/0xafddb3c8f9282a8c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2f04 expref: 13 pid: 14343 timeout: 587 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789477542.825495:0:14336:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783763584 00000100:00100000:0.0:1789477542.825498:0:14336:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783763584 00010000:00010000:0.0:1789477542.825512:0:14336:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9d0d41647c00/0xafddb3c8f9282a54 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2ea2 expref: 14 pid: 14345 timeout: 587 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789477542.825526:0:14336:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 7 00000100:00100000:0.0:1789477542.825537:0:14336:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d7bddd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:41935ab2-fae2-41da-aaaf-b7b0ee59bf6c+14:2355:x1876402783763456:12345-192.168.201.23@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789477542.825557:0:14336:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789477542.825566:0:14336:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9d0d50416000/0xafddb3c8f9282a8c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2f04 expref: 14 pid: 14343 timeout: 587 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789477542.825574:0:14335:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00010000:00010000:0.0:1789477542.825605:0:14336:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9d0d50416000/0xafddb3c8f9282a8c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2f04 expref: 14 pid: 14343 timeout: 587 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789477542.825615:0:14335:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00010000:00010000:0.0:1789477542.825636:0:14336:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d0d50416000/0xafddb3c8f9282a8c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2f04 expref: 14 pid: 14343 timeout: 587 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477542.825676:0:14336:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789477542.825754:0:14336:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d7bddd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:41935ab2-fae2-41da-aaaf-b7b0ee59bf6c+13:2355:x1876402783763456:12345-192.168.201.23@tcp:103:ldlm_bl.0 Request processed in 218us (1551us total) trans 0 rc 0/0 00000100:00100000:0.0:1789477542.825763:0:14336:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 7 00000100:00100000:0.0:1789477542.825792:0:14336:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 8 00000100:00100000:0.0:1789477542.825811:0:14336:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d7bdde680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:41935ab2-fae2-41da-aaaf-b7b0ee59bf6c+12:2355:x1876402783763584:12345-192.168.201.23@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789477542.825820:0:14336:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789477542.825824:0:14336:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9d0d41647c00/0xafddb3c8f9282a54 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2ea2 expref: 12 pid: 14345 timeout: 587 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477542.825835:0:14336:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9d0d41647c00/0xafddb3c8f9282a54 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2ea2 expref: 12 pid: 14345 timeout: 587 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477542.825846:0:14336:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d0d41647c00/0xafddb3c8f9282a54 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2ea2 expref: 12 pid: 14345 timeout: 587 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477542.825861:0:14336:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9d0d50417200/0xafddb3c8f9282ab6 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 16465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477542.825869:0:14336:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d0d50417200/0xafddb3c8f9282ab6 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 16465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477542.825888:0:14336:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9d0d50417200/0xafddb3c8f9282ab6 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 16465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477542.825896:0:14336:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9d0d50417200/0xafddb3c8f9282ab6 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 16465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477542.825915:0:14336:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9d0d50417200/0xafddb3c8f9282ab6 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 16465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477542.825924:0:14336:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9d0d50417200/0xafddb3c8f9282ab6 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 16465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477542.825932:0:14336:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d0d50417200 already unused, calling callback (ffffffffc15972a0) 00010000:00010000:0.0:1789477542.825936:0:14336:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9d0d50417200/0xafddb3c8f9282ab6 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 16465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477542.825946:0:14336:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9d0d50417200/0xafddb3c8f9282ab6 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 16465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477542.825982:0:14336:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9d0d50417200/0xafddb3c8f9282ab6 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477542.825995:0:14336:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789477542.826032:0:14336:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d7bdde680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:41935ab2-fae2-41da-aaaf-b7b0ee59bf6c+11:2355:x1876402783763584:12345-192.168.201.23@tcp:103:ldlm_bl.0 Request processed in 222us (1757us total) trans 0 rc 0/0 00000100:00100000:0.0:1789477542.826039:0:14336:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 8 00010000:00010000:2.0:1789477542.826289:0:16465:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9d0d50417200/0xafddb3c8f9282ab6 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477542.826313:0:16465:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9d0d50417200/0xafddb3c8f9282ab6 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477542.826320:0:16465:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d0d50417200/0xafddb3c8f9282ab6 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477543.729475:0:14339:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1789477544.496730:0:14347:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1789477544.496740:0:14347:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9d0d47667000 from 10 10000000:01000000:1.0:1789477544.496746:0:14347:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1789477544.496829:0:14347:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.123@tcp lock: ffff9d0d7f519000/0xafddb3c8f9282abd lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477544.496844:0:14347:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.123@tcp lock: ffff9d0d7f519000/0xafddb3c8f9282abd lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477544.496857:0:14347:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.123@tcp lock: ffff9d0d7f519000/0xafddb3c8f9282abd lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789477544.496890:0:14347:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d75284e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:730ef4b7-dbd8-4cb5-9f31-5e7e04ae8864:14347:1876402802629248:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789477544.497002:0:14347:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789477544.497195:0:14347:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d0d585b20c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789477544.497972:0:14345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802629248 00000100:00100000:3.0:1789477544.497985:0:14345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802629248 00000100:00100000:3.0:1789477544.498110:0:14345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1789477544.498123:0:14345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d6ec5f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:730ef4b7-dbd8-4cb5-9f31-5e7e04ae8864+16:14347:x1876402802629248:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789477544.498142:0:14345:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789477544.498163:0:14345:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d0d41647600/0xafddb3c8f9282ac4 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xafddb3c8f9282abd expref: -99 pid: 14345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477544.498193:0:14345:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d0d41647600/0xafddb3c8f9282ac4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xafddb3c8f9282abd expref: 17 pid: 14345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477544.498204:0:14345:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d0d41647600/0xafddb3c8f9282ac4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xafddb3c8f9282abd expref: 17 pid: 14345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477544.498232:0:14345:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d0d41647600, rc 0) 00000100:00100000:3.0:1789477544.498318:0:14345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d6ec5f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:730ef4b7-dbd8-4cb5-9f31-5e7e04ae8864+17:14347:x1876402802629248:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 198us (1316us total) trans 0 rc 0/0 00000100:00100000:3.0:1789477544.498325:0:14345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1789477544.498420:0:14347:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d75284e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:730ef4b7-dbd8-4cb5-9f31-5e7e04ae8864:14347:1876402802629248:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789477544.498439:0:14347:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.123@tcp lock: ffff9d0d7f519000/0xafddb3c8f9282abd lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xafddb3c8f9282ac4 expref: -99 pid: 14347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477544.498457:0:14347:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.123@tcp lock: ffff9d0d7f519000/0xafddb3c8f9282abd lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xafddb3c8f9282ac4 expref: -99 pid: 14347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789477544.498552:0:14347:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d75284e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:730ef4b7-dbd8-4cb5-9f31-5e7e04ae8864:14347:1876402802629376:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789477544.498620:0:14347:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789477544.513879:0:14345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802629376 00000100:00100000:3.0:1789477544.513903:0:14345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802629376 00000100:00100000:0.0:1789477544.520812:0:14344:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1789477544.520842:0:14344:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d6ec55050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:730ef4b7-dbd8-4cb5-9f31-5e7e04ae8864+17:14347:x1876402802629376:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789477544.524719:0:14347:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d0d585b20c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789477544.526427:0:14344:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d6ec55050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:730ef4b7-dbd8-4cb5-9f31-5e7e04ae8864+17:14347:x1876402802629376:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 5588us (27796us total) trans 0 rc 0/0 00000100:00100000:0.0:1789477544.526444:0:14344:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1789477544.526650:0:14347:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d75284e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:730ef4b7-dbd8-4cb5-9f31-5e7e04ae8864:14347:1876402802629376:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789477544.526726:0:14347:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d7c1f8a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:730ef4b7-dbd8-4cb5-9f31-5e7e04ae8864:14347:1876402802629504:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789477544.526806:0:14347:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789477544.526844:0:14347:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d0d510aba80 going to sleep for 11 seconds 00000100:00100000:0.0:1789477544.526864:0:14344:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802629504 00000100:00100000:0.0:1789477544.526872:0:14344:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802629504 00000100:00100000:0.0:1789477544.526917:0:14344:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1789477544.527194:0:14344:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d6ec54850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:730ef4b7-dbd8-4cb5-9f31-5e7e04ae8864+17:14347:x1876402802629504:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789477544.529446:0:14344:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d6ec54850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:730ef4b7-dbd8-4cb5-9f31-5e7e04ae8864+17:14347:x1876402802629504:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 2245us (2627us total) trans 0 rc 0/0 00000100:00100000:3.0:1789477544.529664:0:14347:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d7c1f8a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:730ef4b7-dbd8-4cb5-9f31-5e7e04ae8864:14347:1876402802629504:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789477544.530204:0:14344:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000040:00080000:0.0:1789477544.544198:0:16524:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:3.0:1789477544.546406:0:14347:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:3.0:1789477544.546457:0:14347:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.123@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1789477544.551557:0:14347:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.123@tcp lock: ffff9d0d7f519000/0xafddb3c8f9282abd lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xafddb3c8f9282ac4 expref: -99 pid: 14347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477544.551596:0:14347:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.123@tcp lock: ffff9d0d7f519000/0xafddb3c8f9282abd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xafddb3c8f9282ac4 expref: -99 pid: 14347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789477544.551616:0:14347:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1789477544.551620:0:14347:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9d0d7c06e000 from 10 10000000:01000000:3.0:1789477544.551624:0:14347:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1789477544.551691:0:14347:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.123@tcp lock: ffff9d0d41646c00/0xafddb3c8f9282acb lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477544.551700:0:14347:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.123@tcp lock: ffff9d0d41646c00/0xafddb3c8f9282acb lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477544.551714:0:14347:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.123@tcp lock: ffff9d0d41646c00/0xafddb3c8f9282acb lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789477544.551750:0:14347:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d7bddd500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:730ef4b7-dbd8-4cb5-9f31-5e7e04ae8864:14347:1876402802629632:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789477544.551883:0:14347:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789477544.551961:0:14347:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d0d7f6e0e40 going to sleep for 11 seconds 00000100:00100000:0.0:1789477544.568227:0:14345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802629632 00000100:00100000:0.0:1789477544.568248:0:14345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802629632 00000100:00100000:0.0:1789477544.568368:0:14344:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1789477544.568382:0:14344:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d6ec56850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:730ef4b7-dbd8-4cb5-9f31-5e7e04ae8864+17:14347:x1876402802629632:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789477544.568404:0:14344:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789477544.568431:0:14344:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d0d50be4c00/0xafddb3c8f9282ad2 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xafddb3c8f9282acb expref: -99 pid: 14344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477544.568480:0:14344:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d0d50be4c00/0xafddb3c8f9282ad2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xafddb3c8f9282acb expref: 18 pid: 14344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477544.568494:0:14344:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d0d50be4c00/0xafddb3c8f9282ad2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xafddb3c8f9282acb expref: 18 pid: 14344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477544.568506:0:14344:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d0d50be4c00, rc 0) 00000100:00100000:0.0:1789477544.568638:0:14344:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d6ec56850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:730ef4b7-dbd8-4cb5-9f31-5e7e04ae8864+18:14347:x1876402802629632:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 259us (16755us total) trans 0 rc 0/0 00000100:00100000:0.0:1789477544.568646:0:14344:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1789477544.569724:0:14347:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d7bddd500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:730ef4b7-dbd8-4cb5-9f31-5e7e04ae8864:14347:1876402802629632:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789477544.569754:0:14347:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.123@tcp lock: ffff9d0d41646c00/0xafddb3c8f9282acb lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xafddb3c8f9282ad2 expref: -99 pid: 14347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477544.569778:0:14347:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.123@tcp lock: ffff9d0d41646c00/0xafddb3c8f9282acb lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xafddb3c8f9282ad2 expref: -99 pid: 14347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789477544.569879:0:14347:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d7bddd500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:730ef4b7-dbd8-4cb5-9f31-5e7e04ae8864:14347:1876402802629760:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789477544.571217:0:14347:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789477544.573447:0:14347:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d0d7f6e0e40 going to sleep for 11 seconds 00000100:00100000:0.0:1789477544.581419:0:14343:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802629760 00000100:00100000:0.0:1789477544.581444:0:14343:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802629760 00000100:00100000:0.0:1789477544.583619:0:14343:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1789477544.583649:0:14343:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d6ec54c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:730ef4b7-dbd8-4cb5-9f31-5e7e04ae8864+18:14347:x1876402802629760:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789477544.584258:0:14343:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d6ec54c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:730ef4b7-dbd8-4cb5-9f31-5e7e04ae8864+18:14347:x1876402802629760:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 620us (13042us total) trans 0 rc 0/0 00000100:00100000:0.0:1789477544.584269:0:14343:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:3.0:1789477544.592380:0:14347:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d7bddd500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:730ef4b7-dbd8-4cb5-9f31-5e7e04ae8864:14347:1876402802629760:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789477544.593035:0:14347:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d7bddd500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:730ef4b7-dbd8-4cb5-9f31-5e7e04ae8864:14347:1876402802629888:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789477544.593217:0:14347:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789477544.593357:0:14347:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d0d7f6e0e40 going to sleep for 11 seconds 00000100:00100000:0.0:1789477544.593602:0:14343:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802629888 00000100:00100000:0.0:1789477544.593612:0:14343:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802629888 00000100:00100000:0.0:1789477544.593669:0:14343:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:0.0:1789477544.593680:0:14343:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d6ec54450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:730ef4b7-dbd8-4cb5-9f31-5e7e04ae8864+18:14347:x1876402802629888:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789477544.595248:0:14343:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d6ec54450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:730ef4b7-dbd8-4cb5-9f31-5e7e04ae8864+18:14347:x1876402802629888:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 1557us (2020us total) trans 0 rc 0/0 00000100:00100000:0.0:1789477544.595263:0:14343:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1789477544.595393:0:14347:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d7bddd500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:730ef4b7-dbd8-4cb5-9f31-5e7e04ae8864:14347:1876402802629888:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1789477544.599798:0:16527:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:3.0:1789477544.600232:0:14347:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:3.0:1789477544.600268:0:14347:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.123@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1789477544.600298:0:14347:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.123@tcp lock: ffff9d0d41646c00/0xafddb3c8f9282acb lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xafddb3c8f9282ad2 expref: -99 pid: 14347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477544.600314:0:14347:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.123@tcp lock: ffff9d0d41646c00/0xafddb3c8f9282acb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xafddb3c8f9282ad2 expref: -99 pid: 14347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789477544.600327:0:14347:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1789477544.600344:0:14347:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9d0c43499000 from 10 10000000:01000000:3.0:1789477544.600348:0:14347:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1789477544.600400:0:14347:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.123@tcp lock: ffff9d0d41647800/0xafddb3c8f9282ad9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477544.600410:0:14347:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.123@tcp lock: ffff9d0d41647800/0xafddb3c8f9282ad9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477544.600425:0:14347:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.123@tcp lock: ffff9d0d41647800/0xafddb3c8f9282ad9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789477544.600460:0:14347:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d7bddd500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:730ef4b7-dbd8-4cb5-9f31-5e7e04ae8864:14347:1876402802630016:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789477544.600572:0:14347:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789477544.600645:0:14347:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d0d7f6e0e40 going to sleep for 11 seconds 00000100:00100000:3.0:1789477544.600674:0:14344:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802630016 00000100:00100000:3.0:1789477544.600683:0:14344:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802630016 00000100:00100000:3.0:1789477544.600739:0:14344:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:3.0:1789477544.600750:0:14344:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d6ec57850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:730ef4b7-dbd8-4cb5-9f31-5e7e04ae8864+18:14347:x1876402802630016:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789477544.600780:0:14344:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789477544.600798:0:14344:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d0d41647a00/0xafddb3c8f9282ae0 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xafddb3c8f9282ad9 expref: -99 pid: 14344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477544.600829:0:14344:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d0d41647a00/0xafddb3c8f9282ae0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xafddb3c8f9282ad9 expref: 19 pid: 14344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477544.600842:0:14344:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d0d41647a00/0xafddb3c8f9282ae0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xafddb3c8f9282ad9 expref: 19 pid: 14344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477544.600852:0:14344:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d0d41647a00, rc 0) 00000100:00100000:3.0:1789477544.600898:0:14344:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d6ec57850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:730ef4b7-dbd8-4cb5-9f31-5e7e04ae8864+19:14347:x1876402802630016:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 150us (327us total) trans 0 rc 0/0 00000100:00100000:3.0:1789477544.600913:0:14344:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:3.0:1789477544.600983:0:14347:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d7bddd500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:730ef4b7-dbd8-4cb5-9f31-5e7e04ae8864:14347:1876402802630016:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789477544.600999:0:14347:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.123@tcp lock: ffff9d0d41647800/0xafddb3c8f9282ad9 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xafddb3c8f9282ae0 expref: -99 pid: 14347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477544.601010:0:14347:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.123@tcp lock: ffff9d0d41647800/0xafddb3c8f9282ad9 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xafddb3c8f9282ae0 expref: -99 pid: 14347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789477544.601071:0:14347:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d7bddd500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:730ef4b7-dbd8-4cb5-9f31-5e7e04ae8864:14347:1876402802630144:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789477544.604265:0:14347:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789477544.605263:0:14347:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d0d7f6e0e40 going to sleep for 11 seconds 00000100:00100000:3.0:1789477544.605389:0:14345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802630144 00000100:00100000:3.0:1789477544.605402:0:14345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802630144 00000100:00100000:3.0:1789477544.605627:0:14344:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:3.0:1789477544.605641:0:14344:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d6ec56450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:730ef4b7-dbd8-4cb5-9f31-5e7e04ae8864+19:14347:x1876402802630144:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789477544.609394:0:14344:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d6ec56450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:730ef4b7-dbd8-4cb5-9f31-5e7e04ae8864+19:14347:x1876402802630144:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 3742us (5127us total) trans 0 rc 0/0 00000100:00100000:3.0:1789477544.609414:0:14344:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:0.0:1789477544.609421:0:14347:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d7bddd500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:730ef4b7-dbd8-4cb5-9f31-5e7e04ae8864:14347:1876402802630144:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789477544.609509:0:14347:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d7c1faa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:730ef4b7-dbd8-4cb5-9f31-5e7e04ae8864:14347:1876402802630272:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789477544.609574:0:14347:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789477544.609641:0:14347:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d0d510abc00 going to sleep for 11 seconds 00000100:00100000:0.0:1789477544.609660:0:14343:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802630272 00000100:00100000:0.0:1789477544.609669:0:14343:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802630272 00000100:00100000:0.0:1789477544.609725:0:14343:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:0.0:1789477544.609735:0:14343:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d6ec54050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:730ef4b7-dbd8-4cb5-9f31-5e7e04ae8864+19:14347:x1876402802630272:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789477544.609967:0:14343:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d6ec54050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:730ef4b7-dbd8-4cb5-9f31-5e7e04ae8864+19:14347:x1876402802630272:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 231us (393us total) trans 0 rc 0/0 00000100:00100000:0.0:1789477544.609974:0:14343:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:0.0:1789477544.610026:0:14347:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d7c1faa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:730ef4b7-dbd8-4cb5-9f31-5e7e04ae8864:14347:1876402802630272:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1789477544.618099:0:16528:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:2.0:1789477544.618552:0:14347:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:2.0:1789477544.618626:0:14347:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.123@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1789477544.618644:0:14347:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.123@tcp lock: ffff9d0d41647800/0xafddb3c8f9282ad9 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xafddb3c8f9282ae0 expref: -99 pid: 14347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477544.618660:0:14347:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.123@tcp lock: ffff9d0d41647800/0xafddb3c8f9282ad9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xafddb3c8f9282ae0 expref: -99 pid: 14347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789477544.671423:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:3.0:1789477544.671476:0:14345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783763712 00000100:00100000:3.0:1789477544.671487:0:14345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783763712 00000100:00100000:3.0:1789477544.671547:0:14345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 116 00000100:00100000:3.0:1789477544.671558:0:14345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d6ec57050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:41935ab2-fae2-41da-aaaf-b7b0ee59bf6c+11:13753:x1876402783763712:12345-192.168.201.23@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789477544.671595:0:14345:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789477544.671624:0:14345:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d0d41646a00/0xafddb3c8f9282ae7 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xa90d500d7b8f2f35 expref: -99 pid: 14345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477544.671658:0:14345:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d0d41646a00/0xafddb3c8f9282ae7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2f35 expref: 12 pid: 14345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477544.671670:0:14345:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d0d41646a00/0xafddb3c8f9282ae7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2f35 expref: 12 pid: 14345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477544.671680:0:14345:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d0d41646a00, rc 0) 00000100:00100000:3.0:1789477544.671742:0:14345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d6ec57050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:41935ab2-fae2-41da-aaaf-b7b0ee59bf6c+12:13753:x1876402783763712:12345-192.168.201.23@tcp:101:ll_cfg_requeue.0 Request processed in 187us (334us total) trans 0 rc 0/0 00000100:00100000:3.0:1789477544.671747:0:14345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 116 00000100:00100000:3.0:1789477544.678190:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:3.0:1789477544.678236:0:14344:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783763840 00000100:00100000:3.0:1789477544.678251:0:14344:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783763840 00000100:00100000:3.0:1789477544.678457:0:14344:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 117 00000100:00100000:3.0:1789477544.678470:0:14344:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d6ec56c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:41935ab2-fae2-41da-aaaf-b7b0ee59bf6c+12:13753:x1876402783763840:12345-192.168.201.23@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789477544.678886:0:14344:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d6ec56c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:41935ab2-fae2-41da-aaaf-b7b0ee59bf6c+12:13753:x1876402783763840:12345-192.168.201.23@tcp:501:ll_cfg_requeue.0 Request processed in 417us (715us total) trans 0 rc 0/0 00000100:00100000:3.0:1789477544.678896:0:14344:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 117 00000100:00100000:0.0:1789477544.691129:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:0.0:1789477544.691555:0:14343:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783763968 00000100:00100000:0.0:1789477544.691569:0:14343:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783763968 00000100:00100000:0.0:1789477544.691650:0:14343:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 118 00000100:00100000:0.0:1789477544.691662:0:14343:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d6ec55450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:41935ab2-fae2-41da-aaaf-b7b0ee59bf6c+12:13753:x1876402783763968:12345-192.168.201.23@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789477544.691974:0:14343:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d6ec55450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:41935ab2-fae2-41da-aaaf-b7b0ee59bf6c+12:13753:x1876402783763968:12345-192.168.201.23@tcp:503:ll_cfg_requeue.0 Request processed in 312us (858us total) trans 0 rc 0/0 00000100:00100000:0.0:1789477544.691982:0:14343:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 118 00000100:00100000:3.0:1789477544.700053:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:0.0:1789477544.700213:0:14345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783764096 00000100:00100000:0.0:1789477544.700228:0:14345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783764096 00000100:00100000:0.0:1789477544.700305:0:14345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 119 00000100:00100000:0.0:1789477544.700318:0:14345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d6ec56050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:41935ab2-fae2-41da-aaaf-b7b0ee59bf6c+12:13753:x1876402783764096:12345-192.168.201.23@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789477544.700342:0:14345:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789477544.700368:0:14345:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d0d50be4200/0xafddb3c8f9282aee lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xa90d500d7b8f2f3c expref: -99 pid: 14345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477544.700406:0:14345:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d0d50be4200/0xafddb3c8f9282aee lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2f3c expref: 13 pid: 14345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477544.700419:0:14345:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d0d50be4200/0xafddb3c8f9282aee lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2f3c expref: 13 pid: 14345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477544.700428:0:14345:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d0d50be4200, rc 0) 00000100:00100000:0.0:1789477544.700519:0:14345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d6ec56050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:41935ab2-fae2-41da-aaaf-b7b0ee59bf6c+13:13753:x1876402783764096:12345-192.168.201.23@tcp:101:ll_cfg_requeue.0 Request processed in 203us (484us total) trans 0 rc 0/0 00000100:00100000:0.0:1789477544.700527:0:14345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 119 00000100:00100000:3.0:1789477544.705072:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:1.0:1789477544.705176:0:14344:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783764224 00000100:00100000:1.0:1789477544.705189:0:14344:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783764224 00000100:00100000:1.0:1789477544.705253:0:14344:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 120 00000100:00100000:1.0:1789477544.705266:0:14344:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d6ec55c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:41935ab2-fae2-41da-aaaf-b7b0ee59bf6c+13:13753:x1876402783764224:12345-192.168.201.23@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789477544.705654:0:14344:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d6ec55c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:41935ab2-fae2-41da-aaaf-b7b0ee59bf6c+13:13753:x1876402783764224:12345-192.168.201.23@tcp:501:ll_cfg_requeue.0 Request processed in 389us (596us total) trans 0 rc 0/0 00000100:00100000:1.0:1789477544.705664:0:14344:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 120 00000100:00100000:2.0:1789477544.709530:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:1.0:1789477544.709878:0:14345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783764352 00000100:00100000:1.0:1789477544.709891:0:14345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783764352 00000100:00100000:1.0:1789477544.709953:0:14345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 121 00000100:00100000:1.0:1789477544.709965:0:14345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d6ec57c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:41935ab2-fae2-41da-aaaf-b7b0ee59bf6c+13:13753:x1876402783764352:12345-192.168.201.23@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789477544.710548:0:14345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d6ec57c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:41935ab2-fae2-41da-aaaf-b7b0ee59bf6c+13:13753:x1876402783764352:12345-192.168.201.23@tcp:503:ll_cfg_requeue.0 Request processed in 583us (1029us total) trans 0 rc 0/0 00000100:00100000:1.0:1789477544.710557:0:14345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 121 00010000:00010000:2.0:1789477544.751849:0:14338:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789477545.459510:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:2.0:1789477545.459598:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:1.0:1789477545.459764:0:14343:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783764480 00000100:00100000:1.0:1789477545.459778:0:14343:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783764480 00000100:00100000:2.0:1789477545.459885:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:1.0:1789477545.464372:0:14343:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 122 00000100:00100000:1.0:1789477545.464399:0:14343:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d6ec57450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:41935ab2-fae2-41da-aaaf-b7b0ee59bf6c+13:2352:x1876402783764480:12345-192.168.201.23@tcp:400:kworker.0 00000100:00100000:1.0:1789477545.465359:0:14343:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d6ec57450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:41935ab2-fae2-41da-aaaf-b7b0ee59bf6c+13:2352:x1876402783764480:12345-192.168.201.23@tcp:400:kworker.0 Request processed in 963us (5873us total) trans 0 rc 0/0 00000100:00100000:1.0:1789477545.465373:0:14343:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 122 00000100:00100000:2.0:1789477545.466474:0:14351:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783764608 00000100:00100000:2.0:1789477545.466496:0:14351:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783764608 00000100:00100000:2.0:1789477545.466607:0:14351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 26 00000100:00100000:2.0:1789477545.466631:0:14351:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d7c64ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d98042a3-6618-44a7-81f9-5553c982b325+6:2352:x1876402783764608:12345-192.168.201.23@tcp:400:kworker.0 00000100:00100000:2.0:1789477545.466712:0:14351:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d7c64ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d98042a3-6618-44a7-81f9-5553c982b325+6:2352:x1876402783764608:12345-192.168.201.23@tcp:400:kworker.0 Request processed in 85us (7133us total) trans 0 rc 0/0 00000100:00100000:2.0:1789477545.466721:0:14351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 26 00000100:00100000:2.0:1789477545.466762:0:15037:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783764736 00000100:00100000:2.0:1789477545.466767:0:15037:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783764736 00000100:00100000:2.0:1789477545.466801:0:15037:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 12 00000100:00100000:2.0:1789477545.466808:0:15037:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d7c64e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d98042a3-6618-44a7-81f9-5553c982b325+5:2353:x1876402783764736:12345-192.168.201.23@tcp:400:kworker.0 00000100:00100000:2.0:1789477545.466836:0:15037:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d7c64e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d98042a3-6618-44a7-81f9-5553c982b325+5:2353:x1876402783764736:12345-192.168.201.23@tcp:400:kworker.0 Request processed in 29us (6952us total) trans 0 rc 0/0 00000100:00100000:2.0:1789477545.466843:0:15037:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 12 00000100:00100000:2.0:1789477545.466980:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:2.0:1789477545.467002:0:15469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783764864 00000100:00100000:2.0:1789477545.467006:0:15469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783764864 00000100:00100000:2.0:1789477545.467033:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 13 00000100:00100000:2.0:1789477545.467040:0:15469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d7c64ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d98042a3-6618-44a7-81f9-5553c982b325+5:2353:x1876402783764864:12345-192.168.201.23@tcp:400:kworker.0 00000100:00100000:2.0:1789477545.467066:0:15469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d7c64ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d98042a3-6618-44a7-81f9-5553c982b325+5:2353:x1876402783764864:12345-192.168.201.23@tcp:400:kworker.0 Request processed in 26us (88us total) trans 0 rc 0/0 00000100:00100000:2.0:1789477545.467329:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 13 00000100:00100000:2.0:1789477545.467397:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:2.0:1789477545.467416:0:14350:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783764992 00000100:00100000:2.0:1789477545.467420:0:14350:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783764992 00000100:00100000:2.0:1789477545.467449:0:14350:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 27 00000100:00100000:2.0:1789477545.467456:0:14350:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d7c64f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:43ab5f84-4c5e-451f-a8c7-1cb9f9e2bde0+6:2353:x1876402783764992:12345-192.168.201.23@tcp:400:kworker.0 00000100:00100000:2.0:1789477545.467484:0:14350:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d7c64f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:43ab5f84-4c5e-451f-a8c7-1cb9f9e2bde0+6:2353:x1876402783764992:12345-192.168.201.23@tcp:400:kworker.0 Request processed in 28us (87us total) trans 0 rc 0/0 00000100:00100000:2.0:1789477545.467491:0:14350:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 27 00000100:00100000:2.0:1789477545.467531:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:2.0:1789477545.467547:0:15037:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783765120 00000100:00100000:2.0:1789477545.467550:0:15037:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783765120 00000100:00100000:2.0:1789477545.467572:0:15037:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 14 00000100:00100000:2.0:1789477545.467603:0:15037:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d7c64ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:43ab5f84-4c5e-451f-a8c7-1cb9f9e2bde0+5:2353:x1876402783765120:12345-192.168.201.23@tcp:400:kworker.0 00000100:00100000:2.0:1789477545.467637:0:15037:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d7c64ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:43ab5f84-4c5e-451f-a8c7-1cb9f9e2bde0+5:2353:x1876402783765120:12345-192.168.201.23@tcp:400:kworker.0 Request processed in 58us (106us total) trans 0 rc 0/0 00000100:00100000:2.0:1789477545.467643:0:15037:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 14 00000100:00100000:2.0:1789477545.467684:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:2.0:1789477545.467699:0:15038:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783765248 00000100:00100000:2.0:1789477545.467702:0:15038:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783765248 00000100:00100000:2.0:1789477545.467721:0:15038:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 15 00000100:00100000:2.0:1789477545.467726:0:15038:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d7c64d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:43ab5f84-4c5e-451f-a8c7-1cb9f9e2bde0+5:2353:x1876402783765248:12345-192.168.201.23@tcp:400:kworker.0 00000100:00100000:2.0:1789477545.467746:0:15038:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d7c64d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:43ab5f84-4c5e-451f-a8c7-1cb9f9e2bde0+5:2353:x1876402783765248:12345-192.168.201.23@tcp:400:kworker.0 Request processed in 21us (62us total) trans 0 rc 0/0 00000100:00100000:2.0:1789477545.467765:0:15038:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 15 00000100:00080000:1.0:1789477545.468767:0:14346:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789477545.468776:0:14346:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789477545.468781:0:14346:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1789477545.776732:0:15972:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789477545.904231:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d7bddea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1876402802630400:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789477545.904352:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789477545.904732:0:15041:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802630400 00000100:00100000:2.0:1789477545.904754:0:15041:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802630400 00000100:00100000:2.0:1789477545.904872:0:15041:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1789477545.904884:0:15041:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d75286680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1876402802630400:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789477545.904936:0:15041:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789477545.904998:0:15041:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d75286680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1876402802630400:12345-0@lo:13:osp-pre-0-0.0 Request processed in 116us (647us total) trans 0 rc 0/0 00000100:00100000:2.0:1789477545.905007:0:15041:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00080000:1.0:1789477545.906380:0:14346:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789477545.906470:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d7bddea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1876402802630400:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789477546.627310:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:0.0:1789477546.627442:0:14352:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783765376 00000100:00100000:0.0:1789477546.627458:0:14352:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783765376 00000100:00100000:0.0:1789477546.627542:0:14352:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 15 00000100:00100000:0.0:1789477546.627555:0:14352:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d7c64dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d98042a3-6618-44a7-81f9-5553c982b325+6:14410:x1876402783765376:12345-192.168.201.23@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789477546.627628:0:14352:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789477546.627665:0:14352:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be5200/0xafddb3c8f9282af5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa90d500d7b8f2f43 expref: -99 pid: 14352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477546.627773:0:14352:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be5c00/0xafddb3c8f9282afc lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14352 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477546.627810:0:14352:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be5c00/0xafddb3c8f9282afc lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14352 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477546.627829:0:14352:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be5c00/0xafddb3c8f9282afc lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14352 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477546.627846:0:14352:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be4a00/0xafddb3c8f9282b03 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14352 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477546.627852:0:14352:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be4a00/0xafddb3c8f9282b03 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14352 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477546.627859:0:14352:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be4a00/0xafddb3c8f9282b03 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14352 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477546.628419:0:14352:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be5a00/0xafddb3c8f9282b0a lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14352 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477546.628432:0:14352:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be5a00/0xafddb3c8f9282b0a lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14352 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477546.628453:0:14352:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be5a00/0xafddb3c8f9282b0a lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14352 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789477546.628548:0:14352:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 6656 00000004:00200000:0.0:1789477546.628553:0:14352:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:0.0:1789477546.628706:0:14352:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be5a00/0xafddb3c8f9282b0a lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14352 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477546.628721:0:14352:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be5c00/0xafddb3c8f9282afc lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14352 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477546.628740:0:14352:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be5c00/0xafddb3c8f9282afc lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14352 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477546.628749:0:14352:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be5c00/0xafddb3c8f9282afc lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14352 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477546.628755:0:14352:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d0d50be5c00 already unused, calling callback (ffffffffc1fd54f0) 00010000:00010000:0.0:1789477546.628761:0:14352:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be5c00/0xafddb3c8f9282afc lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14352 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477546.628770:0:14352:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be5c00/0xafddb3c8f9282afc lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14352 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477546.628785:0:14352:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9d0d5b3c3900) 00010000:00010000:0.0:1789477546.628789:0:14352:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789477546.628795:0:14352:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be5c00/0xafddb3c8f9282afc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14352 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477546.628803:0:14352:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be5c00/0xafddb3c8f9282afc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14352 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477546.628830:0:14352:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be4a00/0xafddb3c8f9282b03 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14352 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477546.628836:0:14352:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be4a00/0xafddb3c8f9282b03 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14352 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477546.628843:0:14352:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be4a00/0xafddb3c8f9282b03 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14352 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477546.628849:0:14352:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d0d50be4a00 already unused, calling callback (ffffffffc1fd54f0) 00010000:00010000:0.0:1789477546.628853:0:14352:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be4a00/0xafddb3c8f9282b03 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14352 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477546.628860:0:14352:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be4a00/0xafddb3c8f9282b03 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14352 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477546.628869:0:14352:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff9d0d43cd1000) 00010000:00010000:0.0:1789477546.628871:0:14352:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789477546.628874:0:14352:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be4a00/0xafddb3c8f9282b03 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14352 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477546.628882:0:14352:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be4a00/0xafddb3c8f9282b03 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14352 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477546.628927:0:14352:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be5200/0xafddb3c8f9282af5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2f43 expref: 8 pid: 14352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477546.628943:0:14352:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be5a00/0xafddb3c8f9282b0a lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2f43 expref: 7 pid: 14352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477546.628962:0:14352:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9d0d43cd1f00) 00010000:00010000:0.0:1789477546.628965:0:14352:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789477546.628968:0:14352:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d0d50be5a00, rc 0) 00000100:00100000:0.0:1789477546.629065:0:14352:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d7c64dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d98042a3-6618-44a7-81f9-5553c982b325+7:14410:x1876402783765376:12345-192.168.201.23@tcp:101:lhsmtool_posix.0 Request processed in 1511us (1772us total) trans 0 rc 0/0 00000100:00100000:0.0:1789477546.629076:0:14352:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 15 00000100:00100000:2.0:1789477546.632518:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:0.0:1789477546.635286:0:14351:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783765632 00000100:00100000:0.0:1789477546.635310:0:14351:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783765632 00000100:00100000:0.0:1789477546.635408:0:14351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 16 00000100:00100000:0.0:1789477546.635422:0:14351:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d7c64c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d98042a3-6618-44a7-81f9-5553c982b325+7:14410:x1876402783765632:12345-192.168.201.23@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789477546.635450:0:14351:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789477546.635478:0:14351:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be5e00/0xafddb3c8f9282b11 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa90d500d7b8f2f4a expref: -99 pid: 14351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477546.635602:0:14351:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be4000/0xafddb3c8f9282b18 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477546.635621:0:14351:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be4000/0xafddb3c8f9282b18 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477546.635635:0:14351:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be4000/0xafddb3c8f9282b18 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477546.641555:0:14351:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be5200/0xafddb3c8f9282b1f lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477546.641607:0:14351:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be5200/0xafddb3c8f9282b1f lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477546.642771:0:14351:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be5200/0xafddb3c8f9282b1f lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477546.647693:0:14351:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be4a00/0xafddb3c8f9282b26 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477546.647743:0:14351:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be4a00/0xafddb3c8f9282b26 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477546.647765:0:14351:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be4a00/0xafddb3c8f9282b26 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14351 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789477546.647802:0:14351:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 6656 00010000:00010000:0.0:1789477546.648348:0:14351:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be4000/0xafddb3c8f9282b18 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477546.648361:0:14351:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be4000/0xafddb3c8f9282b18 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477546.648370:0:14351:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be4000/0xafddb3c8f9282b18 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477546.648378:0:14351:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d0d50be4000 already unused, calling callback (ffffffffc1fd54f0) 00010000:00010000:0.0:1789477546.648384:0:14351:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be4000/0xafddb3c8f9282b18 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477546.648394:0:14351:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be4000/0xafddb3c8f9282b18 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477546.648414:0:14351:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9d0d43cd1f00) 00010000:00010000:0.0:1789477546.648418:0:14351:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789477546.648432:0:14351:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be4000/0xafddb3c8f9282b18 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477546.648440:0:14351:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be4000/0xafddb3c8f9282b18 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477546.648459:0:14351:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be5200/0xafddb3c8f9282b1f lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477546.648466:0:14351:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be5200/0xafddb3c8f9282b1f lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477546.648473:0:14351:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be5200/0xafddb3c8f9282b1f lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477546.648480:0:14351:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d0d50be5200 already unused, calling callback (ffffffffc1fd54f0) 00010000:00010000:0.0:1789477546.648483:0:14351:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be5200/0xafddb3c8f9282b1f lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477546.648490:0:14351:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be5200/0xafddb3c8f9282b1f lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477546.648504:0:14351:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff9d0d43cd1000) 00010000:00010000:0.0:1789477546.648508:0:14351:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789477546.648511:0:14351:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be5200/0xafddb3c8f9282b1f lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477546.648518:0:14351:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be5200/0xafddb3c8f9282b1f lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477546.650519:0:14351:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be5e00/0xafddb3c8f9282b11 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2f4a expref: 10 pid: 14351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477546.650572:0:14351:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be4a00/0xafddb3c8f9282b26 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2f4a expref: 9 pid: 14351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477546.650623:0:14351:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9d0d43cd1400) 00010000:00010000:0.0:1789477546.650626:0:14351:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789477546.650630:0:14351:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d0d50be4a00, rc 0) 00000100:00100000:0.0:1789477546.655911:0:14351:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d7c64c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d98042a3-6618-44a7-81f9-5553c982b325+9:14410:x1876402783765632:12345-192.168.201.23@tcp:101:lhsmtool_posix.0 Request processed in 20468us (23386us total) trans 8589934593 rc 0/0 00000100:00100000:0.0:1789477546.655931:0:14351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 16 00000100:00100000:1.0:1789477546.661534:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:2.0:1789477546.663889:0:14350:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783765760 00000100:00100000:2.0:1789477546.663912:0:14350:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783765760 00000100:00100000:2.0:1789477546.664020:0:14350:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 17 00000100:00100000:2.0:1789477546.664034:0:14350:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d75287100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d98042a3-6618-44a7-81f9-5553c982b325+9:14410:x1876402783765760:12345-192.168.201.23@tcp:59:lhsmtool_posix.0 00000100:00100000:2.0:1789477546.664218:0:14350:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d75287100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d98042a3-6618-44a7-81f9-5553c982b325+9:14410:x1876402783765760:12345-192.168.201.23@tcp:59:lhsmtool_posix.0 Request processed in 185us (2697us total) trans 0 rc 0/0 00000100:00100000:2.0:1789477546.664510:0:14350:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 17 00000100:00100000:2.0:1789477546.719421:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:0.0:1789477546.720300:0:14351:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783765888 00000100:00100000:0.0:1789477546.720318:0:14351:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783765888 00000100:00100000:0.0:1789477546.720416:0:14351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 18 00000100:00100000:0.0:1789477546.720428:0:14351:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d7c64f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d98042a3-6618-44a7-81f9-5553c982b325+9:14416:x1876402783765888:12345-192.168.201.23@tcp:101:lfs.0 00010000:00010000:0.0:1789477546.720457:0:14351:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789477546.720482:0:14351:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be5e00/0xafddb3c8f9282b34 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa90d500d7b8f2f51 expref: -99 pid: 14351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477546.720569:0:14351:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be5200/0xafddb3c8f9282b3b lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477546.720661:0:14351:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be5200/0xafddb3c8f9282b3b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477546.720676:0:14351:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be5200/0xafddb3c8f9282b3b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477546.720760:0:14351:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be4000/0xafddb3c8f9282b42 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477546.720790:0:14351:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be4000/0xafddb3c8f9282b42 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477546.720798:0:14351:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be4000/0xafddb3c8f9282b42 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477546.722471:0:14351:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be5200/0xafddb3c8f9282b3b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477546.722493:0:14351:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be5200/0xafddb3c8f9282b3b lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477546.722502:0:14351:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be5200/0xafddb3c8f9282b3b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477546.722509:0:14351:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d0d50be5200 already unused, calling callback (ffffffffc1fd54f0) 00010000:00010000:0.0:1789477546.722513:0:14351:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be5200/0xafddb3c8f9282b3b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477546.722521:0:14351:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be5200/0xafddb3c8f9282b3b lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477546.722542:0:14351:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9d0d5b3c3900) 00010000:00010000:0.0:1789477546.722545:0:14351:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789477546.722550:0:14351:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be5200/0xafddb3c8f9282b3b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477546.722557:0:14351:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be5200/0xafddb3c8f9282b3b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477546.722574:0:14351:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be4000/0xafddb3c8f9282b42 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477546.722632:0:14351:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be4000/0xafddb3c8f9282b42 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477546.723240:0:14351:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be4000/0xafddb3c8f9282b42 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477546.723250:0:14351:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d0d50be4000 already unused, calling callback (ffffffffc1fd54f0) 00010000:00010000:0.0:1789477546.723254:0:14351:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be4000/0xafddb3c8f9282b42 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477546.723262:0:14351:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be4000/0xafddb3c8f9282b42 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477546.723276:0:14351:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9d0d43cd1000) 00010000:00010000:0.0:1789477546.723279:0:14351:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789477546.723282:0:14351:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be4000/0xafddb3c8f9282b42 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477546.723289:0:14351:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be4000/0xafddb3c8f9282b42 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477546.723360:0:14351:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be5e00/0xafddb3c8f9282b34 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2f51 expref: 10 pid: 14351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477546.723374:0:14351:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9d0d5b3c3900) 00010000:00010000:0.0:1789477546.723376:0:14351:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789477546.723381:0:14351:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be5e00/0xafddb3c8f9282b34 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2f51 expref: 10 pid: 14351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477546.723409:0:14351:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d0d50be5e00, rc 0) 00000100:00100000:0.0:1789477546.723517:0:14351:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d7c64f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d98042a3-6618-44a7-81f9-5553c982b325+9:14416:x1876402783765888:12345-192.168.201.23@tcp:101:lfs.0 Request processed in 3088us (4111us total) trans 0 rc 301/301 00000100:00100000:0.0:1789477546.723527:0:14351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 18 00000100:00100000:3.0:1789477546.729522:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:0.0:1789477546.730341:0:14359:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783766016 00000100:00100000:0.0:1789477546.730357:0:14359:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783766016 00000100:00100000:0.0:1789477546.730440:0:14359:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 0 00000100:00100000:0.0:1789477546.730453:0:14359:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d7bddea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:d98042a3-6618-44a7-81f9-5553c982b325+9:14416:x1876402783766016:12345-192.168.201.23@tcp:700:lfs.0 00000100:00100000:0.0:1789477546.730607:0:14359:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d7bddea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:d98042a3-6618-44a7-81f9-5553c982b325+9:14416:x1876402783766016:12345-192.168.201.23@tcp:700:lfs.0 Request processed in 128us (1075us total) trans 0 rc 0/0 00000100:00100000:0.0:1789477546.730616:0:14359:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 0 00000100:00100000:1.0:1789477546.733033:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:0.0:1789477546.733255:0:14352:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783766272 00000100:00100000:0.0:1789477546.733272:0:14352:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783766272 00000100:00100000:0.0:1789477546.733352:0:14352:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 19 00000100:00100000:0.0:1789477546.733366:0:14352:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d75285c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d98042a3-6618-44a7-81f9-5553c982b325+9:14416:x1876402783766272:12345-192.168.201.23@tcp:36:lfs.0 00010000:00010000:0.0:1789477546.733451:0:14352:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789477546.733489:0:14352:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d41646800/0xafddb3c8f9282a77 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2ecc expref: 9 pid: 14352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477546.733514:0:14352:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9d0d5b3c3900) 00010000:00010000:0.0:1789477546.733520:0:14352:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789477546.735292:0:14352:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be5e00/0xafddb3c8f9282b49 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14352 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477546.735325:0:14352:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d41647400/0xafddb3c8f9282aaf lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2f2e expref: 5 pid: 14351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477546.735345:0:14352:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be5e00/0xafddb3c8f9282b49 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14352 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477546.735401:0:14352:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d41647400/0xafddb3c8f9282aaf lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2f2e expref: 5 pid: 14351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477546.735421:0:14352:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d41647400/0xafddb3c8f9282aaf lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2f2e expref: 5 pid: 14351 timeout: 591 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789477546.735440:0:14352:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d7c1faa00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14352:1876402802630528:192.168.201.23@tcp:104: 00000100:00100000:0.0:1789477546.735575:0:14352:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d0d510ab9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789477546.739464:0:14352:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d7c1faa00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14352:1876402802630528:192.168.201.23@tcp:104: 00010000:00010000:0.0:1789477546.739519:0:14352:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be5e00/0xafddb3c8f9282b49 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14352 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789477546.741961:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:0.0:1789477546.742082:0:14336:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783766400 00000100:00100000:0.0:1789477546.742099:0:14336:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783766400 00010000:00010000:0.0:1789477546.742171:0:14336:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d41647400/0xafddb3c8f9282aaf lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2f2e expref: 6 pid: 14351 timeout: 591 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789477546.742221:0:14336:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 9 00000100:00100000:0.0:1789477546.742234:0:14336:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d75286a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:43ab5f84-4c5e-451f-a8c7-1cb9f9e2bde0+6:2354:x1876402783766400:12345-192.168.201.23@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789477546.742254:0:14336:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789477546.742264:0:14336:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d41647400/0xafddb3c8f9282aaf lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2f2e expref: 6 pid: 14351 timeout: 591 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477546.742305:0:14336:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d41647400/0xafddb3c8f9282aaf lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2f2e expref: 6 pid: 14351 timeout: 591 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477546.742336:0:14336:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d41647400/0xafddb3c8f9282aaf lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2f2e expref: 6 pid: 14351 timeout: 591 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477546.742360:0:14336:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9d0d5b3c3900) 00010000:00010000:0.0:1789477546.742368:0:14336:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be5e00/0xafddb3c8f9282b49 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14352 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477546.742380:0:14336:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be5e00/0xafddb3c8f9282b49 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 14352 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477546.742389:0:14336:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be5e00/0xafddb3c8f9282b49 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 14352 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477546.742436:0:14336:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789477546.742516:0:14336:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d75286a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:43ab5f84-4c5e-451f-a8c7-1cb9f9e2bde0+5:2354:x1876402783766400:12345-192.168.201.23@tcp:103:ldlm_bl.0 Request processed in 284us (571us total) trans 0 rc 0/0 00000100:00100000:0.0:1789477546.742525:0:14336:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 9 00010000:00010000:2.0:1789477546.742700:0:14352:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be5e00/0xafddb3c8f9282b49 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14352 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477546.742711:0:14352:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be5e00/0xafddb3c8f9282b49 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14352 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477546.742755:0:14352:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50417c00/0xafddb3c8f9282b50 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14352 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477546.742768:0:14352:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50417c00/0xafddb3c8f9282b50 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14352 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477546.742780:0:14352:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50417c00/0xafddb3c8f9282b50 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14352 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789477546.744473:0:14352:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00010000:00010000:2.0:1789477546.744496:0:14352:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be5e00/0xafddb3c8f9282b49 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14352 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477546.744508:0:14352:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be5e00/0xafddb3c8f9282b49 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14352 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477546.744517:0:14352:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be5e00/0xafddb3c8f9282b49 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14352 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477546.744526:0:14352:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d0d50be5e00 already unused, calling callback (ffffffffc1fd54f0) 00010000:00010000:2.0:1789477546.744531:0:14352:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be5e00/0xafddb3c8f9282b49 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14352 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477546.744541:0:14352:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be5e00/0xafddb3c8f9282b49 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14352 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477546.744561:0:14352:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9d0d5b3c3900) 00010000:00010000:2.0:1789477546.744565:0:14352:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789477546.744571:0:14352:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be5e00/0xafddb3c8f9282b49 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14352 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477546.744613:0:14352:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be5e00/0xafddb3c8f9282b49 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14352 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789477546.744638:0:14352:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000a25e968a reply state 000000002cc95d9a transno 8589934594 ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50417c00/0xafddb3c8f9282b50 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14352 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789477546.744650:0:14352:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789477546.744809:0:14352:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d75285c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d98042a3-6618-44a7-81f9-5553c982b325+10:14416:x1876402783766272:12345-192.168.201.23@tcp:36:lfs.0 Request processed in 11441us (11786us total) trans 8589934594 rc 0/0 00000100:00100000:2.0:1789477546.744831:0:14352:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 19 00010000:00010000:3.0:1789477546.750201:0:3296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50417c00/0xafddb3c8f9282b50 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14352 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477546.750279:0:3296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50417c00/0xafddb3c8f9282b50 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14352 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477546.750309:0:3296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50417c00/0xafddb3c8f9282b50 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14352 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477546.750316:0:3296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d0d50417c00 already unused, calling callback (ffffffffc1fd54f0) 00010000:00010000:3.0:1789477546.750321:0:3296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50417c00/0xafddb3c8f9282b50 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14352 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477546.750331:0:3296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50417c00/0xafddb3c8f9282b50 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14352 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477546.750353:0:3296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9d0d50919100) 00010000:00010000:3.0:1789477546.750356:0:3296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789477546.750362:0:3296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50417c00/0xafddb3c8f9282b50 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14352 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477546.750368:0:3296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50417c00/0xafddb3c8f9282b50 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14352 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477546.800377:0:14339:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789477546.816189:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:0.0:1789477546.816302:0:14351:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783766528 00000100:00100000:0.0:1789477546.816320:0:14351:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783766528 00000100:00100000:0.0:1789477546.816575:0:14351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 20 00000100:00100000:0.0:1789477546.816638:0:14351:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d7bddd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d98042a3-6618-44a7-81f9-5553c982b325+9:14424:x1876402783766528:12345-192.168.201.23@tcp:101:lctl.0 00010000:00010000:0.0:1789477546.816670:0:14351:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789477546.816695:0:14351:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be4000/0xafddb3c8f9282b57 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa90d500d7b8f2f58 expref: -99 pid: 14351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477546.817014:0:14351:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be5200/0xafddb3c8f9282b5e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477546.817033:0:14351:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be5200/0xafddb3c8f9282b5e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477546.817048:0:14351:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be5200/0xafddb3c8f9282b5e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14351 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789477546.817127:0:14351:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:0.0:1789477546.817137:0:14351:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 4 stripe count 1 MDT count 1 00000004:00010000:0.0:1789477546.817192:0:14351:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be5200/0xafddb3c8f9282b5e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477546.817219:0:14351:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be4000/0xafddb3c8f9282b57 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2f58 expref: 11 pid: 14351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477546.817304:0:14351:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be5200/0xafddb3c8f9282b5e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2f58 expref: 10 pid: 14351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477546.817315:0:14351:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9d0d43cd1000) 00010000:00010000:0.0:1789477546.817318:0:14351:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789477546.817322:0:14351:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d0d50be5200, rc 0) 00000100:00100000:0.0:1789477546.817473:0:14351:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d7bddd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d98042a3-6618-44a7-81f9-5553c982b325+10:14424:x1876402783766528:12345-192.168.201.23@tcp:101:lctl.0 Request processed in 837us (1290us total) trans 0 rc 0/0 00000100:00100000:0.0:1789477546.817482:0:14351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 20 00000100:00100000:1.0:1789477546.838765:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:2.0:1789477546.838856:0:14352:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783766656 00000100:00100000:2.0:1789477546.838870:0:14352:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783766656 00000100:00100000:2.0:1789477546.838953:0:14352:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 21 00000100:00100000:2.0:1789477546.838967:0:14352:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d75287480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:43ab5f84-4c5e-451f-a8c7-1cb9f9e2bde0+5:14425:x1876402783766656:12345-192.168.201.23@tcp:101:lfs.0 00010000:00010000:2.0:1789477546.838995:0:14352:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789477546.839023:0:14352:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50416200/0xafddb3c8f9282b65 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa90d500d7b8f2f5f expref: -99 pid: 14352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477546.839291:0:14352:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50416000/0xafddb3c8f9282b6c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14352 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477546.839312:0:14352:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50416000/0xafddb3c8f9282b6c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14352 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477546.839326:0:14352:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50416000/0xafddb3c8f9282b6c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14352 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789477546.839411:0:14352:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:2.0:1789477546.839416:0:14352:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 4 stripe count 1 MDT count 1 00000004:00010000:2.0:1789477546.839447:0:14352:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50416000/0xafddb3c8f9282b6c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14352 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477546.839478:0:14352:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50416200/0xafddb3c8f9282b65 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2f5f expref: 7 pid: 14352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477546.839650:0:14352:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50416000/0xafddb3c8f9282b6c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2f5f expref: 6 pid: 14352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477546.839687:0:14352:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9d0d43cd1000) 00010000:00010000:2.0:1789477546.839691:0:14352:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789477546.839695:0:14352:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d0d50416000, rc 0) 00000100:00100000:2.0:1789477546.839838:0:14352:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d75287480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:43ab5f84-4c5e-451f-a8c7-1cb9f9e2bde0+6:14425:x1876402783766656:12345-192.168.201.23@tcp:101:lfs.0 Request processed in 873us (1087us total) trans 0 rc 0/0 00000100:00100000:2.0:1789477546.839845:0:14352:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 21 00000100:00100000:3.0:1789477546.844154:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:0.0:1789477546.844247:0:14351:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783766784 00000100:00100000:0.0:1789477546.844261:0:14351:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783766784 00000100:00100000:0.0:1789477546.844363:0:14351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 22 00000100:00100000:0.0:1789477546.844376:0:14351:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d7bddce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:43ab5f84-4c5e-451f-a8c7-1cb9f9e2bde0+6:14425:x1876402783766784:12345-192.168.201.23@tcp:101:lfs.0 00010000:00010000:0.0:1789477546.844404:0:14351:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789477546.844432:0:14351:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be4000/0xafddb3c8f9282b73 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa90d500d7b8f2f66 expref: -99 pid: 14351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477546.844907:0:14351:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be5c00/0xafddb3c8f9282b7a lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477546.844928:0:14351:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be5c00/0xafddb3c8f9282b7a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477546.844943:0:14351:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be5c00/0xafddb3c8f9282b7a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477546.844961:0:14351:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be5000/0xafddb3c8f9282b81 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477546.844968:0:14351:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be5000/0xafddb3c8f9282b81 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477546.844976:0:14351:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be5000/0xafddb3c8f9282b81 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477546.846495:0:14351:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be5600/0xafddb3c8f9282b88 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477546.846525:0:14351:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be5600/0xafddb3c8f9282b88 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477546.846539:0:14351:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be5600/0xafddb3c8f9282b88 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14351 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789477546.846660:0:14351:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00000004:00200000:0.0:1789477546.846666:0:14351:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1789477546.846697:0:14351:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be5600/0xafddb3c8f9282b88 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477546.846714:0:14351:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be5c00/0xafddb3c8f9282b7a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477546.846722:0:14351:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be5c00/0xafddb3c8f9282b7a lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477546.846740:0:14351:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be5c00/0xafddb3c8f9282b7a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477546.846747:0:14351:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d0d50be5c00 already unused, calling callback (ffffffffc1fd54f0) 00010000:00010000:0.0:1789477546.846752:0:14351:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be5c00/0xafddb3c8f9282b7a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477546.846759:0:14351:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be5c00/0xafddb3c8f9282b7a lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477546.846775:0:14351:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9d0d43cd1000) 00010000:00010000:0.0:1789477546.846779:0:14351:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789477546.846784:0:14351:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be5c00/0xafddb3c8f9282b7a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477546.846790:0:14351:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be5c00/0xafddb3c8f9282b7a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477546.846810:0:14351:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be5000/0xafddb3c8f9282b81 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477546.846827:0:14351:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be5000/0xafddb3c8f9282b81 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477546.846833:0:14351:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be5000/0xafddb3c8f9282b81 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477546.846838:0:14351:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d0d50be5000 already unused, calling callback (ffffffffc1fd54f0) 00010000:00010000:0.0:1789477546.846841:0:14351:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be5000/0xafddb3c8f9282b81 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477546.846848:0:14351:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be5000/0xafddb3c8f9282b81 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477546.846857:0:14351:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9d0d43cd1b00) 00010000:00010000:0.0:1789477546.846860:0:14351:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789477546.846863:0:14351:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be5000/0xafddb3c8f9282b81 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477546.846869:0:14351:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be5000/0xafddb3c8f9282b81 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477546.846919:0:14351:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be4000/0xafddb3c8f9282b73 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2f66 expref: 8 pid: 14351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477546.846936:0:14351:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be5600/0xafddb3c8f9282b88 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2f66 expref: 7 pid: 14351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477546.846944:0:14351:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9d0d43cd1100) 00010000:00010000:0.0:1789477546.846946:0:14351:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789477546.846955:0:14351:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d0d50be5600, rc 0) 00000100:00100000:0.0:1789477546.847851:0:14351:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d7bddce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:43ab5f84-4c5e-451f-a8c7-1cb9f9e2bde0+7:14425:x1876402783766784:12345-192.168.201.23@tcp:101:lfs.0 Request processed in 3469us (3707us total) trans 0 rc 0/0 00000100:00100000:0.0:1789477546.847864:0:14351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 22 00000100:00100000:3.0:1789477546.851029:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:2.0:1789477546.851193:0:14352:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783767040 00000100:00100000:2.0:1789477546.851206:0:14352:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783767040 00000100:00100000:2.0:1789477546.851291:0:14352:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 23 00000100:00100000:2.0:1789477546.851302:0:14352:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d58071180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:43ab5f84-4c5e-451f-a8c7-1cb9f9e2bde0+7:14425:x1876402783767040:12345-192.168.201.23@tcp:101:lfs.0 00010000:00010000:2.0:1789477546.851329:0:14352:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789477546.851353:0:14352:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50417000/0xafddb3c8f9282b8f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa90d500d7b8f2f6d expref: -99 pid: 14352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789477546.851503:0:14352:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00010000:00010000:2.0:1789477546.851683:0:14352:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50417000/0xafddb3c8f9282b8f lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2f6d expref: 9 pid: 14352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477546.851700:0:14352:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9d0d43cd1000) 00010000:00010000:2.0:1789477546.851703:0:14352:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789477546.851708:0:14352:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50417000/0xafddb3c8f9282b8f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2f6d expref: 9 pid: 14352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477546.853030:0:14352:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d0d50417000, rc 0) 00000100:00100000:2.0:1789477546.853181:0:14352:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d58071180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:43ab5f84-4c5e-451f-a8c7-1cb9f9e2bde0+8:14425:x1876402783767040:12345-192.168.201.23@tcp:101:lfs.0 Request processed in 1875us (2163us total) trans 8589934595 rc 301/301 00000100:00100000:2.0:1789477546.853214:0:14352:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 23 00000100:00100000:2.0:1789477546.857959:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:0.0:1789477546.858123:0:14351:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783767296 00000100:00100000:0.0:1789477546.858137:0:14351:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783767296 00000100:00100000:0.0:1789477546.858264:0:14351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 24 00000100:00100000:0.0:1789477546.858278:0:14351:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d7c64c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:43ab5f84-4c5e-451f-a8c7-1cb9f9e2bde0+8:14425:x1876402783767296:12345-192.168.201.23@tcp:36:lfs.0 00010000:00010000:0.0:1789477546.858358:0:14351:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789477546.858395:0:14351:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be5600/0xafddb3c8f9282b88 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2f66 expref: 8 pid: 14351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477546.858421:0:14351:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9d0d43cd1100) 00010000:00010000:0.0:1789477546.858434:0:14351:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789477546.858464:0:14351:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be5400/0xafddb3c8f9282b9d lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477546.858480:0:14351:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be5400/0xafddb3c8f9282b9d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477546.858504:0:14351:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be5400/0xafddb3c8f9282b9d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14351 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789477546.858856:0:14351:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000a9301ca0 reply state 000000005ba8dcc6 transno 8589934596 ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be5400/0xafddb3c8f9282b9d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14351 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789477546.858869:0:14351:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:0.0:1789477546.858886:0:14351:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00000100:00100000:0.0:1789477546.858998:0:14351:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d7c64c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:43ab5f84-4c5e-451f-a8c7-1cb9f9e2bde0+9:14425:x1876402783767296:12345-192.168.201.23@tcp:36:lfs.0 Request processed in 722us (1054us total) trans 8589934596 rc 0/0 00000100:00100000:0.0:1789477546.859027:0:14351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 24 00010000:00010000:2.0:1789477546.860759:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be5400/0xafddb3c8f9282b9d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477546.860781:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be5400/0xafddb3c8f9282b9d lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477546.860790:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be5400/0xafddb3c8f9282b9d lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477546.860798:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d0d50be5400 already unused, calling callback (ffffffffc1fd54f0) 00010000:00010000:2.0:1789477546.860803:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be5400/0xafddb3c8f9282b9d lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477546.860811:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be5400/0xafddb3c8f9282b9d lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477546.860832:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9d0d43cd1e00) 00010000:00010000:2.0:1789477546.860836:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:2.0:1789477546.860841:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be5400/0xafddb3c8f9282b9d lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477546.860847:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be5400/0xafddb3c8f9282b9d lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14351 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789477546.862263:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:3.0:1789477546.862752:0:14354:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783767552 00000100:00100000:3.0:1789477546.862767:0:14354:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783767552 00000100:00100000:3.0:1789477546.862835:0:14354:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 2 00000100:00100000:3.0:1789477546.862848:0:14354:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d7c64d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:43ab5f84-4c5e-451f-a8c7-1cb9f9e2bde0+8:14425:x1876402783767552:12345-192.168.201.23@tcp:35:lfs.0 00000100:00100000:3.0:1789477546.863207:0:14354:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d7c64d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:43ab5f84-4c5e-451f-a8c7-1cb9f9e2bde0+9:14425:x1876402783767552:12345-192.168.201.23@tcp:35:lfs.0 Request processed in 361us (955us total) trans 8589934597 rc 0/0 00000100:00100000:3.0:1789477546.863216:0:14354:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 2 00000100:00100000:3.0:1789477546.866200:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:2.0:1789477546.866348:0:14352:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783767808 00000100:00100000:2.0:1789477546.866364:0:14352:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783767808 00000100:00100000:2.0:1789477546.866439:0:14352:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 25 00000100:00100000:2.0:1789477546.866453:0:14352:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d58073480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:43ab5f84-4c5e-451f-a8c7-1cb9f9e2bde0+9:14425:x1876402783767808:12345-192.168.201.23@tcp:101:lfs.0 00010000:00010000:2.0:1789477546.866524:0:14352:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789477546.866554:0:14352:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50416200/0xafddb3c8f9282ba4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa90d500d7b8f2f74 expref: -99 pid: 14352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477546.866680:0:14352:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50417800/0xafddb3c8f9282bab lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14352 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477546.866699:0:14352:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50417800/0xafddb3c8f9282bab lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14352 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477546.866713:0:14352:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50417800/0xafddb3c8f9282bab lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14352 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477546.866742:0:14352:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50416800/0xafddb3c8f9282bb2 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14352 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477546.866750:0:14352:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50416800/0xafddb3c8f9282bb2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14352 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477546.866756:0:14352:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50416800/0xafddb3c8f9282bb2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14352 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789477546.866932:0:14352:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00010000:00010000:2.0:1789477546.867067:0:14352:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50417800/0xafddb3c8f9282bab lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14352 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477546.867077:0:14352:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50417800/0xafddb3c8f9282bab lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14352 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477546.867084:0:14352:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50417800/0xafddb3c8f9282bab lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14352 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477546.867102:0:14352:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d0d50417800 already unused, calling callback (ffffffffc1fd54f0) 00010000:00010000:2.0:1789477546.867107:0:14352:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50417800/0xafddb3c8f9282bab lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14352 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477546.867116:0:14352:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50417800/0xafddb3c8f9282bab lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14352 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477546.867133:0:14352:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9d0d43cd1000) 00010000:00010000:2.0:1789477546.867136:0:14352:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789477546.867142:0:14352:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50417800/0xafddb3c8f9282bab lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14352 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477546.867148:0:14352:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50417800/0xafddb3c8f9282bab lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14352 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477546.867165:0:14352:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50416800/0xafddb3c8f9282bb2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14352 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477546.867171:0:14352:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50416800/0xafddb3c8f9282bb2 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14352 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477546.867177:0:14352:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50416800/0xafddb3c8f9282bb2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14352 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477546.867182:0:14352:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d0d50416800 already unused, calling callback (ffffffffc1fd54f0) 00010000:00010000:2.0:1789477546.867185:0:14352:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50416800/0xafddb3c8f9282bb2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14352 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477546.867191:0:14352:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50416800/0xafddb3c8f9282bb2 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14352 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477546.867211:0:14352:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9d0d50919300) 00010000:00010000:2.0:1789477546.867214:0:14352:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789477546.867217:0:14352:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50416800/0xafddb3c8f9282bb2 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14352 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477546.867223:0:14352:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50416800/0xafddb3c8f9282bb2 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14352 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477546.867272:0:14352:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50416200/0xafddb3c8f9282ba4 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2f74 expref: 11 pid: 14352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477546.867283:0:14352:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9d0d43cd1000) 00010000:00010000:2.0:1789477546.867285:0:14352:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789477546.867289:0:14352:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50416200/0xafddb3c8f9282ba4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2f74 expref: 11 pid: 14352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477546.867299:0:14352:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d0d50416200, rc 0) 00000100:00100000:2.0:1789477546.867390:0:14352:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d58073480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:43ab5f84-4c5e-451f-a8c7-1cb9f9e2bde0+10:14425:x1876402783767808:12345-192.168.201.23@tcp:101:lfs.0 Request processed in 941us (1206us total) trans 8589934598 rc 301/301 00000100:00100000:2.0:1789477546.867399:0:14352:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 25 00000100:00100000:3.0:1789477546.870703:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:2.0:1789477546.870966:0:14352:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783767936 00000100:00100000:2.0:1789477546.870980:0:14352:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783767936 00000100:00100000:1.0:1789477546.871144:0:14350:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 26 00000100:00100000:1.0:1789477546.871161:0:14350:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d58072680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:43ab5f84-4c5e-451f-a8c7-1cb9f9e2bde0+10:14425:x1876402783767936:12345-192.168.201.23@tcp:101:lfs.0 00010000:00010000:1.0:1789477546.871195:0:14350:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789477546.871237:0:14350:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f518400/0xafddb3c8f9282bc0 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa90d500d7b8f2f7b expref: -99 pid: 14350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477546.871353:0:14350:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f518200/0xafddb3c8f9282bc7 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14350 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477546.871371:0:14350:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f518200/0xafddb3c8f9282bc7 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14350 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477546.871384:0:14350:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f518200/0xafddb3c8f9282bc7 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14350 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789477546.871466:0:14350:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00000004:00200000:1.0:1789477546.871470:0:14350:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1789477546.871496:0:14350:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f518200/0xafddb3c8f9282bc7 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14350 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477546.871527:0:14350:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f518400/0xafddb3c8f9282bc0 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2f7b expref: 12 pid: 14350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477546.871547:0:14350:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f518200/0xafddb3c8f9282bc7 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2f7b expref: 11 pid: 14350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477546.871558:0:14350:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9d0d44f4e200) 00010000:00010000:1.0:1789477546.871561:0:14350:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789477546.871565:0:14350:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d0d7f518200, rc 0) 00000100:00100000:1.0:1789477546.871680:0:14350:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d58072680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:43ab5f84-4c5e-451f-a8c7-1cb9f9e2bde0+11:14425:x1876402783767936:12345-192.168.201.23@tcp:101:lfs.0 Request processed in 524us (993us total) trans 0 rc 0/0 00000100:00100000:1.0:1789477546.871687:0:14350:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 26 00000100:00100000:3.0:1789477546.875818:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:2.0:1789477546.876042:0:14354:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783768064 00000100:00100000:2.0:1789477546.876064:0:14354:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783768064 00000100:00100000:2.0:1789477546.876134:0:14354:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 3 00000100:00100000:2.0:1789477546.876146:0:14354:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d58070a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:43ab5f84-4c5e-451f-a8c7-1cb9f9e2bde0+11:14425:x1876402783768064:12345-192.168.201.23@tcp:37:lfs.0 00000100:00100000:2.0:1789477546.880926:0:14354:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d58070a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:43ab5f84-4c5e-451f-a8c7-1cb9f9e2bde0+11:14425:x1876402783768064:12345-192.168.201.23@tcp:37:lfs.0 Request processed in 4767us (5111us total) trans 0 rc 0/0 00000100:00100000:2.0:1789477546.880954:0:14354:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 3 00000100:00100000:0.0:1789477546.884219:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:3.0:1789477546.884401:0:14353:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783768320 00000100:00100000:3.0:1789477546.884415:0:14353:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783768320 00000100:00100000:3.0:1789477546.884491:0:14353:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 4 00000100:00100000:3.0:1789477546.884503:0:14353:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d7fbb1850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:43ab5f84-4c5e-451f-a8c7-1cb9f9e2bde0+11:14425:x1876402783768320:12345-192.168.201.23@tcp:35:lfs.0 00000100:00100000:3.0:1789477546.884921:0:14353:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d7fbb1850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:43ab5f84-4c5e-451f-a8c7-1cb9f9e2bde0+12:14425:x1876402783768320:12345-192.168.201.23@tcp:35:lfs.0 Request processed in 418us (717us total) trans 8589934599 rc 0/0 00000100:00100000:3.0:1789477546.884930:0:14353:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 4 00000100:00100000:3.0:1789477546.937416:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:0.0:1789477546.937544:0:14351:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783768448 00000100:00100000:0.0:1789477546.937559:0:14351:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783768448 00000100:00100000:0.0:1789477546.937663:0:14351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 27 00000100:00100000:0.0:1789477546.937674:0:14351:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d58070a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d98042a3-6618-44a7-81f9-5553c982b325+10:14431:x1876402783768448:12345-192.168.201.23@tcp:101:bash.0 00010000:00010000:0.0:1789477546.937701:0:14351:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789477546.937740:0:14351:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be5000/0xafddb3c8f9282bce lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa90d500d7b8f2f82 expref: -99 pid: 14351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477546.937821:0:14351:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be5c00/0xafddb3c8f9282bd5 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477546.937838:0:14351:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be5c00/0xafddb3c8f9282bd5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477546.937854:0:14351:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be5c00/0xafddb3c8f9282bd5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477546.937870:0:14351:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be4000/0xafddb3c8f9282bdc lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477546.937877:0:14351:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be4000/0xafddb3c8f9282bdc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477546.937884:0:14351:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be4000/0xafddb3c8f9282bdc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477546.938015:0:14351:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be5600/0xafddb3c8f9282be3 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477546.938039:0:14351:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be5600/0xafddb3c8f9282be3 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477546.938170:0:14351:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be5600/0xafddb3c8f9282be3 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14351 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789477546.938210:0:14351:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00000004:00200000:0.0:1789477546.938213:0:14351:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1789477546.938256:0:14351:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be5600/0xafddb3c8f9282be3 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477546.938269:0:14351:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be5c00/0xafddb3c8f9282bd5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477546.938277:0:14351:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be5c00/0xafddb3c8f9282bd5 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477546.938284:0:14351:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be5c00/0xafddb3c8f9282bd5 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477546.938291:0:14351:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d0d50be5c00 already unused, calling callback (ffffffffc1fd54f0) 00010000:00010000:0.0:1789477546.938295:0:14351:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be5c00/0xafddb3c8f9282bd5 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477546.938303:0:14351:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be5c00/0xafddb3c8f9282bd5 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477546.938317:0:14351:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9d0d43cd1000) 00010000:00010000:0.0:1789477546.938320:0:14351:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789477546.938324:0:14351:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be5c00/0xafddb3c8f9282bd5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477546.938340:0:14351:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be5c00/0xafddb3c8f9282bd5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477546.938355:0:14351:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be4000/0xafddb3c8f9282bdc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477546.938361:0:14351:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be4000/0xafddb3c8f9282bdc lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477546.938367:0:14351:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be4000/0xafddb3c8f9282bdc lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477546.938373:0:14351:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d0d50be4000 already unused, calling callback (ffffffffc1fd54f0) 00010000:00010000:0.0:1789477546.938375:0:14351:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be4000/0xafddb3c8f9282bdc lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477546.938381:0:14351:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be4000/0xafddb3c8f9282bdc lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477546.938388:0:14351:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9d0d43cd1100) 00010000:00010000:0.0:1789477546.938390:0:14351:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789477546.938392:0:14351:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be4000/0xafddb3c8f9282bdc lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477546.938397:0:14351:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be4000/0xafddb3c8f9282bdc lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477546.938430:0:14351:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be5000/0xafddb3c8f9282bce lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2f82 expref: 12 pid: 14351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477546.938456:0:14351:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be5600/0xafddb3c8f9282be3 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2f82 expref: 11 pid: 14351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477546.938464:0:14351:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9d0d44f4e200) 00010000:00010000:0.0:1789477546.938467:0:14351:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1789477546.938469:0:14351:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d0d50be5600, rc 0) 00000100:00100000:0.0:1789477546.938740:0:14351:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d58070a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d98042a3-6618-44a7-81f9-5553c982b325+11:14431:x1876402783768448:12345-192.168.201.23@tcp:101:bash.0 Request processed in 1065us (1339us total) trans 0 rc 0/0 00000100:00100000:0.0:1789477546.938747:0:14351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 27 00000100:00100000:3.0:1789477546.943624:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:2.0:1789477546.943779:0:14352:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783768704 00000100:00100000:2.0:1789477546.943794:0:14352:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783768704 00000100:00100000:2.0:1789477546.943866:0:14352:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 28 00000100:00100000:2.0:1789477546.943879:0:14352:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d58072d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d98042a3-6618-44a7-81f9-5553c982b325+11:14431:x1876402783768704:12345-192.168.201.23@tcp:101:bash.0 00010000:00010000:2.0:1789477546.943907:0:14352:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789477546.943935:0:14352:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50416800/0xafddb3c8f9282bea lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa90d500d7b8f2f89 expref: -99 pid: 14352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477546.944152:0:14352:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50417800/0xafddb3c8f9282bf1 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14352 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477546.944172:0:14352:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f518200/0xafddb3c8f9282bc7 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2f7b expref: 11 pid: 14350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477546.944182:0:14352:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50417800/0xafddb3c8f9282bf1 lrc: 4/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14352 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477546.944239:0:14352:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f518200/0xafddb3c8f9282bc7 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2f7b expref: 11 pid: 14350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477546.944257:0:14352:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f518200/0xafddb3c8f9282bc7 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2f7b expref: 11 pid: 14350 timeout: 592 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789477546.944275:0:14352:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d7c64c000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14352:1876402802630656:192.168.201.23@tcp:104: 00000100:00100000:2.0:1789477546.944393:0:14352:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d0d7ed92900 going to sleep for 11 seconds 00000100:00100000:0.0:1789477546.948862:0:14352:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d7c64c000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14352:1876402802630656:192.168.201.23@tcp:104: 00010000:00010000:0.0:1789477546.948902:0:14352:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50417800/0xafddb3c8f9282bf1 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14352 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789477546.950264:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:1.0:1789477546.955404:0:14337:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783768832 00000100:00100000:1.0:1789477546.955426:0:14337:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783768832 00010000:00010000:1.0:1789477546.955666:0:14337:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f518200/0xafddb3c8f9282bc7 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2f7b expref: 12 pid: 14350 timeout: 592 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789477546.955776:0:14337:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 10 00000100:00100000:1.0:1789477546.955789:0:14337:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d6d464700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:43ab5f84-4c5e-451f-a8c7-1cb9f9e2bde0+12:2354:x1876402783768832:12345-192.168.201.23@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789477546.955809:0:14337:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789477546.955818:0:14337:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f518200/0xafddb3c8f9282bc7 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2f7b expref: 12 pid: 14350 timeout: 592 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477546.955858:0:14337:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f518200/0xafddb3c8f9282bc7 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2f7b expref: 12 pid: 14350 timeout: 592 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477546.955890:0:14337:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f518200/0xafddb3c8f9282bc7 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2f7b expref: 12 pid: 14350 timeout: 592 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477546.955910:0:14337:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9d0d44f4e200) 00010000:00010000:1.0:1789477546.955916:0:14337:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50417800/0xafddb3c8f9282bf1 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14352 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477546.955927:0:14337:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50417800/0xafddb3c8f9282bf1 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 14352 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477546.955936:0:14337:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50417800/0xafddb3c8f9282bf1 lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 14352 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477546.955971:0:14337:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789477546.956179:0:14352:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50417800/0xafddb3c8f9282bf1 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14352 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477546.956190:0:14352:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50417800/0xafddb3c8f9282bf1 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14352 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477546.956232:0:14352:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be5000/0xafddb3c8f9282bf8 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14352 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477546.956244:0:14352:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be5000/0xafddb3c8f9282bf8 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14352 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477546.956251:0:14352:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be5000/0xafddb3c8f9282bf8 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14352 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789477546.957802:0:14337:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d6d464700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:43ab5f84-4c5e-451f-a8c7-1cb9f9e2bde0+11:2354:x1876402783768832:12345-192.168.201.23@tcp:103:ldlm_bl.0 Request processed in 2003us (7539us total) trans 0 rc 0/0 00000100:00100000:1.0:1789477546.957819:0:14337:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 10 00010000:00010000:0.0:1789477546.957947:0:14352:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be4000/0xafddb3c8f9282bff lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14352 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477546.957966:0:14352:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be4000/0xafddb3c8f9282bff lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14352 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477546.957980:0:14352:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be4000/0xafddb3c8f9282bff lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14352 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789477546.957994:0:14352:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:0.0:1789477546.958035:0:14352:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50417800/0xafddb3c8f9282bf1 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14352 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477546.958042:0:14352:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50417800/0xafddb3c8f9282bf1 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14352 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477546.958050:0:14352:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50417800/0xafddb3c8f9282bf1 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14352 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477546.958057:0:14352:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d0d50417800 already unused, calling callback (ffffffffc1fd54f0) 00010000:00010000:0.0:1789477546.958062:0:14352:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50417800/0xafddb3c8f9282bf1 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14352 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477546.958071:0:14352:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50417800/0xafddb3c8f9282bf1 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14352 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477546.958086:0:14352:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9d0d44f4e200) 00010000:00010000:0.0:1789477546.958089:0:14352:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789477546.958094:0:14352:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50417800/0xafddb3c8f9282bf1 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14352 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477546.958119:0:14352:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50417800/0xafddb3c8f9282bf1 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14352 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789477546.958137:0:14352:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000877ba460 reply state 0000000081933abf transno 8589934600 ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be5000/0xafddb3c8f9282bf8 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14352 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789477546.958149:0:14352:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1789477546.958198:0:14352:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50416800/0xafddb3c8f9282bea lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2f89 expref: 14 pid: 14352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477546.958215:0:14352:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be4000/0xafddb3c8f9282bff lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2f89 expref: 13 pid: 14352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477546.958441:0:14352:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9d0d43cd1b00) 00010000:00010000:0.0:1789477546.958443:0:14352:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:0.0:1789477546.958446:0:14352:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d0d50be4000, rc 0) 00000100:00100000:0.0:1789477546.958568:0:14352:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d58072d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d98042a3-6618-44a7-81f9-5553c982b325+14:14431:x1876402783768704:12345-192.168.201.23@tcp:101:bash.0 Request processed in 14691us (14995us total) trans 8589934600 rc 0/0 00000100:00100000:0.0:1789477546.958601:0:14352:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 28 00010000:00010000:3.0:1789477546.964878:0:3296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be5000/0xafddb3c8f9282bf8 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14352 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477546.964905:0:3296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be5000/0xafddb3c8f9282bf8 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14352 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477546.964913:0:3296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be5000/0xafddb3c8f9282bf8 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14352 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477546.964921:0:3296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d0d50be5000 already unused, calling callback (ffffffffc1fd54f0) 00010000:00010000:3.0:1789477546.964927:0:3296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be5000/0xafddb3c8f9282bf8 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14352 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477546.964936:0:3296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be5000/0xafddb3c8f9282bf8 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14352 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477546.964959:0:3296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff9d0d43cd1100) 00010000:00010000:3.0:1789477546.964979:0:3296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789477546.964985:0:3296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be5000/0xafddb3c8f9282bf8 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14352 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477546.964991:0:3296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be5000/0xafddb3c8f9282bf8 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14352 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789477546.970804:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:0.0:1789477546.971419:0:14351:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783768960 00000100:00100000:0.0:1789477546.971435:0:14351:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783768960 00000100:00100000:0.0:1789477546.971529:0:14351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 29 00000100:00100000:0.0:1789477546.971543:0:14351:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d6d465180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d98042a3-6618-44a7-81f9-5553c982b325+13:14431:x1876402783768960:12345-192.168.201.23@tcp:101:bash.0 00010000:00010000:0.0:1789477546.971630:0:14351:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789477546.971660:0:14351:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be5c00/0xafddb3c8f9282c0d lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa90d500d7b8f2f90 expref: -99 pid: 14351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477546.971803:0:14351:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be5400/0xafddb3c8f9282c14 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477546.971822:0:14351:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be5400/0xafddb3c8f9282c14 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477546.971837:0:14351:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be5400/0xafddb3c8f9282c14 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14351 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789477546.971892:0:14351:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:0.0:1789477546.971898:0:14351:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1789477546.971923:0:14351:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be5400/0xafddb3c8f9282c14 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477546.971937:0:14351:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be5400/0xafddb3c8f9282c14 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477546.971970:0:14351:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be5c00/0xafddb3c8f9282c0d lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2f90 expref: 15 pid: 14351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477546.971993:0:14351:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be5400/0xafddb3c8f9282c14 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2f90 expref: 14 pid: 14351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477546.972003:0:14351:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9d0d43cd1b00) 00010000:00010000:0.0:1789477546.972006:0:14351:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789477546.972010:0:14351:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d0d50be5400, rc 0) 00000100:00100000:0.0:1789477546.972320:0:14351:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d6d465180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d98042a3-6618-44a7-81f9-5553c982b325+14:14431:x1876402783768960:12345-192.168.201.23@tcp:101:bash.0 Request processed in 778us (1530us total) trans 0 rc 0/0 00000100:00100000:0.0:1789477546.972330:0:14351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 29 00000100:00100000:0.0:1789477546.977057:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:3.0:1789477546.977154:0:14353:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783769216 00000100:00100000:3.0:1789477546.977169:0:14353:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783769216 00000100:00100000:3.0:1789477546.977251:0:14353:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 5 00000100:00100000:3.0:1789477546.977264:0:14353:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d7c1faa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d98042a3-6618-44a7-81f9-5553c982b325+14:14431:x1876402783769216:12345-192.168.201.23@tcp:35:bash.0 00000100:00100000:0.0:1789477546.978849:0:14353:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d7c1faa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d98042a3-6618-44a7-81f9-5553c982b325+15:14431:x1876402783769216:12345-192.168.201.23@tcp:35:bash.0 Request processed in 1574us (1804us total) trans 8589934601 rc 0/0 00000100:00100000:0.0:1789477546.978870:0:14353:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 5 00000100:00100000:2.0:1789477547.054384:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:0.0:1789477547.054847:0:14352:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783769472 00000100:00100000:0.0:1789477547.054861:0:14352:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783769472 00000100:00100000:0.0:1789477547.054985:0:14352:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 30 00000100:00100000:0.0:1789477547.054999:0:14352:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d7c64fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d98042a3-6618-44a7-81f9-5553c982b325+15:14441:x1876402783769472:12345-192.168.201.23@tcp:101:lfs.0 00010000:00010000:0.0:1789477547.055030:0:14352:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789477547.055067:0:14352:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be5c00/0xafddb3c8f9282c1b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa90d500d7b8f2f97 expref: -99 pid: 14352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789477547.055321:0:14352:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00010000:00010000:0.0:1789477547.055480:0:14352:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be5c00/0xafddb3c8f9282c1b lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2f97 expref: 17 pid: 14352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477547.057204:0:14352:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9d0d43cd1000) 00010000:00010000:0.0:1789477547.057217:0:14352:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1789477547.057930:0:14352:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be5c00/0xafddb3c8f9282c1b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2f97 expref: 17 pid: 14352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477547.057960:0:14352:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d0d50be5c00, rc 0) 00000100:00100000:0.0:1789477547.058155:0:14352:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d7c64fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d98042a3-6618-44a7-81f9-5553c982b325+16:14441:x1876402783769472:12345-192.168.201.23@tcp:101:lfs.0 Request processed in 3156us (3784us total) trans 8589934602 rc 301/301 00000100:00100000:0.0:1789477547.058166:0:14352:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 30 00000100:00080000:1.0:1789477547.060288:0:14346:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789477547.060860:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:3.0:1789477547.060913:0:14354:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783769728 00000100:00100000:3.0:1789477547.060925:0:14354:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783769728 00000100:00100000:3.0:1789477547.060991:0:14354:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 6 00000100:00100000:0.0:1789477547.061000:0:14353:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 2 min 2 max 80 00000100:00100000:3.0:1789477547.061004:0:14354:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d7c64f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d98042a3-6618-44a7-81f9-5553c982b325+16:14441:x1876402783769728:12345-192.168.201.23@tcp:35:lfs.0 00000100:00100000:0.0:1789477547.061013:0:14353:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_002' 00000100:00100000:3.0:1789477547.061761:0:14354:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d7c64f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d98042a3-6618-44a7-81f9-5553c982b325+17:14441:x1876402783769728:12345-192.168.201.23@tcp:35:lfs.0 Request processed in 754us (903us total) trans 8589934603 rc 0/0 00000100:00100000:3.0:1789477547.061773:0:14354:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 6 00000100:00100000:3.0:1789477547.084896:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:1.0:1789477547.085200:0:14350:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783769984 00000100:00100000:1.0:1789477547.085213:0:14350:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783769984 00000100:00100000:1.0:1789477547.085293:0:14350:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 31 00000100:00100000:1.0:1789477547.085303:0:14350:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d6d467100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d98042a3-6618-44a7-81f9-5553c982b325+17:14444:x1876402783769984:12345-192.168.201.23@tcp:101:lfs.0 00010000:00010000:1.0:1789477547.085334:0:14350:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789477547.085357:0:14350:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f518400/0xafddb3c8f9282c29 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa90d500d7b8f2f9e expref: -99 pid: 14350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477547.085488:0:14350:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f519e00/0xafddb3c8f9282c30 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14350 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477547.085830:0:14350:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f519e00/0xafddb3c8f9282c30 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14350 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477547.085847:0:14350:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f519e00/0xafddb3c8f9282c30 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14350 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789477547.085862:0:14350:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:1.0:1789477547.086030:0:14350:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f518400/0xafddb3c8f9282c29 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2f9e expref: 20 pid: 14350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477547.086065:0:14350:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f519e00/0xafddb3c8f9282c30 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2f9e expref: 19 pid: 14350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477547.086077:0:14350:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9d0d43cd1b00) 00010000:00010000:1.0:1789477547.086080:0:14350:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789477547.086084:0:14350:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d0d7f519e00, rc 0) 00000100:00100000:1.0:1789477547.086174:0:14350:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d6d467100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d98042a3-6618-44a7-81f9-5553c982b325+19:14444:x1876402783769984:12345-192.168.201.23@tcp:101:lfs.0 Request processed in 871us (1293us total) trans 8589934604 rc 0/0 00000100:00100000:1.0:1789477547.086182:0:14350:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 31 00000100:00100000:1.0:1789477547.092292:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:1.0:1789477547.092344:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:3.0:1789477547.092422:0:14335:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783770112 00000100:00100000:3.0:1789477547.092436:0:14335:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783770112 00000100:00100000:3.0:1789477547.092534:0:14335:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 0 00000100:00100000:3.0:1789477547.092548:0:14335:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d75287800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d98042a3-6618-44a7-81f9-5553c982b325+19:2354:x1876402783770112:12345-192.168.201.23@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789477547.092570:0:14335:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789477547.092637:0:14335:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f519e00/0xafddb3c8f9282c30 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2f9e expref: 19 pid: 14350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789477547.092654:0:14351:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783770240 00000100:00100000:2.0:1789477547.092660:0:14351:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783770240 00010000:00010000:3.0:1789477547.092684:0:14335:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9d0d43cd1b00) 00010000:00010000:3.0:1789477547.092691:0:14335:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789477547.092698:0:14351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 32 00000100:00100000:2.0:1789477547.092705:0:14351:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d75287b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d98042a3-6618-44a7-81f9-5553c982b325+19:14444:x1876402783770240:12345-192.168.201.23@tcp:54:lfs.0 00000100:00100000:3.0:1789477547.092785:0:14335:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d75287800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d98042a3-6618-44a7-81f9-5553c982b325+19:2354:x1876402783770112:12345-192.168.201.23@tcp:103:ldlm_bl.0 Request processed in 239us (507us total) trans 0 rc 0/0 00000100:00100000:3.0:1789477547.092793:0:14335:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 0 00010000:00010000:2.0:1789477547.092813:0:14351:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50416800/0xafddb3c8f9282c3e lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477547.092830:0:14351:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50416800/0xafddb3c8f9282c3e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477547.092845:0:14351:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50416800/0xafddb3c8f9282c3e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477547.092879:0:14351:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50416800/0xafddb3c8f9282c3e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477547.092887:0:14351:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50416800/0xafddb3c8f9282c3e lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477547.092893:0:14351:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50416800/0xafddb3c8f9282c3e lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477547.092900:0:14351:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d0d50416800 already unused, calling callback (ffffffffc1fd54f0) 00010000:00010000:2.0:1789477547.092905:0:14351:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50416800/0xafddb3c8f9282c3e lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477547.092914:0:14351:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50416800/0xafddb3c8f9282c3e lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477547.092922:0:14351:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9d0d43cd1b00) 00010000:00010000:2.0:1789477547.092925:0:14351:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789477547.092935:0:14351:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50416800/0xafddb3c8f9282c3e lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477547.092941:0:14351:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50416800/0xafddb3c8f9282c3e lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14351 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789477547.092978:0:14351:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d75287b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d98042a3-6618-44a7-81f9-5553c982b325+18:14444:x1876402783770240:12345-192.168.201.23@tcp:54:lfs.0 Request processed in 273us (633us total) trans 0 rc 0/0 00000100:00100000:2.0:1789477547.092985:0:14351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 32 00000100:00100000:2.0:1789477547.095743:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:0.0:1789477547.095845:0:14353:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783770496 00000100:00100000:0.0:1789477547.095859:0:14353:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783770496 00000100:00100000:0.0:1789477547.095927:0:14353:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 7 00000100:00100000:0.0:1789477547.095939:0:14353:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d7c64c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d98042a3-6618-44a7-81f9-5553c982b325+18:14444:x1876402783770496:12345-192.168.201.23@tcp:35:lfs.0 00000100:00100000:0.0:1789477547.096256:0:14353:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d7c64c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d98042a3-6618-44a7-81f9-5553c982b325+19:14444:x1876402783770496:12345-192.168.201.23@tcp:35:lfs.0 Request processed in 317us (535us total) trans 8589934605 rc 0/0 00000100:00100000:0.0:1789477547.096265:0:14353:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 7 00000040:00080000:3.0:1789477547.248407:0:14385:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1789477547.313820:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:2.0:1789477547.313948:0:14350:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783770752 00000100:00100000:2.0:1789477547.313962:0:14350:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783770752 00000100:00100000:2.0:1789477547.314042:0:14350:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 33 00000100:00100000:2.0:1789477547.314054:0:14350:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d75285f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d98042a3-6618-44a7-81f9-5553c982b325+19:14475:x1876402783770752:12345-192.168.201.23@tcp:101:cat.0 00010000:00010000:2.0:1789477547.314088:0:14350:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789477547.314131:0:14350:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50416800/0xafddb3c8f9282c45 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa90d500d7b8f2fa5 expref: -99 pid: 14350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477547.314271:0:14350:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50417800/0xafddb3c8f9282c4c lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14350 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477547.314290:0:14350:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50417800/0xafddb3c8f9282c4c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14350 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477547.314304:0:14350:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50417800/0xafddb3c8f9282c4c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14350 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789477547.314318:0:14350:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1789477547.314515:0:14350:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50416800/0xafddb3c8f9282c45 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2fa5 expref: 22 pid: 14350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477547.314562:0:14350:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50417800/0xafddb3c8f9282c4c lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2fa5 expref: 21 pid: 14350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477547.314572:0:14350:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9d0d43cd1b00) 00010000:00010000:2.0:1789477547.314710:0:14350:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789477547.314727:0:14350:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d0d50417800, rc 0) 00000100:00100000:2.0:1789477547.314804:0:14350:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d75285f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d98042a3-6618-44a7-81f9-5553c982b325+21:14475:x1876402783770752:12345-192.168.201.23@tcp:101:cat.0 Request processed in 751us (997us total) trans 8589934606 rc 0/0 00000100:00100000:2.0:1789477547.314811:0:14350:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 33 00000100:00100000:1.0:1789477547.325135:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:1.0:1789477547.325195:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:2.0:1789477547.325328:0:16467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783770880 00000100:00100000:3.0:1789477547.325340:0:14354:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783771136 00000100:00100000:2.0:1789477547.325341:0:16467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783770880 00000100:00100000:3.0:1789477547.325344:0:14354:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783771136 00000100:00100000:3.0:1789477547.325415:0:14354:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 8 00000100:00100000:2.0:1789477547.325415:0:16467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 1 00000100:00100000:3.0:1789477547.325428:0:14354:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d75284700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d98042a3-6618-44a7-81f9-5553c982b325+22:14475:x1876402783771136:12345-192.168.201.23@tcp:35:cat.0 00000100:00100000:2.0:1789477547.325428:0:16467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d75284e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d98042a3-6618-44a7-81f9-5553c982b325+22:2354:x1876402783770880:12345-192.168.201.23@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789477547.325447:0:16467:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789477547.325478:0:16467:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50417800/0xafddb3c8f9282c4c lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2fa5 expref: 22 pid: 14350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477547.325502:0:16467:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9d0d43cd1b00) 00010000:00010000:2.0:1789477547.325508:0:16467:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789477547.325574:0:16467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d75284e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d98042a3-6618-44a7-81f9-5553c982b325+21:2354:x1876402783770880:12345-192.168.201.23@tcp:103:ldlm_bl.0 Request processed in 150us (457us total) trans 0 rc 0/0 00000100:00100000:2.0:1789477547.325619:0:16467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 1 00000100:00100000:3.0:1789477547.325851:0:14354:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d75284700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d98042a3-6618-44a7-81f9-5553c982b325+21:14475:x1876402783771136:12345-192.168.201.23@tcp:35:cat.0 Request processed in 425us (654us total) trans 8589934607 rc 0/0 00000100:00100000:3.0:1789477547.325857:0:14354:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 8 00000100:00100000:1.0:1789477547.388352:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:0.0:1789477547.388502:0:14352:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783771392 00000100:00100000:0.0:1789477547.388517:0:14352:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783771392 00000100:00100000:0.0:1789477547.388638:0:14352:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 34 00000100:00100000:0.0:1789477547.388650:0:14352:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d7f700e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d98042a3-6618-44a7-81f9-5553c982b325+21:14481:x1876402783771392:12345-192.168.201.23@tcp:101:dd.0 00010000:00010000:0.0:1789477547.388683:0:14352:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789477547.388708:0:14352:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be5c00/0xafddb3c8f9282c5a lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa90d500d7b8f2fac expref: -99 pid: 14352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477547.388869:0:14352:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be5e00/0xafddb3c8f9282c61 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14352 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477547.388885:0:14352:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be4000/0xafddb3c8f9282bff lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2f89 expref: 22 pid: 14352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477547.388895:0:14352:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be5400/0xafddb3c8f9282c14 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2f90 expref: 22 pid: 14351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477547.388904:0:14352:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be5e00/0xafddb3c8f9282c61 lrc: 5/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14352 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477547.388946:0:14352:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be5400/0xafddb3c8f9282c14 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2f90 expref: 22 pid: 14351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477547.388979:0:14352:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be5400/0xafddb3c8f9282c14 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2f90 expref: 22 pid: 14351 timeout: 592 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789477547.388995:0:14352:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d7c1fb800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14352:1876402802630784:192.168.201.23@tcp:104: 00010000:00010000:0.0:1789477547.389129:0:14352:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be4000/0xafddb3c8f9282bff lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2f89 expref: 22 pid: 14352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477547.389138:0:14352:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be4000/0xafddb3c8f9282bff lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2f89 expref: 22 pid: 14352 timeout: 592 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789477547.389147:0:14352:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d7c1f9f80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14352:1876402802630912:192.168.201.23@tcp:104: 00000100:00100000:0.0:1789477547.389170:0:14352:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d0d58576f00 going to sleep for 11 seconds 00000100:00100000:0.0:1789477547.393731:0:14352:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d7c1fb800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14352:1876402802630784:192.168.201.23@tcp:104: 00000100:00100000:0.0:1789477547.393754:0:14352:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d7c1f9f80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14352:1876402802630912:192.168.201.23@tcp:104: 00010000:00010000:0.0:1789477547.393790:0:14352:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be5e00/0xafddb3c8f9282c61 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14352 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789477547.397864:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:1.0:1789477547.397948:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:0.0:1789477547.398146:0:14336:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783771520 00000100:00100000:0.0:1789477547.398160:0:14336:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783771520 00010000:00010000:0.0:1789477547.398228:0:14336:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be5400/0xafddb3c8f9282c14 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2f90 expref: 23 pid: 14351 timeout: 592 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789477547.398332:0:14336:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783771648 00000100:00100000:0.0:1789477547.398336:0:14336:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783771648 00010000:00010000:0.0:1789477547.398351:0:14336:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be4000/0xafddb3c8f9282bff lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2f89 expref: 24 pid: 14352 timeout: 592 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789477547.398456:0:14335:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 11 00000100:00100000:3.0:1789477547.398470:0:14335:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d4e64d050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d98042a3-6618-44a7-81f9-5553c982b325+24:2355:x1876402783771520:12345-192.168.201.23@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1789477547.398625:0:16467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 12 00000100:00100000:2.0:1789477547.398635:0:16467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d7f702300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d98042a3-6618-44a7-81f9-5553c982b325+24:2355:x1876402783771648:12345-192.168.201.23@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789477547.398653:0:16467:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789477547.398661:0:16467:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be4000/0xafddb3c8f9282bff lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2f89 expref: 24 pid: 14352 timeout: 592 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477547.398674:0:16467:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be4000/0xafddb3c8f9282bff lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2f89 expref: 24 pid: 14352 timeout: 592 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477547.398703:0:16467:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be4000/0xafddb3c8f9282bff lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2f89 expref: 24 pid: 14352 timeout: 592 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477547.398739:0:16467:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9d0d43cd1b00) 00010000:00010000:2.0:1789477547.398745:0:16467:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be5e00/0xafddb3c8f9282c61 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14352 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477547.398755:0:16467:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be5e00/0xafddb3c8f9282c61 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14352 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477547.398762:0:16467:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789477547.398833:0:16467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d7f702300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d98042a3-6618-44a7-81f9-5553c982b325+23:2355:x1876402783771648:12345-192.168.201.23@tcp:103:ldlm_bl.0 Request processed in 200us (884us total) trans 0 rc 0/0 00000100:00100000:2.0:1789477547.398842:0:16467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 12 00010000:00010000:3.0:1789477547.400338:0:14335:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789477547.400362:0:14335:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be5400/0xafddb3c8f9282c14 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2f90 expref: 22 pid: 14351 timeout: 592 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477547.400382:0:14335:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be5400/0xafddb3c8f9282c14 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2f90 expref: 22 pid: 14351 timeout: 592 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477547.400410:0:14335:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be5400/0xafddb3c8f9282c14 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2f90 expref: 22 pid: 14351 timeout: 592 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477547.400450:0:14335:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9d0d43cd1b00) 00010000:00010000:3.0:1789477547.400456:0:14335:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be5e00/0xafddb3c8f9282c61 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14352 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477547.400466:0:14335:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be5e00/0xafddb3c8f9282c61 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 14352 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477547.400475:0:14335:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be5e00/0xafddb3c8f9282c61 lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 14352 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477547.400747:0:14335:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789477547.400823:0:14335:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d4e64d050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d98042a3-6618-44a7-81f9-5553c982b325+21:2355:x1876402783771520:12345-192.168.201.23@tcp:103:ldlm_bl.0 Request processed in 2354us (2972us total) trans 0 rc 0/0 00000100:00100000:3.0:1789477547.400834:0:14335:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 11 00010000:00010000:2.0:1789477547.402821:0:14352:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be5e00/0xafddb3c8f9282c61 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14352 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477547.402844:0:14352:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be5e00/0xafddb3c8f9282c61 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14352 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789477547.402873:0:14352:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:3.0:1789477547.403345:0:14352:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be5c00/0xafddb3c8f9282c5a lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2fac expref: 22 pid: 14352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477547.403374:0:14352:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be5e00/0xafddb3c8f9282c61 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2fac expref: 21 pid: 14352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477547.403385:0:14352:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9d0d43cd1b00) 00010000:00010000:3.0:1789477547.403388:0:14352:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1789477547.403392:0:14352:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d0d50be5e00, rc 0) 00000100:00100000:3.0:1789477547.403893:0:14352:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d7f700e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d98042a3-6618-44a7-81f9-5553c982b325+21:14481:x1876402783771392:12345-192.168.201.23@tcp:101:dd.0 Request processed in 15242us (15553us total) trans 8589934608 rc 0/0 00000100:00100000:3.0:1789477547.403905:0:14352:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 34 00000100:00100000:1.0:1789477547.406776:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:0.0:1789477547.406891:0:14351:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783771904 00000100:00100000:0.0:1789477547.406906:0:14351:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783771904 00000100:00100000:0.0:1789477547.407031:0:14351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 35 00000100:00100000:0.0:1789477547.407054:0:14351:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d74a89180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d98042a3-6618-44a7-81f9-5553c982b325+21:14481:x1876402783771904:12345-192.168.201.23@tcp:36:dd.0 00010000:00010000:0.0:1789477547.407701:0:14351:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be4800/0xafddb3c8f9282c6f lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477547.407735:0:14351:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be4800/0xafddb3c8f9282c6f lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477547.407750:0:14351:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be4800/0xafddb3c8f9282c6f lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14351 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789477547.407847:0:14351:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934609 00000004:00010000:0.0:1789477547.407876:0:14351:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000418cb731 reply state 00000000343c0f70 transno 8589934610 ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be4800/0xafddb3c8f9282c6f lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14351 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789477547.407885:0:14351:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789477547.408066:0:14351:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d74a89180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d98042a3-6618-44a7-81f9-5553c982b325+24:14481:x1876402783771904:12345-192.168.201.23@tcp:36:dd.0 Request processed in 1012us (1302us total) trans 8589934610 rc 0/0 00000100:00100000:0.0:1789477547.408075:0:14351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 35 00000020:00080000:0.0:1789477547.408082:0:14351:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1789477547.411486:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00010000:00010000:2.0:1789477547.411788:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be4800/0xafddb3c8f9282c6f lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477547.411811:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be4800/0xafddb3c8f9282c6f lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477547.411820:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be4800/0xafddb3c8f9282c6f lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477547.411827:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d0d50be4800 already unused, calling callback (ffffffffc1fd54f0) 00010000:00010000:2.0:1789477547.411833:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be4800/0xafddb3c8f9282c6f lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477547.411842:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be4800/0xafddb3c8f9282c6f lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477547.411865:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9d0d43cd1b00) 00010000:00010000:2.0:1789477547.411869:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789477547.411874:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be4800/0xafddb3c8f9282c6f lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477547.411881:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be4800/0xafddb3c8f9282c6f lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14351 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789477547.411971:0:14352:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783772032 00000100:00100000:0.0:1789477547.411988:0:14352:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783772032 00000100:00100000:0.0:1789477547.412071:0:14352:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 36 00000100:00100000:0.0:1789477547.412084:0:14352:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d6d464700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d98042a3-6618-44a7-81f9-5553c982b325+23:14481:x1876402783772032:12345-192.168.201.23@tcp:101:dd.0 00010000:00010000:0.0:1789477547.412121:0:14352:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789477547.412147:0:14352:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be4000/0xafddb3c8f9282c76 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa90d500d7b8f2fb3 expref: -99 pid: 14352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477547.412251:0:14352:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be4000/0xafddb3c8f9282c76 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2fb3 expref: 24 pid: 14352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477547.412267:0:14352:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be4000/0xafddb3c8f9282c76 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2fb3 expref: 24 pid: 14352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477547.412289:0:14352:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9d0d43cd1b00) 00010000:00010000:0.0:1789477547.412292:0:14352:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789477547.412295:0:14352:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d0d50be4000, rc 0) 00000100:00100000:0.0:1789477547.412767:0:14352:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d6d464700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d98042a3-6618-44a7-81f9-5553c982b325+24:14481:x1876402783772032:12345-192.168.201.23@tcp:101:dd.0 Request processed in 683us (1295us total) trans 0 rc 0/0 00000100:00100000:0.0:1789477547.412775:0:14352:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 36 00000100:00100000:3.0:1789477547.424895:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:2.0:1789477547.425186:0:16467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783772288 00000100:00100000:2.0:1789477547.425199:0:16467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783772288 00000100:00100000:2.0:1789477547.425282:0:16467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 2 00000100:00100000:2.0:1789477547.425296:0:16467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d6d465c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d98042a3-6618-44a7-81f9-5553c982b325+24:14481:x1876402783772288:12345-192.168.201.23@tcp:103:dd.0 00010000:00010000:2.0:1789477547.425317:0:16467:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789477547.425349:0:16467:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be4000/0xafddb3c8f9282c76 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2fb3 expref: 24 pid: 14352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477547.425394:0:16467:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9d0d43cd1b00) 00010000:00010000:2.0:1789477547.425398:0:16467:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789477547.425468:0:16467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d6d465c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d98042a3-6618-44a7-81f9-5553c982b325+23:14481:x1876402783772288:12345-192.168.201.23@tcp:103:dd.0 Request processed in 176us (586us total) trans 0 rc 0/0 00000100:00100000:2.0:1789477547.425477:0:16467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 2 00000100:00100000:1.0:1789477547.427472:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:0.0:1789477547.428017:0:14351:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783772416 00000100:00100000:0.0:1789477547.428044:0:14351:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783772416 00000100:00100000:0.0:1789477547.428159:0:14351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 37 00000100:00100000:0.0:1789477547.428171:0:14351:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d74a8a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d98042a3-6618-44a7-81f9-5553c982b325+23:14481:x1876402783772416:12345-192.168.201.23@tcp:58:dd.0 00010000:00010000:0.0:1789477547.428317:0:14351:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be5000/0xafddb3c8f9282c7d lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477547.428339:0:14351:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be5000/0xafddb3c8f9282c7d lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477547.428353:0:14351:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be5000/0xafddb3c8f9282c7d lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14351 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1789477547.429769:0:14351:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1789477547.429943:0:14351:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 64 off8320 00000040:00080000:0.0:1789477547.430044:0:14351:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xe:0x0].1, 136 off8328 00000100:00100000:0.0:1789477547.430408:0:14351:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d74a8a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d98042a3-6618-44a7-81f9-5553c982b325+23:14481:x1876402783772416:12345-192.168.201.23@tcp:58:dd.0 Request processed in 2229us (2940us total) trans 0 rc 0/0 00000100:00100000:0.0:1789477547.430421:0:14351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 37 00000100:00100000:3.0:1789477547.433136:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:0.0:1789477547.433236:0:14352:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783772544 00000100:00100000:0.0:1789477547.433250:0:14352:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783772544 00000100:00100000:0.0:1789477547.433329:0:14352:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 38 00000100:00100000:0.0:1789477547.433342:0:14352:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d6d466a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d98042a3-6618-44a7-81f9-5553c982b325+23:14481:x1876402783772544:12345-192.168.201.23@tcp:101:dd.0 00010000:00010000:0.0:1789477547.433371:0:14352:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789477547.433400:0:14352:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be4800/0xafddb3c8f9282c84 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa90d500d7b8f2fba expref: -99 pid: 14352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477547.433476:0:14352:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be5000/0xafddb3c8f9282c7d lrc: 2/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477547.433731:0:14352:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be4800/0xafddb3c8f9282c84 lrc: 4/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2fba expref: 24 pid: 14352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477547.433760:0:14352:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be5000/0xafddb3c8f9282c7d lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 14351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477547.433778:0:14352:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be4800/0xafddb3c8f9282c84 lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2fba expref: 24 pid: 14352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477547.433795:0:14352:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9d0d43cd1b00) 00010000:00010000:0.0:1789477547.433797:0:14352:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789477547.433802:0:14352:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be4800/0xafddb3c8f9282c84 lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2fba expref: 24 pid: 14352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477547.433832:0:14352:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d0d50be4800, rc 0) 00000100:00100000:0.0:1789477547.433982:0:14352:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d6d466a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d98042a3-6618-44a7-81f9-5553c982b325+24:14481:x1876402783772544:12345-192.168.201.23@tcp:101:dd.0 Request processed in 642us (859us total) trans 0 rc 0/0 00000100:00100000:0.0:1789477547.433990:0:14352:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 38 00000100:00100000:1.0:1789477547.439984:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d6d467b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:730ef4b7-dbd8-4cb5-9f31-5e7e04ae8864:3312:1876402802631040:0@lo:400:kworker.0 00000100:00100000:1.0:1789477547.440101:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789477547.440604:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d6d465500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1876402802631296:0@lo:400:kworker.0 00000100:00100000:2.0:1789477547.440652:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789477547.440687:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789477547.440694:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d6d464a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1876402802631424:0@lo:400:kworker.0 00000100:00100000:2.0:1789477547.440733:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789477547.440766:0:15469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802631296 00000100:00100000:2.0:1789477547.440774:0:15469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802631296 00000100:00100000:2.0:1789477547.440832:0:15469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802631424 00000100:00100000:2.0:1789477547.440834:0:15469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802631424 00000100:00100000:2.0:1789477547.440859:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1789477547.440868:0:15469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d7c64d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3310:x1876402802631296:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789477547.440926:0:15469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d7c64d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3310:x1876402802631296:12345-0@lo:400:kworker.0 Request processed in 59us (274us total) trans 0 rc 0/0 00000100:00100000:2.0:1789477547.440934:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1789477547.440952:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1789477547.440958:0:15469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d7523f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3310:x1876402802631424:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789477547.440982:0:15469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d7523f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3310:x1876402802631424:12345-0@lo:400:kworker.0 Request processed in 24us (249us total) trans 0 rc 0/0 00000100:00100000:2.0:1789477547.440989:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1789477547.441043:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d6d464a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1876402802631424:0@lo:400:kworker.0 00000100:00100000:2.0:1789477547.441075:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d6d465500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1876402802631296:0@lo:400:kworker.0 00000100:00100000:1.0:1789477547.444937:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d6d464000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3312:1876402802631552:0@lo:400:kworker.0 00000100:00100000:1.0:1789477547.445049:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789477547.445120:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789477547.445129:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d7c1f9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1876402802631168:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789477547.445162:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789477547.445244:0:14345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802631040 00000100:00100000:1.0:1789477547.445254:0:14345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802631040 00000100:00100000:1.0:1789477547.445317:0:14345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:1.0:1789477547.445327:0:14345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d6ec55850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:730ef4b7-dbd8-4cb5-9f31-5e7e04ae8864+19:3312:x1876402802631040:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789477547.445386:0:14345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d6ec55850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:730ef4b7-dbd8-4cb5-9f31-5e7e04ae8864+19:3312:x1876402802631040:12345-0@lo:400:kworker.0 Request processed in 60us (5285us total) trans 0 rc 0/0 00000100:00100000:1.0:1789477547.445395:0:14345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:1.0:1789477547.445446:0:15041:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802631168 00000100:00100000:1.0:1789477547.445450:0:15041:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802631168 00000100:00100000:1.0:1789477547.445480:0:15041:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1789477547.445486:0:15041:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d74a89c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1876402802631168:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789477547.445523:0:15041:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789477547.445557:0:15041:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d74a89c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1876402802631168:12345-0@lo:13:osp-pre-1-0.0 Request processed in 71us (394us total) trans 0 rc 0/0 00000100:00100000:1.0:1789477547.445608:0:15041:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00080000:1.0:1789477547.445635:0:14346:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789477547.445641:0:14346:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789477547.445689:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d7c1f9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1876402802631168:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789477547.445705:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d6d467b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:730ef4b7-dbd8-4cb5-9f31-5e7e04ae8864:3312:1876402802631040:0@lo:400:kworker.0 00000100:00100000:2.0:1789477547.446054:0:14351:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802631552 00000100:00100000:2.0:1789477547.446060:0:14351:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802631552 00000100:00100000:2.0:1789477547.446103:0:14351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1789477547.446112:0:14351:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d74a88700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1876402802631552:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789477547.446160:0:14351:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d74a88700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1876402802631552:12345-0@lo:400:kworker.0 Request processed in 50us (1111us total) trans 0 rc 0/0 00000100:00100000:2.0:1789477547.446167:0:14351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1789477547.446337:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d6d464000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3312:1876402802631552:0@lo:400:kworker.0 00000100:00100000:3.0:1789477547.446673:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789477547.446686:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d6d467800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3311:1876402802631808:0@lo:400:kworker.0 00000100:00100000:3.0:1789477547.446743:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789477547.446858:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d6d465f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3313:1876402802631680:0@lo:400:kworker.0 00000100:00100000:0.0:1789477547.446891:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789477547.446933:0:14352:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802631808 00000100:00100000:0.0:1789477547.446938:0:14352:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802631808 00000100:00100000:0.0:1789477547.446992:0:14350:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802631680 00000100:00100000:0.0:1789477547.446995:0:14350:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802631680 00000100:00100000:0.0:1789477547.447015:0:14350:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1789477547.447021:0:14350:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d6d466680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1876402802631808:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789477547.447120:0:14351:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:2.0:1789477547.447130:0:14351:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:0.0:1789477547.447204:0:14350:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d6d466680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1876402802631808:12345-0@lo:400:kworker.0 Request processed in 182us (460us total) trans 0 rc 0/0 00000100:00100000:2.0:1789477547.447311:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d6d467800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3311:1876402802631808:0@lo:400:kworker.0 00000100:00100000:0.0:1789477547.447346:0:14350:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1789477547.447365:0:14350:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1789477547.447371:0:14350:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d7c1fb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1876402802631680:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789477547.447412:0:14350:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d7c1fb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1876402802631680:12345-0@lo:400:kworker.0 Request processed in 41us (520us total) trans 0 rc 0/0 00000100:00100000:0.0:1789477547.447418:0:14350:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1789477547.447478:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d6d465f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3313:1876402802631680:0@lo:400:kworker.0 00000100:00080000:3.0:1789477547.447823:0:14346:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1789477547.824495:0:14338:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1789477548.054788:0:5868:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934610 is committed 00000001:00080000:2.0:1789477548.054825:0:5868:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934596 is committed 00000001:00080000:2.0:1789477548.054845:0:5868:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934598 is committed 00000001:00080000:2.0:1789477548.054866:0:5868:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934599 is committed 00000040:00080000:3.0:1789477548.272173:0:14385:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1789477548.272186:0:14385:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1789477548.272236:0:14385:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:3.0:1789477548.272246:0:14385:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:3.0:1789477548.272430:0:14385:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d6d466300 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:14385:1876402802631936:192.168.201.23@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1789477548.272603:0:14385:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d0d46da99c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789477548.277806:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:1.0:1789477548.277936:0:14361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783772672 00000100:00100000:1.0:1789477548.277949:0:14361:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783772672 00000100:00100000:1.0:1789477548.278014:0:14361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 0 00000100:00100000:1.0:1789477548.278027:0:14361:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d7523c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:d98042a3-6618-44a7-81f9-5553c982b325+12:14482:x1876402783772672:12345-192.168.201.23@tcp:900:lhsmtool_posix.0 00000100:00100000:1.0:1789477548.278140:0:14361:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d7523c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:d98042a3-6618-44a7-81f9-5553c982b325+12:14482:x1876402783772672:12345-192.168.201.23@tcp:900:lhsmtool_posix.0 Request processed in 115us (348us total) trans 0 rc 0/0 00000100:00100000:1.0:1789477548.278149:0:14361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 0 00000100:00100000:3.0:1789477548.279415:0:14385:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d6d466300 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:14385:1876402802631936:192.168.201.23@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1789477548.279993:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:0.0:1789477548.280575:0:14350:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783772800 00000100:00100000:0.0:1789477548.280630:0:14350:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783772800 00000100:00100000:0.0:1789477548.280771:0:14350:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 39 00000100:00100000:0.0:1789477548.280782:0:14350:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d74a8a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d98042a3-6618-44a7-81f9-5553c982b325+11:14482:x1876402783772800:12345-192.168.201.23@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1789477548.280823:0:14350:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1789477548.281207:0:14350:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d74a8a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d98042a3-6618-44a7-81f9-5553c982b325+11:14482:x1876402783772800:12345-192.168.201.23@tcp:53:lhsmtool_posix.0 Request processed in 425us (1213us total) trans 0 rc 0/0 00000100:00100000:0.0:1789477548.281216:0:14350:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 39 00000100:00100000:3.0:1789477548.287840:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:2.0:1789477548.295392:0:14352:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783772928 00000100:00100000:2.0:1789477548.295413:0:14352:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783772928 00000100:00100000:2.0:1789477548.295531:0:14352:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 40 00000100:00100000:2.0:1789477548.295544:0:14352:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d6d466300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d98042a3-6618-44a7-81f9-5553c982b325+11:14482:x1876402783772928:12345-192.168.201.23@tcp:34:lhsmtool_posix.0 00010000:00010000:2.0:1789477548.295670:0:14352:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50416800/0xafddb3c8f9282c8b lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14352 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477548.295692:0:14352:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50416800/0xafddb3c8f9282c8b lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14352 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477548.295738:0:14352:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50416800/0xafddb3c8f9282c8b lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14352 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477548.297728:0:14352:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50416200/0xafddb3c8f9282c92 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14352 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477548.297754:0:14352:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50416200/0xafddb3c8f9282c92 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14352 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477548.297768:0:14352:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50416200/0xafddb3c8f9282c92 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14352 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477548.297802:0:14352:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50417200/0xafddb3c8f9282c99 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14352 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477548.297810:0:14352:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50417200/0xafddb3c8f9282c99 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14352 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477548.297817:0:14352:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50417200/0xafddb3c8f9282c99 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14352 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789477548.297863:0:14352:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:2.0:1789477548.297868:0:14352:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1789477548.297886:0:14352:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50417200/0xafddb3c8f9282c99 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14352 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477548.297899:0:14352:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50416800/0xafddb3c8f9282c8b lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14352 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477548.297905:0:14352:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50416800/0xafddb3c8f9282c8b lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14352 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477548.297928:0:14352:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50416800/0xafddb3c8f9282c8b lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14352 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477548.297935:0:14352:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d0d50416800 already unused, calling callback (ffffffffc1fd54f0) 00010000:00010000:2.0:1789477548.297940:0:14352:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50416800/0xafddb3c8f9282c8b lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14352 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477548.297948:0:14352:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50416800/0xafddb3c8f9282c8b lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14352 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477548.297961:0:14352:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9d0d43cd1400) 00010000:00010000:2.0:1789477548.297964:0:14352:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789477548.297968:0:14352:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50416800/0xafddb3c8f9282c8b lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14352 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477548.297975:0:14352:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50416800/0xafddb3c8f9282c8b lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14352 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477548.297991:0:14352:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50416200/0xafddb3c8f9282c92 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14352 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477548.297997:0:14352:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50416200/0xafddb3c8f9282c92 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14352 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477548.298002:0:14352:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50416200/0xafddb3c8f9282c92 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14352 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477548.298007:0:14352:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d0d50416200 already unused, calling callback (ffffffffc1fd54f0) 00010000:00010000:2.0:1789477548.298010:0:14352:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50416200/0xafddb3c8f9282c92 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14352 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477548.298026:0:14352:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50416200/0xafddb3c8f9282c92 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14352 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477548.298037:0:14352:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x4549062c (ffff9d0d50919c00) 00010000:00010000:2.0:1789477548.298039:0:14352:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789477548.298042:0:14352:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50416200/0xafddb3c8f9282c92 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14352 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477548.298048:0:14352:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50416200/0xafddb3c8f9282c92 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14352 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477548.298064:0:14352:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50417200/0xafddb3c8f9282c99 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14352 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477548.298081:0:14352:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50417200/0xafddb3c8f9282c99 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14352 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477548.298086:0:14352:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50417200/0xafddb3c8f9282c99 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14352 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477548.298091:0:14352:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d0d50417200 already unused, calling callback (ffffffffc1fd54f0) 00010000:00010000:2.0:1789477548.298094:0:14352:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50417200/0xafddb3c8f9282c99 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14352 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477548.298100:0:14352:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50417200/0xafddb3c8f9282c99 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14352 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477548.298107:0:14352:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9d0d43cd1b00) 00010000:00010000:2.0:1789477548.298110:0:14352:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789477548.298113:0:14352:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50417200/0xafddb3c8f9282c99 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14352 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477548.298128:0:14352:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50417200/0xafddb3c8f9282c99 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14352 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789477548.298341:0:14352:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d6d466300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d98042a3-6618-44a7-81f9-5553c982b325+11:14482:x1876402783772928:12345-192.168.201.23@tcp:34:lhsmtool_posix.0 Request processed in 2687us (10403us total) trans 0 rc 0/0 00000100:00100000:2.0:1789477548.298352:0:14352:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 40 00000100:00100000:1.0:1789477548.312755:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:2.0:1789477548.312839:0:14352:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783773184 00000100:00100000:2.0:1789477548.312855:0:14352:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783773184 00000100:00100000:2.0:1789477548.312962:0:14352:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 41 00000100:00100000:2.0:1789477548.312973:0:14352:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d74a8b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d98042a3-6618-44a7-81f9-5553c982b325+11:14482:x1876402783773184:12345-192.168.201.23@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789477548.312995:0:14352:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789477548.313016:0:14352:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50417200/0xafddb3c8f9282ca0 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa90d500d7b8f2fc1 expref: -99 pid: 14352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477548.313127:0:14352:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50416200/0xafddb3c8f9282ca7 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14352 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477548.313142:0:14352:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50416200/0xafddb3c8f9282ca7 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14352 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477548.313154:0:14352:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50416200/0xafddb3c8f9282ca7 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14352 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789477548.313166:0:14352:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1789477548.313319:0:14352:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50416200/0xafddb3c8f9282ca7 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14352 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477548.313328:0:14352:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50416200/0xafddb3c8f9282ca7 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14352 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477548.313351:0:14352:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50416200/0xafddb3c8f9282ca7 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14352 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477548.313357:0:14352:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d0d50416200 already unused, calling callback (ffffffffc1fd54f0) 00010000:00010000:2.0:1789477548.313361:0:14352:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50416200/0xafddb3c8f9282ca7 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14352 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477548.313380:0:14352:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50416200/0xafddb3c8f9282ca7 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14352 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477548.313393:0:14352:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9d0d43cd1b00) 00010000:00010000:2.0:1789477548.313397:0:14352:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1789477548.313401:0:14352:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50416200/0xafddb3c8f9282ca7 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14352 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477548.313408:0:14352:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50416200/0xafddb3c8f9282ca7 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14352 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477548.313452:0:14352:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50417200/0xafddb3c8f9282ca0 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2fc1 expref: 13 pid: 14352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477548.313462:0:14352:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9d0d43cd1400) 00010000:00010000:2.0:1789477548.313464:0:14352:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789477548.313468:0:14352:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50417200/0xafddb3c8f9282ca0 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2fc1 expref: 13 pid: 14352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477548.313477:0:14352:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d0d50417200, rc 0) 00000100:00100000:2.0:1789477548.313549:0:14352:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d74a8b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d98042a3-6618-44a7-81f9-5553c982b325+12:14482:x1876402783773184:12345-192.168.201.23@tcp:101:lhsmtool_posix.0 Request processed in 578us (817us total) trans 8589934611 rc 301/301 00000100:00100000:2.0:1789477548.313567:0:14352:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 41 00000100:00100000:2.0:1789477548.325954:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:1.0:1789477548.327225:0:14350:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783773312 00000100:00100000:1.0:1789477548.327247:0:14350:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783773312 00000100:00100000:1.0:1789477548.327323:0:14350:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 42 00000100:00100000:1.0:1789477548.327334:0:14350:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d7523d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d98042a3-6618-44a7-81f9-5553c982b325+12:14482:x1876402783773312:12345-192.168.201.23@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1789477548.327559:0:14350:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1789477548.328305:0:14350:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d7523d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d98042a3-6618-44a7-81f9-5553c982b325+12:14482:x1876402783773312:12345-192.168.201.23@tcp:53:lhsmtool_posix.0 Request processed in 968us (2355us total) trans 0 rc 0/0 00000100:00100000:1.0:1789477548.328316:0:14350:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 42 00000100:00100000:1.0:1789477548.337456:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:3.0:1789477548.337621:0:16579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783773568 00000100:00100000:3.0:1789477548.337630:0:16579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783773568 00000100:00100000:3.0:1789477548.337694:0:16579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 43 00000100:00100000:3.0:1789477548.337737:0:16579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d74a8aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d98042a3-6618-44a7-81f9-5553c982b325+12:14482:x1876402783773568:12345-192.168.201.23@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789477548.337758:0:16579:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789477548.337778:0:16579:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d41647000/0xafddb3c8f9282cb5 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa90d500d7b8f2fc8 expref: -99 pid: 16579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1789477548.338834:0:16579:0:(osp_internal.h:553:osp_update_last_fid()) Gap in objids: start=[0x240000400:0x6:0x0], count =28 00000004:00080000:3.0:1789477548.338843:0:16579:0:(osp_object.c:1645:osp_create()) Writing gap [0x240000400:0x6:0x0]+28 in llog 00000004:00080000:3.0:1789477548.338891:0:16579:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x22:0x0], index 0: 0 00010000:00010000:3.0:1789477548.339190:0:16579:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d41646000/0xafddb3c8f9282cbc lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477548.339219:0:16579:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d41646000/0xafddb3c8f9282cbc lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477548.339621:0:16579:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d41646000/0xafddb3c8f9282cbc lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16579 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477548.339694:0:16579:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d41647000/0xafddb3c8f9282cb5 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2fc8 expref: 15 pid: 16579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477548.339727:0:16579:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d41646000/0xafddb3c8f9282cbc lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2fc8 expref: 14 pid: 16579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477548.339736:0:16579:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9d0d5b3c3a00) 00010000:00010000:3.0:1789477548.339738:0:16579:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789477548.339742:0:16579:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d0d41646000, rc 0) 00000100:00100000:3.0:1789477548.339812:0:16579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d74a8aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d98042a3-6618-44a7-81f9-5553c982b325+14:14482:x1876402783773568:12345-192.168.201.23@tcp:101:lhsmtool_posix.0 Request processed in 2077us (2367us total) trans 8589934612 rc 0/0 00000100:00100000:3.0:1789477548.339821:0:16579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 43 00000100:00100000:2.0:1789477548.357680:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:1.0:1789477548.357824:0:14351:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783773824 00000100:00100000:1.0:1789477548.357834:0:14351:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783773824 00000100:00100000:1.0:1789477548.357898:0:14351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 44 00000100:00100000:1.0:1789477548.357910:0:14351:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d7523ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d98042a3-6618-44a7-81f9-5553c982b325+14:14482:x1876402783773824:12345-192.168.201.23@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1789477548.357968:0:14351:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789477548.357996:0:14351:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d41646000/0xafddb3c8f9282cbc lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2fc8 expref: 14 pid: 16579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477548.358462:0:14351:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9d0d5b3c3a00) 00010000:00010000:1.0:1789477548.358477:0:14351:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789477548.358504:0:14351:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f518400/0xafddb3c8f9282cca lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477548.358523:0:14351:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f518400/0xafddb3c8f9282cca lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477548.358533:0:14351:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f518400/0xafddb3c8f9282cca lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477548.358687:0:14351:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f518200/0xafddb3c8f9282cd1 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x4f80d40a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477548.358706:0:14351:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f518200/0xafddb3c8f9282cd1 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x4f80d40a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477548.358714:0:14351:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f518200/0xafddb3c8f9282cd1 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x4f80d40a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477548.359005:0:14351:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f518400/0xafddb3c8f9282cca lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477548.359155:0:14351:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f518400/0xafddb3c8f9282cca lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477548.359162:0:14351:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f518400/0xafddb3c8f9282cca lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477548.359170:0:14351:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d0d7f518400 already unused, calling callback (ffffffffc1fd54f0) 00010000:00010000:1.0:1789477548.359174:0:14351:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f518400/0xafddb3c8f9282cca lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477548.359181:0:14351:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f518400/0xafddb3c8f9282cca lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477548.359192:0:14351:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9d0d44f4e200) 00010000:00010000:1.0:1789477548.359195:0:14351:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789477548.359282:0:14351:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f518400/0xafddb3c8f9282cca lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477548.359289:0:14351:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f518400/0xafddb3c8f9282cca lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477548.359300:0:14351:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f518200/0xafddb3c8f9282cd1 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x4f80d40a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477548.359306:0:14351:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f518200/0xafddb3c8f9282cd1 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x4f80d40a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477548.359312:0:14351:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f518200/0xafddb3c8f9282cd1 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x4f80d40a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477548.359317:0:14351:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d0d7f518200 already unused, calling callback (ffffffffc1fd54f0) 00010000:00010000:1.0:1789477548.359326:0:14351:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f518200/0xafddb3c8f9282cd1 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x4f80d40a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477548.359333:0:14351:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f518200/0xafddb3c8f9282cd1 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x4f80d40a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477548.359342:0:14351:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x4f80d40a (ffff9d0d44f4e600) 00010000:00010000:1.0:1789477548.359344:0:14351:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789477548.359348:0:14351:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f518200/0xafddb3c8f9282cd1 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x4f80d40a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477548.359354:0:14351:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d7f518200/0xafddb3c8f9282cd1 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x4f80d40a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14351 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789477548.359514:0:14351:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d7523ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d98042a3-6618-44a7-81f9-5553c982b325+13:14482:x1876402783773824:12345-192.168.201.23@tcp:36:lhsmtool_posix.0 Request processed in 1603us (1839us total) trans 0 rc -2/-2 00000100:00100000:1.0:1789477548.359523:0:14351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 44 00000100:00100000:2.0:1789477548.372374:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:0.0:1789477548.372469:0:14352:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783773952 00000100:00100000:0.0:1789477548.372480:0:14352:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783773952 00000100:00100000:0.0:1789477548.372541:0:14352:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 45 00000100:00100000:0.0:1789477548.372551:0:14352:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d7523ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d98042a3-6618-44a7-81f9-5553c982b325+13:14482:x1876402783773952:12345-192.168.201.23@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789477548.372574:0:14352:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789477548.372647:0:14352:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be5c00/0xafddb3c8f9282cd8 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa90d500d7b8f2fcf expref: -99 pid: 14352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477548.372684:0:14352:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be5400/0xafddb3c8f9282cdf lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14352 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477548.372708:0:14352:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be5400/0xafddb3c8f9282cdf lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14352 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477548.372721:0:14352:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be5400/0xafddb3c8f9282cdf lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14352 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477548.372827:0:14352:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be5c00/0xafddb3c8f9282cd8 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2fcf expref: 15 pid: 14352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477548.372850:0:14352:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be5400/0xafddb3c8f9282cdf lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2fcf expref: 14 pid: 14352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477548.372862:0:14352:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9d0d43cd1100) 00010000:00010000:0.0:1789477548.372865:0:14352:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1789477548.372869:0:14352:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d0d50be5400, rc 0) 00000100:00100000:0.0:1789477548.372942:0:14352:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d7523ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d98042a3-6618-44a7-81f9-5553c982b325+14:14482:x1876402783773952:12345-192.168.201.23@tcp:101:lhsmtool_posix.0 Request processed in 391us (577us total) trans 0 rc 0/0 00000100:00100000:0.0:1789477548.372948:0:14352:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 45 00000100:00100000:2.0:1789477548.375573:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:0.0:1789477548.375895:0:14350:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783774208 00000100:00100000:0.0:1789477548.375906:0:14350:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783774208 00000100:00100000:0.0:1789477548.375965:0:14350:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 46 00000100:00100000:0.0:1789477548.375976:0:14350:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d7523df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d98042a3-6618-44a7-81f9-5553c982b325+14:14482:x1876402783774208:12345-192.168.201.23@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1789477548.376081:0:14350:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be4000/0xafddb3c8f9282ce6 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14350 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477548.376098:0:14350:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be4000/0xafddb3c8f9282ce6 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14350 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477548.376110:0:14350:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be4000/0xafddb3c8f9282ce6 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14350 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1789477548.376668:0:14350:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].2, 88 off8344 00000004:00080000:0.0:1789477548.376679:0:14350:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 493448101168ns, next at 494448098295ns, rc = 0 00000004:00010000:0.0:1789477548.376788:0:14350:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000e45ca548 reply state 000000000338cb9d transno 8589934613 ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be4000/0xafddb3c8f9282ce6 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14350 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789477548.376798:0:14350:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789477548.376896:0:14350:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d7523df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d98042a3-6618-44a7-81f9-5553c982b325+16:14482:x1876402783774208:12345-192.168.201.23@tcp:36:lhsmtool_posix.0 Request processed in 921us (1331us total) trans 8589934613 rc 0/0 00000100:00100000:0.0:1789477548.376904:0:14350:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 46 00000100:00100000:2.0:1789477548.387634:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00010000:00010000:3.0:1789477548.387946:0:3296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be4000/0xafddb3c8f9282ce6 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14350 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477548.387959:0:3296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be4000/0xafddb3c8f9282ce6 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14350 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477548.387967:0:3296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be4000/0xafddb3c8f9282ce6 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14350 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477548.387974:0:3296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d0d50be4000 already unused, calling callback (ffffffffc1fd54f0) 00010000:00010000:3.0:1789477548.387979:0:3296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be4000/0xafddb3c8f9282ce6 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14350 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477548.388001:0:3296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be4000/0xafddb3c8f9282ce6 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14350 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477548.388030:0:3296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9d0d43cd1100) 00010000:00010000:3.0:1789477548.388034:0:3296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1789477548.388039:0:3296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be4000/0xafddb3c8f9282ce6 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14350 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477548.388046:0:3296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be4000/0xafddb3c8f9282ce6 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14350 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789477548.388290:0:14352:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783774336 00000100:00100000:0.0:1789477548.388301:0:14352:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783774336 00000100:00100000:0.0:1789477548.388359:0:14352:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 47 00000100:00100000:0.0:1789477548.388370:0:14352:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d7523e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d98042a3-6618-44a7-81f9-5553c982b325+15:14482:x1876402783774336:12345-192.168.201.23@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789477548.388401:0:14352:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789477548.388419:0:14352:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be5c00/0xafddb3c8f9282ced lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa90d500d7b8f2fd6 expref: -99 pid: 14352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477548.388479:0:14352:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be5c00/0xafddb3c8f9282ced lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2fd6 expref: 16 pid: 14352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477548.388493:0:14352:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be5c00/0xafddb3c8f9282ced lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2fd6 expref: 16 pid: 14352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477548.388514:0:14352:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9d0d43cd1100) 00010000:00010000:0.0:1789477548.388516:0:14352:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789477548.388519:0:14352:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d0d50be5c00, rc 0) 00000100:00100000:0.0:1789477548.388616:0:14352:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d7523e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d98042a3-6618-44a7-81f9-5553c982b325+16:14482:x1876402783774336:12345-192.168.201.23@tcp:101:lhsmtool_posix.0 Request processed in 246us (1041us total) trans 0 rc 0/0 00000100:00100000:0.0:1789477548.388623:0:14352:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 47 00000100:00100000:2.0:1789477548.398364:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:0.0:1789477548.399503:0:15469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783774464 00000100:00100000:0.0:1789477548.399516:0:15469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783774464 00000100:00100000:0.0:1789477548.399641:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 13 00000100:00100000:0.0:1789477548.399654:0:15469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d7523e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d98042a3-6618-44a7-81f9-5553c982b325+5:2354:x1876402783774464:12345-192.168.201.23@tcp:2:lhsmtool_posix.0 00000100:00100000:0.0:1789477548.400225:0:15469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d7523e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d98042a3-6618-44a7-81f9-5553c982b325+6:2354:x1876402783774464:12345-192.168.201.23@tcp:2:lhsmtool_posix.0 Request processed in 573us (1869us total) trans 8589934594 rc 0/0 00000100:00100000:0.0:1789477548.400234:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 13 00000100:00080000:3.0:1789477548.400677:0:14346:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789477548.404151:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:1.0:1789477548.404278:0:16578:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783774720 00000100:00100000:1.0:1789477548.404289:0:16578:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783774720 00000100:00100000:1.0:1789477548.404351:0:16578:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 9 00000100:00100000:1.0:1789477548.404361:0:16578:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d7523ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:d98042a3-6618-44a7-81f9-5553c982b325+16:14482:x1876402783774720:12345-192.168.201.23@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1789477548.404640:0:16578:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d7523ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:d98042a3-6618-44a7-81f9-5553c982b325+17:14482:x1876402783774720:12345-192.168.201.23@tcp:35:lhsmtool_posix.0 Request processed in 279us (499us total) trans 8589934614 rc 0/0 00000100:00100000:1.0:1789477548.404649:0:16578:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 9 00000100:00100000:2.0:1789477548.415551:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:0.0:1789477548.415867:0:14350:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783774976 00000100:00100000:0.0:1789477548.415878:0:14350:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783774976 00000100:00100000:0.0:1789477548.415938:0:14350:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 48 00000100:00100000:0.0:1789477548.415949:0:14350:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d7523d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d98042a3-6618-44a7-81f9-5553c982b325+17:14482:x1876402783774976:12345-192.168.201.23@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1789477548.416100:0:14350:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d7523d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d98042a3-6618-44a7-81f9-5553c982b325+17:14482:x1876402783774976:12345-192.168.201.23@tcp:57:lhsmtool_posix.0 Request processed in 152us (559us total) trans 0 rc 0/0 00000100:00100000:0.0:1789477548.416108:0:14350:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 48 00000100:00100000:2.0:1789477548.422853:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:0.0:1789477548.423282:0:14352:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783775104 00000100:00100000:0.0:1789477548.423293:0:14352:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783775104 00000100:00100000:0.0:1789477548.423356:0:14352:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 49 00000100:00100000:0.0:1789477548.423368:0:14352:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d7f738700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d98042a3-6618-44a7-81f9-5553c982b325+17:14482:x1876402783775104:12345-192.168.201.23@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789477548.423389:0:14352:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789477548.423410:0:14352:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be4000/0xafddb3c8f9282cf4 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa90d500d7b8f2fdd expref: -99 pid: 14352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477548.423476:0:14352:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d82151000/0xafddb3c8f9282cfb lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14352 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477548.423490:0:14352:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d82151000/0xafddb3c8f9282cfb lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14352 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477548.423502:0:14352:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d82151000/0xafddb3c8f9282cfb lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14352 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789477548.423537:0:14352:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1789477548.423553:0:14352:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d82151000/0xafddb3c8f9282cfb lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14352 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477548.423910:0:14352:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be4000/0xafddb3c8f9282cf4 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2fdd expref: 19 pid: 14352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477548.423933:0:14352:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d82151000/0xafddb3c8f9282cfb lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2fdd expref: 18 pid: 14352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477548.423959:0:14352:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9d0d43cd1100) 00010000:00010000:0.0:1789477548.423962:0:14352:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1789477548.423966:0:14352:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d0d82151000, rc 0) 00000100:00100000:1.0:1789477548.424082:0:14352:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d7f738700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d98042a3-6618-44a7-81f9-5553c982b325+18:14482:x1876402783775104:12345-192.168.201.23@tcp:101:lhsmtool_posix.0 Request processed in 715us (1236us total) trans 0 rc 0/0 00000100:00100000:1.0:1789477548.424090:0:14352:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 49 00000100:00100000:2.0:1789477548.427823:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:0.0:1789477548.427979:0:15037:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783775232 00000100:00100000:0.0:1789477548.427990:0:15037:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783775232 00000100:00100000:0.0:1789477548.428053:0:15037:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 14 00000100:00100000:0.0:1789477548.428065:0:15037:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d7f73b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d98042a3-6618-44a7-81f9-5553c982b325+6:2353:x1876402783775232:12345-192.168.201.23@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789477548.428084:0:15037:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789477548.428105:0:15037:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a7ccb216/0xafddb3c8f9282d02 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa90d500d7b8f2fe4 expref: -99 pid: 15037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789477548.428144:0:15037:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x22:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6aa942ab, blocks: 0x1 00010000:00010000:0.0:1789477548.428164:0:15037:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=493s v=(0 0) 00010000:00010000:0.0:1789477548.428169:0:15037:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789477548.428179:0:15037:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a7ccb216/0xafddb3c8f9282d02 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2fe4 expref: 7 pid: 15037 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477548.428199:0:15037:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000a7ccb216/0xafddb3c8f9282d02 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2fe4 expref: 7 pid: 15037 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477548.428213:0:15037:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d0d82151600, rc 0) 00000100:00100000:0.0:1789477548.428562:0:15037:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d7f73b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d98042a3-6618-44a7-81f9-5553c982b325+7:2353:x1876402783775232:12345-192.168.201.23@tcp:101:lhsmtool_posix.0 Request processed in 497us (747us total) trans 0 rc 0/0 00000100:00100000:0.0:1789477548.428570:0:15037:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 14 00000100:00100000:2.0:1789477548.434904:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:0.0:1789477548.434992:0:14350:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783775488 00000100:00100000:0.0:1789477548.435004:0:14350:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783775488 00000100:00100000:0.0:1789477548.435076:0:14350:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 50 00000100:00100000:0.0:1789477548.435087:0:14350:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d7f73aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d98042a3-6618-44a7-81f9-5553c982b325+18:14482:x1876402783775488:12345-192.168.201.23@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1789477548.435210:0:14350:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d7f73aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d98042a3-6618-44a7-81f9-5553c982b325+18:14482:x1876402783775488:12345-192.168.201.23@tcp:57:lhsmtool_posix.0 Request processed in 124us (316us total) trans 0 rc 0/0 00000100:00100000:0.0:1789477548.435218:0:14350:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 50 00000100:00100000:2.0:1789477548.443013:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:3.0:1789477548.443156:0:16579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783775616 00000100:00100000:3.0:1789477548.443166:0:16579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783775616 00000100:00100000:3.0:1789477548.443246:0:16579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 51 00000100:00100000:3.0:1789477548.443259:0:16579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d7f73b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d98042a3-6618-44a7-81f9-5553c982b325+18:14482:x1876402783775616:12345-192.168.201.23@tcp:44:lhsmtool_posix.0 00000001:00080000:2.0:1789477548.497502:0:5868:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934613 is committed 00000004:00080000:2.0:1789477548.497519:0:5868:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00000100:00100000:3.0:1789477548.497779:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d6d466d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1876402802632064:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1789477548.497871:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789477548.497963:0:15038:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802632064 00000100:00100000:3.0:1789477548.497972:0:15038:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802632064 00000100:00100000:3.0:1789477548.498037:0:15038:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1789477548.498048:0:15038:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d6d464380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3311:x1876402802632064:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1789477548.498382:0:15038:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1789477548.498386:0:15038:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:3.0:1789477548.498389:0:15038:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1789477548.498391:0:15038:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb ctime from disk: 1789477547 -> 1789477547 00002000:00010000:3.0:1789477548.498394:0:15038:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:3.0:1789477548.498459:0:15038:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d6d464380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3311:x1876402802632064:12345-0@lo:2:osp-syn-0-0.0 Request processed in 412us (588us total) trans 8589934595 rc 0/0 00000100:00100000:3.0:1789477548.498467:0:15038:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000004:00080000:3.0:1789477548.498518:0:3311:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9d0d6d466d80/2, rc 0, transno 8589934595 00000100:00100000:3.0:1789477548.498525:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d6d466d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1876402802632064:0@lo:2:osp-syn-0-0.0 00000001:00080000:2.0:1789477548.498803:0:5868:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934614 is committed 00000100:00100000:1.0:1789477548.499280:0:16579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d7f73b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d98042a3-6618-44a7-81f9-5553c982b325+15:14482:x1876402783775616:12345-192.168.201.23@tcp:44:lhsmtool_posix.0 Request processed in 56019us (56273us total) trans 0 rc 0/0 00000100:00100000:1.0:1789477548.499303:0:16579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 51 00000100:00100000:2.0:1789477548.513078:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:1.0:1789477548.517179:0:15037:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783775744 00000100:00100000:1.0:1789477548.517215:0:15037:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783775744 00000100:00100000:1.0:1789477548.517313:0:15037:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 16 00000100:00100000:1.0:1789477548.517326:0:15037:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d7f739f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d98042a3-6618-44a7-81f9-5553c982b325+7:2354:x1876402783775744:12345-192.168.201.23@tcp:16:lhsmtool_posix.0 00000100:00100000:1.0:1789477548.517492:0:15037:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d7f739f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d98042a3-6618-44a7-81f9-5553c982b325+7:2354:x1876402783775744:12345-192.168.201.23@tcp:16:lhsmtool_posix.0 Request processed in 168us (4430us total) trans 0 rc 0/0 00000100:00100000:1.0:1789477548.517500:0:15037:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 16 00000100:00100000:3.0:1789477548.520101:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:0.0:1789477548.522179:0:14350:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783776000 00000100:00100000:0.0:1789477548.522334:0:14350:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783776000 00000100:00100000:0.0:1789477548.522430:0:14350:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 52 00000100:00100000:0.0:1789477548.522443:0:14350:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d6d467480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d98042a3-6618-44a7-81f9-5553c982b325+14:14482:x1876402783776000:12345-192.168.201.23@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1789477548.522681:0:14350:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789477548.522728:0:14350:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d82151000/0xafddb3c8f9282cfb lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2fdd expref: 14 pid: 14352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477548.522755:0:14350:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9d0d43cd1100) 00010000:00010000:0.0:1789477548.522761:0:14350:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789477548.522799:0:14350:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d82151800/0xafddb3c8f9282d09 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14350 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477548.522818:0:14350:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d82151800/0xafddb3c8f9282d09 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14350 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477548.522828:0:14350:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d82151800/0xafddb3c8f9282d09 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14350 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789477548.524273:0:14350:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000db1863ed reply state 00000000d8d6023b transno 8589934615 ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d82151800/0xafddb3c8f9282d09 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14350 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789477548.524319:0:14350:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789477548.524549:0:14350:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d6d467480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d98042a3-6618-44a7-81f9-5553c982b325+15:14482:x1876402783776000:12345-192.168.201.23@tcp:36:lhsmtool_posix.0 Request processed in 2103us (4456us total) trans 8589934615 rc 0/0 00000100:00100000:0.0:1789477548.524559:0:14350:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 52 00000100:00100000:2.0:1789477548.533461:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:1.0:1789477548.534435:0:15038:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783776128 00000100:00100000:1.0:1789477548.534455:0:15038:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783776128 00000100:00100000:1.0:1789477548.534553:0:15038:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 17 00000100:00100000:1.0:1789477548.534567:0:15038:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d7f739880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d98042a3-6618-44a7-81f9-5553c982b325+7:2355:x1876402783776128:12345-192.168.201.23@tcp:2:lhsmtool_posix.0 00002000:00010000:1.0:1789477548.534903:0:15038:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1789477548.534908:0:15038:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb mtime from disk: 0 -> 1789477546 00002000:00010000:1.0:1789477548.534911:0:15038:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb atime from disk: 0 -> 1789477546 00002000:00010000:1.0:1789477548.534913:0:15038:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb ctime from disk: 1789477547 -> 1789477546 00002000:00010000:1.0:1789477548.534916:0:15038:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:1.0:1789477548.535000:0:15038:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d7f739880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d98042a3-6618-44a7-81f9-5553c982b325+8:2355:x1876402783776128:12345-192.168.201.23@tcp:2:lhsmtool_posix.0 Request processed in 435us (1555us total) trans 8589934596 rc 0/0 00000100:00100000:1.0:1789477548.535009:0:15038:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 17 00010000:00010000:3.0:1789477548.537264:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d82151800/0xafddb3c8f9282d09 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14350 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477548.537287:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d82151800/0xafddb3c8f9282d09 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14350 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477548.537295:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d82151800/0xafddb3c8f9282d09 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14350 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477548.537303:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d0d82151800 already unused, calling callback (ffffffffc1fd54f0) 00010000:00010000:3.0:1789477548.537372:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d82151800/0xafddb3c8f9282d09 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14350 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477548.537382:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d82151800/0xafddb3c8f9282d09 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14350 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477548.537406:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9d0d43cd1100) 00010000:00010000:3.0:1789477548.537410:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789477548.537415:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d82151800/0xafddb3c8f9282d09 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14350 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477548.537422:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d82151800/0xafddb3c8f9282d09 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14350 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789477548.540815:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:1.0:1789477548.540933:0:15037:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783776256 00000100:00100000:1.0:1789477548.540945:0:15037:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783776256 00000100:00100000:1.0:1789477548.541010:0:15037:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 18 00000100:00100000:1.0:1789477548.541029:0:15037:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d7f73bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d98042a3-6618-44a7-81f9-5553c982b325+8:2355:x1876402783776256:12345-192.168.201.23@tcp:1:lhsmtool_posix.0 00010000:00010000:1.0:1789477548.541087:0:15037:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000f75f5d68/0xafddb3c8f9282d10 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477548.541126:0:15037:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789477548.541131:0:15037:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789477548.541139:0:15037:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f75f5d68/0xafddb3c8f9282d10 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477548.541156:0:15037:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f75f5d68/0xafddb3c8f9282d10 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477548.541204:0:15037:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000f75f5d68/0xafddb3c8f9282d10 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477548.541213:0:15037:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f75f5d68/0xafddb3c8f9282d10 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477548.541223:0:15037:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f75f5d68/0xafddb3c8f9282d10 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477548.541230:0:15037:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d0d7f518400 already unused, calling callback (ffffffffc15972a0) 00010000:00010000:1.0:1789477548.541235:0:15037:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f75f5d68/0xafddb3c8f9282d10 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477548.541244:0:15037:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f75f5d68/0xafddb3c8f9282d10 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477548.541261:0:15037:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f75f5d68/0xafddb3c8f9282d10 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477548.541275:0:15037:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f75f5d68/0xafddb3c8f9282d10 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789477548.541372:0:15037:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d7f73bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d98042a3-6618-44a7-81f9-5553c982b325+8:2355:x1876402783776256:12345-192.168.201.23@tcp:1:lhsmtool_posix.0 Request processed in 345us (571us total) trans 0 rc 0/0 00000100:00100000:1.0:1789477548.541380:0:15037:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 18 00000100:00100000:1.0:1789477548.547251:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:2.0:1789477548.547395:0:14352:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783776512 00000100:00100000:2.0:1789477548.547407:0:14352:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783776512 00000100:00100000:2.0:1789477548.547481:0:14352:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 53 00000100:00100000:2.0:1789477548.547493:0:14352:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d74a88a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d98042a3-6618-44a7-81f9-5553c982b325+14:14482:x1876402783776512:12345-192.168.201.23@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1789477548.547630:0:14352:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50417c00/0xafddb3c8f9282d17 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14352 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477548.547652:0:14352:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50417c00/0xafddb3c8f9282d17 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14352 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477548.547687:0:14352:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50417c00/0xafddb3c8f9282d17 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14352 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477548.548031:0:14352:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50417200/0xafddb3c8f9282d1e lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14352 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477548.548044:0:14352:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be5c00/0xafddb3c8f9282ced lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2fd6 expref: 15 pid: 14352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477548.548053:0:14352:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50417200/0xafddb3c8f9282d1e lrc: 4/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14352 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477548.548095:0:14352:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be5c00/0xafddb3c8f9282ced lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2fd6 expref: 15 pid: 14352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477548.548112:0:14352:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be5c00/0xafddb3c8f9282ced lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2fd6 expref: 15 pid: 14352 timeout: 593 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789477548.548128:0:14352:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d7f739180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14352:1876402802632192:192.168.201.23@tcp:104: 00000100:00100000:2.0:1789477548.548253:0:14352:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d0d7ed92a80 going to sleep for 11 seconds 00000100:00100000:2.0:1789477548.552407:0:14352:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d7f739180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14352:1876402802632192:192.168.201.23@tcp:104: 00010000:00010000:2.0:1789477548.552469:0:14352:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50417200/0xafddb3c8f9282d1e lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14352 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789477548.554098:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:0.0:1789477548.558572:0:14336:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783776640 00000100:00100000:0.0:1789477548.558650:0:14336:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783776640 00010000:00010000:0.0:1789477548.558734:0:14336:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be5c00/0xafddb3c8f9282ced lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2fd6 expref: 16 pid: 14352 timeout: 593 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789477548.558794:0:14336:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 13 00000100:00100000:0.0:1789477548.558807:0:14336:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d74a8ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d98042a3-6618-44a7-81f9-5553c982b325+16:2355:x1876402783776640:12345-192.168.201.23@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789477548.558826:0:14336:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789477548.558835:0:14336:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be5c00/0xafddb3c8f9282ced lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2fd6 expref: 16 pid: 14352 timeout: 593 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477548.558850:0:14336:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be5c00/0xafddb3c8f9282ced lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2fd6 expref: 16 pid: 14352 timeout: 593 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477548.558878:0:14336:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be5c00/0xafddb3c8f9282ced lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2fd6 expref: 16 pid: 14352 timeout: 593 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477548.558899:0:14336:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9d0d43cd1100) 00010000:00010000:0.0:1789477548.558905:0:14336:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50417200/0xafddb3c8f9282d1e lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14352 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477548.558927:0:14336:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50417200/0xafddb3c8f9282d1e lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 14352 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477548.558956:0:14336:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50417200/0xafddb3c8f9282d1e lrc: 4/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 14352 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477548.558997:0:14336:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789477548.559095:0:14336:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d74a8ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d98042a3-6618-44a7-81f9-5553c982b325+15:2355:x1876402783776640:12345-192.168.201.23@tcp:103:ldlm_bl.0 Request processed in 290us (5008us total) trans 0 rc 0/0 00000100:00100000:0.0:1789477548.559104:0:14336:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 13 00010000:00010000:2.0:1789477548.562664:0:14352:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50417200/0xafddb3c8f9282d1e lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14352 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477548.562690:0:14352:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50417200/0xafddb3c8f9282d1e lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14352 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789477548.563014:0:14352:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934616 00000001:00080000:2.0:1789477548.563207:0:14352:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934617 00000001:00080000:2.0:1789477548.563262:0:14352:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934618 00000100:00100000:2.0:1789477548.563492:0:14352:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d7f739180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:14352:1876402802632320:0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1789477548.566368:0:14352:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789477548.566444:0:14352:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d0d7ed92780 going to sleep for 11 seconds 00000100:00100000:1.0:1789477548.566821:0:14355:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802632320 00000100:00100000:1.0:1789477548.566833:0:14355:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802632320 00000100:00100000:1.0:1789477548.566904:0:14355:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789477548.566918:0:14355:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d7f739c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:14352:x1876402802632320:12345-0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1789477548.567069:0:14355:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d7f739c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:14352:x1876402802632320:12345-0@lo:1000:mdt00_002.0 Request processed in 153us (715us total) trans 0 rc 0/0 00000100:00100000:1.0:1789477548.567077:0:14355:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789477548.567135:0:14352:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d7f739180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:14352:1876402802632320:0@lo:1000:mdt00_002.0 00000001:00080000:1.0:1789477548.568028:0:14352:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934619 00000100:00100000:1.0:1789477548.568141:0:14352:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d74a89500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:14352:1876402802632448:0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1789477548.568203:0:14352:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789477548.568244:0:14352:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d0d44480840 going to sleep for 11 seconds 00000100:00100000:3.0:1789477548.568443:0:14355:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802632448 00000100:00100000:3.0:1789477548.568458:0:14355:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802632448 00000100:00100000:3.0:1789477548.568563:0:14355:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789477548.568574:0:14355:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d74a88380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:14352:x1876402802632448:12345-0@lo:1000:mdt00_002.0 00000100:00100000:3.0:1789477548.568822:0:14355:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d74a88380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:14352:x1876402802632448:12345-0@lo:1000:mdt00_002.0 Request processed in 249us (619us total) trans 8589934597 rc 0/0 00000100:00100000:3.0:1789477548.568831:0:14355:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789477548.568922:0:14352:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d74a89500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:14352:1876402802632448:0@lo:1000:mdt00_002.0 00010000:00010000:1.0:1789477548.568973:0:14352:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50417200/0xafddb3c8f9282d1e lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14352 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477548.568986:0:14352:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50417200/0xafddb3c8f9282d1e lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14352 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477548.569002:0:14352:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50417200/0xafddb3c8f9282d1e lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14352 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477548.569009:0:14352:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d0d50417200 already unused, calling callback (ffffffffc1fd54f0) 00010000:00010000:1.0:1789477548.569015:0:14352:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50417200/0xafddb3c8f9282d1e lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14352 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477548.569024:0:14352:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50417200/0xafddb3c8f9282d1e lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14352 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477548.569045:0:14352:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9d0d43cd1100) 00010000:00010000:1.0:1789477548.569048:0:14352:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789477548.569055:0:14352:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50417200/0xafddb3c8f9282d1e lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14352 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477548.569072:0:14352:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50417200/0xafddb3c8f9282d1e lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14352 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477548.569113:0:14352:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be5000/0xafddb3c8f9282c7d lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 14351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477548.569120:0:14352:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be5000/0xafddb3c8f9282c7d lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 14351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477548.569126:0:14352:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be5000/0xafddb3c8f9282c7d lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 14351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477548.569131:0:14352:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d0d50be5000 already unused, calling callback (ffffffffc1fd54f0) 00010000:00010000:1.0:1789477548.569134:0:14352:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be5000/0xafddb3c8f9282c7d lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 14351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477548.569150:0:14352:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be5000/0xafddb3c8f9282c7d lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 14351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477548.569160:0:14352:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9d0d43cd1b00) 00010000:00010000:1.0:1789477548.569163:0:14352:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789477548.569171:0:14352:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be4800/0xafddb3c8f9282c84 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2fba expref: 18 pid: 14352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477548.569184:0:14352:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be4800/0xafddb3c8f9282c84 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2fba expref: 18 pid: 14352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477548.569195:0:14352:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be4800/0xafddb3c8f9282c84 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2fba expref: 18 pid: 14352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477548.569257:0:14352:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be4800/0xafddb3c8f9282c84 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2fba expref: 18 pid: 14352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789477548.569270:0:14352:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d74a89880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14352:1876402802632576:192.168.201.23@tcp:105: 00000100:00100000:1.0:1789477548.569498:0:14352:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d0d44480b40 going to sleep for 11 seconds 00000100:00100000:1.0:1789477548.572760:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:3.0:1789477548.572964:0:14354:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783776768 00000100:00100000:3.0:1789477548.572977:0:14354:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783776768 00000100:00100000:3.0:1789477548.573149:0:14354:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 10 00000100:00100000:3.0:1789477548.573163:0:14354:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d7fbb3050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d98042a3-6618-44a7-81f9-5553c982b325+19:14481:x1876402783776768:12345-192.168.201.23@tcp:49:dd.0 00000100:00100000:3.0:1789477548.573415:0:14354:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d7fbb3050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d98042a3-6618-44a7-81f9-5553c982b325+19:14481:x1876402783776768:12345-192.168.201.23@tcp:49:dd.0 Request processed in 253us (672us total) trans 0 rc 0/0 00000100:00100000:3.0:1789477548.573423:0:14354:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 10 00000100:00100000:2.0:1789477548.574540:0:14352:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d74a89880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14352:1876402802632576:192.168.201.23@tcp:105: 00010000:00010000:2.0:1789477548.575067:0:14352:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be5000/0xafddb3c8f9282c7d lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 14351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477548.575082:0:14352:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50be5000/0xafddb3c8f9282c7d lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 14351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477548.575128:0:14352:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50416200/0xafddb3c8f9282d25 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14352 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477548.575146:0:14352:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50416200/0xafddb3c8f9282d25 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14352 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477548.575161:0:14352:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50416200/0xafddb3c8f9282d25 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14352 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477548.575173:0:14352:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50416200/0xafddb3c8f9282d25 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14352 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477548.575179:0:14352:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50416200/0xafddb3c8f9282d25 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14352 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477548.575186:0:14352:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50416200/0xafddb3c8f9282d25 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14352 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477548.575216:0:14352:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d0d50416200 already unused, calling callback (ffffffffc1fd54f0) 00010000:00010000:2.0:1789477548.575221:0:14352:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50416200/0xafddb3c8f9282d25 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14352 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477548.575229:0:14352:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50416200/0xafddb3c8f9282d25 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14352 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477548.575245:0:14352:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9d0d43cd1b00) 00010000:00010000:2.0:1789477548.575249:0:14352:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789477548.575253:0:14352:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50416200/0xafddb3c8f9282d25 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14352 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477548.575259:0:14352:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50416200/0xafddb3c8f9282d25 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14352 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477548.575271:0:14352:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50417c00/0xafddb3c8f9282d17 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14352 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477548.575278:0:14352:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50417c00/0xafddb3c8f9282d17 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14352 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477548.575284:0:14352:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50417c00/0xafddb3c8f9282d17 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14352 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477548.575289:0:14352:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d0d50417c00 already unused, calling callback (ffffffffc1fd54f0) 00010000:00010000:2.0:1789477548.575292:0:14352:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50417c00/0xafddb3c8f9282d17 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14352 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477548.575298:0:14352:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50417c00/0xafddb3c8f9282d17 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14352 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477548.575318:0:14352:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9d0d43cd1b00) 00010000:00010000:2.0:1789477548.575321:0:14352:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1789477548.575324:0:14352:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50417c00/0xafddb3c8f9282d17 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14352 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477548.575330:0:14352:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d50417c00/0xafddb3c8f9282d17 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14352 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789477548.575680:0:14352:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d74a88a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d98042a3-6618-44a7-81f9-5553c982b325+18:14482:x1876402783776512:12345-192.168.201.23@tcp:57:lhsmtool_posix.0 Request processed in 28184us (28444us total) trans 8589934620 rc 0/0 00000100:00100000:2.0:1789477548.575705:0:14352:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 53 00000020:00080000:2.0:1789477548.575713:0:14352:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:3.0:1789477548.578874:0:14385:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1789477548.578888:0:14385:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1789477548.578931:0:14385:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:3.0:1789477548.578939:0:14385:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:1.0:1789477548.582475:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:0.0:1789477548.582976:0:14353:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783777024 00000100:00100000:0.0:1789477548.582993:0:14353:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783777024 00000100:00100000:0.0:1789477548.583086:0:14353:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 11 00000100:00100000:0.0:1789477548.583099:0:14353:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d74a8b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d98042a3-6618-44a7-81f9-5553c982b325+18:14482:x1876402783777024:12345-192.168.201.23@tcp:35:lhsmtool_posix.0 00000004:00080000:0.0:1789477548.584863:0:14353:0:(mdd_object.c:4014:mdd_close()) Object [0x200000bd1:0x3:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:0.0:1789477548.585005:0:14353:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934621 00010000:00010000:0.0:1789477548.585071:0:14353:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d82150600/0xafddb3c8f9282d2c lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14353 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477548.585094:0:14353:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d82150600/0xafddb3c8f9282d2c lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 14353 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477548.585110:0:14353:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d82150600/0xafddb3c8f9282d2c lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 14353 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477548.585119:0:14353:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d82150600/0xafddb3c8f9282d2c lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 14353 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477548.585126:0:14353:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d82150600/0xafddb3c8f9282d2c lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 14353 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477548.585133:0:14353:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d82150600/0xafddb3c8f9282d2c lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 14353 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477548.585175:0:14353:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789477548.585446:0:15972:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789477548.585457:0:15972:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d82150600/0xafddb3c8f9282d2c lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 14353 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477548.585467:0:15972:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d0d82150600 already unused, calling callback (ffffffffc15972a0) 00010000:00010000:3.0:1789477548.585472:0:15972:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d82150600/0xafddb3c8f9282d2c lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 14353 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477548.585482:0:15972:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d82150600/0xafddb3c8f9282d2c lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 14353 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477548.585511:0:15972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9d0d43cd1100) 00010000:00010000:3.0:1789477548.585523:0:15972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1789477548.585529:0:15972:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d82150600/0xafddb3c8f9282d2c lrc: 1/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 14353 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477548.585536:0:15972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d0d82150600/0xafddb3c8f9282d2c lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 14353 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477548.585555:0:15972:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789477548.585557:0:15972:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789477548.585559:0:15972:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789477548.585915:0:14353:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d74a8b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d98042a3-6618-44a7-81f9-5553c982b325+20:14482:x1876402783777024:12345-192.168.201.23@tcp:35:lhsmtool_posix.0 Request processed in 2811us (3450us total) trans 8589934622 rc 0/0 00000100:00100000:0.0:1789477548.585928:0:14353:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 11 00000020:00080000:0.0:1789477548.585936:0:14353:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1789477548.782365:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:1.0:1789477548.782423:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:0.0:1789477548.782548:0:15043:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783777280 00000100:00100000:0.0:1789477548.782563:0:15043:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783777280 00000100:00100000:0.0:1789477548.782684:0:15043:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783777152 00000100:00100000:0.0:1789477548.782718:0:15043:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783777152 00000100:00100000:0.0:1789477548.782748:0:15043:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 0 00000100:00100000:0.0:1789477548.782760:0:15043:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d74a8bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:d98042a3-6618-44a7-81f9-5553c982b325+9:2355:x1876402783777280:12345-192.168.201.23@tcp:4:dd.0 00010000:00010000:0.0:1789477548.782806:0:15043:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005a2d75a6/0xafddb3c8f9282d33 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477548.782833:0:15043:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000a7ccb216/0xafddb3c8f9282d02 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2fe4 expref: 9 pid: 15037 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477548.782843:0:15043:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789477548.782849:0:15043:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789477548.782855:0:15043:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005a2d75a6/0xafddb3c8f9282d33 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477548.782901:0:15043:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000a7ccb216/0xafddb3c8f9282d02 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2fe4 expref: 9 pid: 15037 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477548.782918:0:15043:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000a7ccb216/0xafddb3c8f9282d02 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2fe4 expref: 9 pid: 15037 timeout: 593 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789477548.782957:0:15043:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d7c1fa300 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_000:lustre-OST0000_UUID:15043:1876402802632704:192.168.201.23@tcp:104: 00000100:00100000:0.0:1789477548.783086:0:15043:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d0d58576540 going to sleep for 11 seconds 00000100:00100000:1.0:1789477548.793062:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:1.0:1789477548.793122:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:1.0:1789477548.793144:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:1.0:1789477548.793157:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:1.0:1789477548.793204:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:1.0:1789477548.793219:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:0.0:1789477548.793514:0:15045:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:0.0:1789477548.793529:0:15045:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_003' 00000100:00100000:2.0:1789477548.793661:0:15043:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d7c1fa300 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_000:lustre-OST0000_UUID:15043:1876402802632704:192.168.201.23@tcp:104: 00010000:00010000:2.0:1789477548.793709:0:15043:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000005a2d75a6/0xafddb3c8f9282d33 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789477548.796342:0:15044:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:3.0:1789477548.796376:0:15044:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783777408 00000100:00100000:3.0:1789477548.796387:0:15044:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783777408 00000100:00100000:3.0:1789477548.796452:0:15044:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:3.0:1789477548.796460:0:15044:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783777536 00000100:00100000:3.0:1789477548.796463:0:15044:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783777536 00000100:00100000:3.0:1789477548.796479:0:15044:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:3.0:1789477548.796483:0:15044:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783777664 00000100:00100000:3.0:1789477548.796496:0:15044:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783777664 00000100:00100000:3.0:1789477548.796512:0:15044:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:3.0:1789477548.796517:0:15044:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783777792 00000100:00100000:3.0:1789477548.796520:0:15044:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783777792 00000100:00100000:3.0:1789477548.796532:0:15044:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:3.0:1789477548.796536:0:15044:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783777920 00000100:00100000:3.0:1789477548.796538:0:15044:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783777920 00000100:00100000:3.0:1789477548.796549:0:15044:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:3.0:1789477548.796558:0:15044:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783778048 00000100:00100000:3.0:1789477548.796561:0:15044:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783778048 00000100:00100000:0.0:1789477548.797758:0:16581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 1 00000100:00100000:0.0:1789477548.797778:0:16581:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d74a8b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:d98042a3-6618-44a7-81f9-5553c982b325+15:2355:x1876402783777152:12345-192.168.201.23@tcp:4:dd.0 00010000:00010000:0.0:1789477548.797833:0:16581:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b477e62b/0xafddb3c8f9282d3a lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477548.797859:0:16581:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789477548.797865:0:16581:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789477548.797871:0:16581:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b477e62b/0xafddb3c8f9282d3a lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477548.797883:0:16581:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000b477e62b/0xafddb3c8f9282d3a lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789477548.798476:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:3.0:1789477548.798731:0:14335:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783778176 00000100:00100000:3.0:1789477548.798742:0:14335:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783778176 00010000:00010000:3.0:1789477548.798789:0:14335:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000a7ccb216/0xafddb3c8f9282d02 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2fe4 expref: 16 pid: 15037 timeout: 593 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789477548.798866:0:14335:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 14 00000100:00100000:3.0:1789477548.798888:0:14335:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d7c3e4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d98042a3-6618-44a7-81f9-5553c982b325+16:2355:x1876402783778176:12345-192.168.201.23@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789477548.798904:0:14335:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789477548.798946:0:14335:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000a7ccb216/0xafddb3c8f9282d02 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2fe4 expref: 16 pid: 15037 timeout: 593 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477548.798964:0:14335:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000a7ccb216/0xafddb3c8f9282d02 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2fe4 expref: 16 pid: 15037 timeout: 593 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477548.798992:0:14335:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a7ccb216/0xafddb3c8f9282d02 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.23@tcp remote: 0xa90d500d7b8f2fe4 expref: 16 pid: 15037 timeout: 593 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477548.799484:0:14335:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789477548.799502:0:14335:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789477548.799510:0:14335:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000005a2d75a6/0xafddb3c8f9282d33 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477548.799522:0:14335:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005a2d75a6/0xafddb3c8f9282d33 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477548.799533:0:14335:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789477548.799536:0:14335:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789477548.799539:0:14335:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000b477e62b/0xafddb3c8f9282d3a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 16581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477548.799547:0:14335:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b477e62b/0xafddb3c8f9282d3a lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 16581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477548.799648:0:14335:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789477548.799737:0:14335:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d7c3e4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d98042a3-6618-44a7-81f9-5553c982b325+15:2355:x1876402783778176:12345-192.168.201.23@tcp:103:ldlm_bl.0 Request processed in 849us (1262us total) trans 0 rc 0/0 00000100:00100000:3.0:1789477548.799746:0:14335:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 14 00010000:00010000:1.0:1789477548.799826:0:15043:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000005a2d75a6/0xafddb3c8f9282d33 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477548.799837:0:15043:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005a2d75a6/0xafddb3c8f9282d33 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477548.800733:0:16581:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000b477e62b/0xafddb3c8f9282d3a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477548.800748:0:16581:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b477e62b/0xafddb3c8f9282d3a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477548.854309:0:14339:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1789477548.910366:0:6730:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934598 is committed 00000001:00080000:1.0:1789477548.910415:0:6730:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934597 is committed 00002000:00010000:1.0:1789477548.910485:0:16581:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 0 -> 2097152 00002000:00010000:1.0:1789477548.910490:0:16581:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb mtime from disk: 1789477546 -> 1789477548 00002000:00010000:1.0:1789477548.910492:0:16581:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb ctime from disk: 1789477546 -> 1789477548 00002000:00010000:1.0:1789477548.910494:0:16581:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 1 -> 4099 00010000:00010000:1.0:1789477548.910513:0:16581:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b477e62b/0xafddb3c8f9282d3a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477548.910530:0:16581:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b477e62b/0xafddb3c8f9282d3a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477548.910541:0:16581:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b477e62b/0xafddb3c8f9282d3a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477548.910549:0:16581:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d0d82150800 already unused, calling callback (ffffffffc15972a0) 00010000:00010000:1.0:1789477548.910555:0:16581:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b477e62b/0xafddb3c8f9282d3a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477548.910612:0:16581:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b477e62b/0xafddb3c8f9282d3a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477548.910639:0:16581:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b477e62b/0xafddb3c8f9282d3a lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477548.910647:0:16581:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b477e62b/0xafddb3c8f9282d3a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789477548.910793:0:16581:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d74a8b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:d98042a3-6618-44a7-81f9-5553c982b325+15:2355:x1876402783777152:12345-192.168.201.23@tcp:4:dd.0 Request processed in 113014us (128362us total) trans 8589934598 rc 0/0 00000100:00100000:1.0:1789477548.910812:0:16581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 1 00000100:00100000:1.0:1789477548.910860:0:16581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 2 00000100:00100000:1.0:1789477548.910875:0:16581:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d74a88000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:d98042a3-6618-44a7-81f9-5553c982b325+14:2354:x1876402783777408:12345-192.168.201.23@tcp:4:dd.0 00010000:00010000:1.0:1789477548.910933:0:16581:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000003f1ade9/0xafddb3c8f9282d41 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477548.910949:0:16581:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789477548.910954:0:16581:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789477548.910960:0:16581:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000003f1ade9/0xafddb3c8f9282d41 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477548.910975:0:16581:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000003f1ade9/0xafddb3c8f9282d41 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789477548.978067:0:15043:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 2097152 -> 3145728 00002000:00010000:0.0:1789477548.978082:0:15043:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 4099 -> 4103 00010000:00010000:0.0:1789477548.978118:0:15043:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005a2d75a6/0xafddb3c8f9282d33 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477548.978133:0:15043:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005a2d75a6/0xafddb3c8f9282d33 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477548.978143:0:15043:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005a2d75a6/0xafddb3c8f9282d33 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477548.978151:0:15043:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d0d82151200 already unused, calling callback (ffffffffc15972a0) 00010000:00010000:0.0:1789477548.978157:0:15043:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005a2d75a6/0xafddb3c8f9282d33 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477548.978169:0:15043:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005a2d75a6/0xafddb3c8f9282d33 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477548.978211:0:15043:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005a2d75a6/0xafddb3c8f9282d33 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477548.978221:0:15043:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005a2d75a6/0xafddb3c8f9282d33 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789477548.978351:0:15043:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d74a8bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:d98042a3-6618-44a7-81f9-5553c982b325+16:2355:x1876402783777280:12345-192.168.201.23@tcp:4:dd.0 Request processed in 195585us (195993us total) trans 8589934599 rc 0/0 00000100:00100000:0.0:1789477548.978364:0:15043:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 0 00000100:00100000:0.0:1789477548.978407:0:15043:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 3 00000100:00100000:0.0:1789477548.978422:0:15043:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d74a89f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:d98042a3-6618-44a7-81f9-5553c982b325+15:2354:x1876402783777536:12345-192.168.201.23@tcp:4:dd.0 00010000:00010000:0.0:1789477548.978473:0:15043:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002a6f8fd6/0xafddb3c8f9282d48 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477548.978487:0:15043:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=1s v=(0 0) 00010000:00010000:0.0:1789477548.978492:0:15043:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789477548.978499:0:15043:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002a6f8fd6/0xafddb3c8f9282d48 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477548.978512:0:15043:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002a6f8fd6/0xafddb3c8f9282d48 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789477548.978896:0:6730:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934599 is committed 00002000:00010000:1.0:1789477549.045064:0:16581:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 3145728 -> 4194304 00002000:00010000:1.0:1789477549.045078:0:16581:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 4103 -> 6151 00010000:00010000:1.0:1789477549.045098:0:16581:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000003f1ade9/0xafddb3c8f9282d41 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477549.045114:0:16581:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000003f1ade9/0xafddb3c8f9282d41 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477549.045125:0:16581:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000003f1ade9/0xafddb3c8f9282d41 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477549.045132:0:16581:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d0d7f519800 already unused, calling callback (ffffffffc15972a0) 00010000:00010000:1.0:1789477549.045138:0:16581:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000003f1ade9/0xafddb3c8f9282d41 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477549.045148:0:16581:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000003f1ade9/0xafddb3c8f9282d41 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477549.045174:0:16581:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000003f1ade9/0xafddb3c8f9282d41 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477549.045182:0:16581:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000003f1ade9/0xafddb3c8f9282d41 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789477549.045311:0:16581:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d74a88000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:d98042a3-6618-44a7-81f9-5553c982b325+15:2354:x1876402783777408:12345-192.168.201.23@tcp:4:dd.0 Request processed in 134436us (252258us total) trans 8589934600 rc 0/0 00000100:00100000:1.0:1789477549.045340:0:16581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 2 00000100:00100000:1.0:1789477549.045383:0:16581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 4 00000100:00100000:1.0:1789477549.045398:0:16581:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d74a88e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:d98042a3-6618-44a7-81f9-5553c982b325+14:2354:x1876402783777664:12345-192.168.201.23@tcp:4:dd.0 00010000:00010000:1.0:1789477549.045440:0:16581:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f75f5d68/0xafddb3c8f9282d4f lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477549.045455:0:16581:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789477549.045460:0:16581:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789477549.045467:0:16581:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f75f5d68/0xafddb3c8f9282d4f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477549.045481:0:16581:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f75f5d68/0xafddb3c8f9282d4f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789477549.045675:0:6730:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934600 is committed 00000001:00080000:0.0:1789477549.099628:0:6730:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934601 is committed 00002000:00010000:2.0:1789477549.100219:0:15043:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 4194304 -> 5242880 00002000:00010000:2.0:1789477549.100226:0:15043:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 6151 -> 8199 00010000:00010000:2.0:1789477549.100247:0:15043:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002a6f8fd6/0xafddb3c8f9282d48 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477549.100262:0:15043:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002a6f8fd6/0xafddb3c8f9282d48 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477549.100272:0:15043:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002a6f8fd6/0xafddb3c8f9282d48 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477549.100299:0:15043:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d0d82151e00 already unused, calling callback (ffffffffc15972a0) 00010000:00010000:2.0:1789477549.100305:0:15043:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002a6f8fd6/0xafddb3c8f9282d48 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477549.100316:0:15043:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002a6f8fd6/0xafddb3c8f9282d48 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477549.100342:0:15043:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002a6f8fd6/0xafddb3c8f9282d48 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477549.100351:0:15043:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002a6f8fd6/0xafddb3c8f9282d48 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789477549.100475:0:15043:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d74a89f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:d98042a3-6618-44a7-81f9-5553c982b325+12:2354:x1876402783777536:12345-192.168.201.23@tcp:4:dd.0 Request processed in 122051us (307343us total) trans 8589934601 rc 0/0 00000100:00100000:2.0:1789477549.100494:0:15043:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 3 00000100:00100000:2.0:1789477549.100536:0:15043:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 5 00000100:00100000:2.0:1789477549.100551:0:15043:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d74a89880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:d98042a3-6618-44a7-81f9-5553c982b325+11:2354:x1876402783777792:12345-192.168.201.23@tcp:4:dd.0 00010000:00010000:2.0:1789477549.100631:0:15043:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fca0ba78/0xafddb3c8f9282d56 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477549.100648:0:15043:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789477549.100652:0:15043:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789477549.100659:0:15043:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fca0ba78/0xafddb3c8f9282d56 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477549.100698:0:15043:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fca0ba78/0xafddb3c8f9282d56 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789477549.153774:0:6730:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934602 is committed 00002000:00010000:0.0:1789477549.160717:0:16581:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 5242880 -> 6291456 00002000:00010000:0.0:1789477549.160734:0:16581:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 8199 -> 12295 00010000:00010000:0.0:1789477549.162448:0:16581:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f75f5d68/0xafddb3c8f9282d4f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477549.162476:0:16581:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f75f5d68/0xafddb3c8f9282d4f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477549.162488:0:16581:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f75f5d68/0xafddb3c8f9282d4f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477549.162498:0:16581:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d0d7f518400 already unused, calling callback (ffffffffc15972a0) 00010000:00010000:0.0:1789477549.162504:0:16581:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f75f5d68/0xafddb3c8f9282d4f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477549.162533:0:16581:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f75f5d68/0xafddb3c8f9282d4f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477549.162558:0:16581:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f75f5d68/0xafddb3c8f9282d4f lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477549.162567:0:16581:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f75f5d68/0xafddb3c8f9282d4f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789477549.162716:0:16581:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d74a88e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:d98042a3-6618-44a7-81f9-5553c982b325+11:2354:x1876402783777664:12345-192.168.201.23@tcp:4:dd.0 Request processed in 117317us (369562us total) trans 8589934602 rc 0/0 00000100:00100000:0.0:1789477549.162727:0:16581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 4 00000100:00100000:0.0:1789477549.162776:0:16581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 6 00000100:00100000:0.0:1789477549.162791:0:16581:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d7c3e6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:d98042a3-6618-44a7-81f9-5553c982b325+10:2354:x1876402783777920:12345-192.168.201.23@tcp:4:dd.0 00010000:00010000:0.0:1789477549.162838:0:16581:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005a2d75a6/0xafddb3c8f9282d5d lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477549.162853:0:16581:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789477549.162858:0:16581:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789477549.162866:0:16581:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005a2d75a6/0xafddb3c8f9282d5d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789477549.162880:0:16581:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005a2d75a6/0xafddb3c8f9282d5d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789477549.210671:0:6730:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934603 is committed 00002000:00010000:2.0:1789477549.211253:0:15043:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 6291456 -> 7340032 00010000:00010000:2.0:1789477549.211276:0:15043:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fca0ba78/0xafddb3c8f9282d56 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477549.211292:0:15043:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fca0ba78/0xafddb3c8f9282d56 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477549.211302:0:15043:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fca0ba78/0xafddb3c8f9282d56 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477549.211311:0:15043:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d0d50417000 already unused, calling callback (ffffffffc15972a0) 00010000:00010000:2.0:1789477549.211317:0:15043:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fca0ba78/0xafddb3c8f9282d56 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477549.211328:0:15043:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fca0ba78/0xafddb3c8f9282d56 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477549.211357:0:15043:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fca0ba78/0xafddb3c8f9282d56 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477549.211364:0:15043:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fca0ba78/0xafddb3c8f9282d56 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789477549.211505:0:15043:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d74a89880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:d98042a3-6618-44a7-81f9-5553c982b325+10:2354:x1876402783777792:12345-192.168.201.23@tcp:4:dd.0 Request processed in 110952us (418338us total) trans 8589934603 rc 0/0 00000100:00100000:2.0:1789477549.211516:0:15043:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 5 00000100:00100000:2.0:1789477549.211556:0:15043:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 7 00000100:00100000:2.0:1789477549.211571:0:15043:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d7c3e4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:d98042a3-6618-44a7-81f9-5553c982b325+9:2354:x1876402783778048:12345-192.168.201.23@tcp:4:dd.0 00010000:00010000:2.0:1789477549.211663:0:15043:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009a794c35/0xafddb3c8f9282d64 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477549.211679:0:15043:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789477549.211696:0:15043:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789477549.211703:0:15043:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009a794c35/0xafddb3c8f9282d64 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789477549.211716:0:15043:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009a794c35/0xafddb3c8f9282d64 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789477549.253161:0:6730:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934604 is committed 00002000:00010000:1.0:1789477549.258982:0:16581:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 7340032 -> 7654321 00002000:00010000:1.0:1789477549.259008:0:16581:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 12295 -> 16391 00010000:00010000:1.0:1789477549.259030:0:16581:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005a2d75a6/0xafddb3c8f9282d5d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477549.259046:0:16581:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005a2d75a6/0xafddb3c8f9282d5d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477549.259056:0:16581:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005a2d75a6/0xafddb3c8f9282d5d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477549.259091:0:16581:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d0d82151200 already unused, calling callback (ffffffffc15972a0) 00010000:00010000:1.0:1789477549.259098:0:16581:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005a2d75a6/0xafddb3c8f9282d5d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477549.259110:0:16581:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005a2d75a6/0xafddb3c8f9282d5d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477549.259137:0:16581:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005a2d75a6/0xafddb3c8f9282d5d lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789477549.259146:0:16581:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005a2d75a6/0xafddb3c8f9282d5d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789477549.260658:0:16581:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d7c3e6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:d98042a3-6618-44a7-81f9-5553c982b325+9:2354:x1876402783777920:12345-192.168.201.23@tcp:4:dd.0 Request processed in 97856us (467435us total) trans 8589934604 rc 0/0 00000100:00100000:1.0:1789477549.260677:0:16581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 6 00010000:00010000:3.0:1789477549.293393:0:15043:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009a794c35/0xafddb3c8f9282d64 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477549.293420:0:15043:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009a794c35/0xafddb3c8f9282d64 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477549.293430:0:15043:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009a794c35/0xafddb3c8f9282d64 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477549.293438:0:15043:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d0d50417c00 already unused, calling callback (ffffffffc15972a0) 00010000:00010000:3.0:1789477549.293444:0:15043:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009a794c35/0xafddb3c8f9282d64 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477549.293453:0:15043:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009a794c35/0xafddb3c8f9282d64 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477549.293477:0:15043:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009a794c35/0xafddb3c8f9282d64 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789477549.293484:0:15043:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009a794c35/0xafddb3c8f9282d64 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789477549.293661:0:6730:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934605 is committed 00000100:00100000:3.0:1789477549.293956:0:15043:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d7c3e4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:d98042a3-6618-44a7-81f9-5553c982b325+5:2354:x1876402783778048:12345-192.168.201.23@tcp:4:dd.0 Request processed in 82382us (500726us total) trans 8589934605 rc 0/0 00000100:00100000:3.0:1789477549.293969:0:15043:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 7 00010000:00010000:2.0:1789477549.872295:0:14338:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789477550.559902:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:0.0:1789477550.559944:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:0.0:1789477550.559987:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:2.0:1789477550.559995:0:15038:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783778560 00000100:00100000:2.0:1789477550.560011:0:15038:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783778560 00000100:00100000:1.0:1789477550.560091:0:14344:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783778304 00000100:00100000:1.0:1789477550.560096:0:14344:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783778304 00000100:00100000:0.0:1789477550.560150:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:1.0:1789477550.560167:0:14344:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 124 00000100:00100000:1.0:1789477550.560190:0:14344:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d7c55c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:41935ab2-fae2-41da-aaaf-b7b0ee59bf6c+13:2355:x1876402783778304:12345-192.168.201.23@tcp:400:kworker.0 00000100:00100000:0.0:1789477550.560190:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:0.0:1789477550.560218:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:0.0:1789477550.560247:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:0.0:1789477550.560284:0:14351:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783778816 00000100:00100000:0.0:1789477550.560304:0:14351:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783778816 00000100:00100000:0.0:1789477550.560359:0:14351:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783778432 00000100:00100000:0.0:1789477550.560362:0:14351:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783778432 00000100:00100000:0.0:1789477550.560391:0:14351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 31 00000100:00100000:0.0:1789477550.560400:0:14351:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d7c1f8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:43ab5f84-4c5e-451f-a8c7-1cb9f9e2bde0+6:2355:x1876402783778816:12345-192.168.201.23@tcp:400:kworker.0 00000100:00100000:0.0:1789477550.560733:0:14351:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d7c1f8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:43ab5f84-4c5e-451f-a8c7-1cb9f9e2bde0+6:2355:x1876402783778816:12345-192.168.201.23@tcp:400:kworker.0 Request processed in 331us (749us total) trans 0 rc 0/0 00000100:00100000:1.0:1789477550.560739:0:14344:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d7c55c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:41935ab2-fae2-41da-aaaf-b7b0ee59bf6c+13:2355:x1876402783778304:12345-192.168.201.23@tcp:400:kworker.0 Request processed in 554us (840us total) trans 0 rc 0/0 00000100:00100000:0.0:1789477550.560752:0:14351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 31 00000100:00100000:1.0:1789477550.560756:0:14344:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 124 00000100:00080000:3.0:1789477550.560764:0:14346:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789477550.560771:0:14346:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789477550.560882:0:14351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 32 00000100:00100000:0.0:1789477550.560891:0:14351:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d7c1fb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d98042a3-6618-44a7-81f9-5553c982b325+20:2355:x1876402783778432:12345-192.168.201.23@tcp:400:kworker.0 00000100:00100000:0.0:1789477550.560937:0:14351:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d7c1fb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d98042a3-6618-44a7-81f9-5553c982b325+20:2355:x1876402783778432:12345-192.168.201.23@tcp:400:kworker.0 Request processed in 48us (754us total) trans 0 rc 0/0 00000100:00100000:0.0:1789477550.560945:0:14351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 32 00000100:00100000:0.0:1789477550.560965:0:15469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783779072 00000100:00100000:0.0:1789477550.560968:0:15469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783779072 00000100:00100000:0.0:1789477550.561281:0:15469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783778688 00000100:00100000:0.0:1789477550.561285:0:15469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783778688 00000100:00100000:0.0:1789477550.561355:0:15469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402783778944 00000100:00100000:0.0:1789477550.561358:0:15469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402783778944 00000100:00100000:0.0:1789477550.561372:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 18 00000100:00100000:0.0:1789477550.561449:0:15469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d7c1f9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:43ab5f84-4c5e-451f-a8c7-1cb9f9e2bde0+5:2355:x1876402783779072:12345-192.168.201.23@tcp:400:kworker.0 00000100:00100000:0.0:1789477550.561477:0:15469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d7c1f9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:43ab5f84-4c5e-451f-a8c7-1cb9f9e2bde0+5:2355:x1876402783779072:12345-192.168.201.23@tcp:400:kworker.0 Request processed in 99us (1329us total) trans 0 rc 0/0 00000100:00100000:0.0:1789477550.561483:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 18 00000100:00100000:0.0:1789477550.561499:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 19 00000100:00100000:0.0:1789477550.561505:0:15469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d7c1f8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d98042a3-6618-44a7-81f9-5553c982b325+5:2355:x1876402783778688:12345-192.168.201.23@tcp:400:kworker.0 00000100:00100000:0.0:1789477550.561523:0:15469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d7c1f8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d98042a3-6618-44a7-81f9-5553c982b325+5:2355:x1876402783778688:12345-192.168.201.23@tcp:400:kworker.0 Request processed in 18us (1307us total) trans 0 rc 0/0 00000100:00100000:0.0:1789477550.561529:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 19 00000100:00100000:0.0:1789477550.561538:0:15469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 20 00000100:00100000:0.0:1789477550.561543:0:15469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d7c1f8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:43ab5f84-4c5e-451f-a8c7-1cb9f9e2bde0+5:2355:x1876402783778944:12345-192.168.201.23@tcp:400:kworker.0 00000100:00100000:0.0:1789477550.561559:0:15469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d7c1f8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:43ab5f84-4c5e-451f-a8c7-1cb9f9e2bde0+5:2355:x1876402783778944:12345-192.168.201.23@tcp:400:kworker.0 Request processed in 16us (1311us total) trans 0 rc 0/0 00000100:00100000:0.0:1789477550.561565:0:15469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 20 00000100:00080000:1.0:1789477550.561638:0:14346:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789477550.561644:0:14346:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789477550.562227:0:15038:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 21 00000100:00100000:2.0:1789477550.562246:0:15038:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d7c1f9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d98042a3-6618-44a7-81f9-5553c982b325+5:2355:x1876402783778560:12345-192.168.201.23@tcp:400:kworker.0 00000100:00100000:2.0:1789477550.562313:0:15038:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d7c1f9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d98042a3-6618-44a7-81f9-5553c982b325+5:2355:x1876402783778560:12345-192.168.201.23@tcp:400:kworker.0 Request processed in 75us (2368us total) trans 0 rc 0/0 00000100:00100000:2.0:1789477550.562335:0:15038:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 21 00000001:02000400:2.0:1789477550.877737:0:16619:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-pcc test_1c: @@@@@@ FAIL: expected /mnt/pcc.d1c.sanity-pcc/d1c.sanity-pcc/0bd3/0x200000bd1:0x2:0x0 size: 7654321 got: 0 00010000:00010000:3.0:1789477550.899095:0:15972:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789477551.026105:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d0d7c1fad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1876402802632832:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789477551.026209:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789477551.027307:0:15041:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876402802632832 00000100:00100000:0.0:1789477551.027325:0:15041:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876402802632832 00000100:00100000:0.0:1789477551.027413:0:15041:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1789477551.027426:0:15041:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d0d7c3e5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1876402802632832:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789477551.027478:0:15041:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 3407872 granted 71499776 pending 0 free 3851419648 avail 3849322496 00000100:00100000:0.0:1789477551.027567:0:15041:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d0d7c3e5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1876402802632832:12345-0@lo:13:osp-pre-0-0.0 Request processed in 144us (1358us total) trans 0 rc 0/0 00000100:00100000:0.0:1789477551.027605:0:15041:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00080000:1.0:1789477551.029118:0:14346:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789477551.029185:0:3312:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934597 gen 2 00000004:00080000:1.0:1789477551.029196:0:3312:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9d0d6d466d80, transno 8589934595 00000004:00080000:1.0:1789477551.029218:0:3312:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 8589934597 committed transno 8589934597 00000100:00100000:1.0:1789477551.029262:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d0d7c1fad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1876402802632832:0@lo:13:osp-pre-0-0.0 00000040:00080000:3.0:1789477551.665135:0:14385:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1789477551.665152:0:14385:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1789477551.665195:0:14385:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:3.0:1789477551.665203:0:14385:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00010000:00010000:2.0:1789477551.927973:0:14339:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) Debug log: 29525 lines, 29525 kept, 0 dropped, 0 bad.